Running 14 The Jagged AI Frontier is a Data Frontier 🧭 14 Why AI capabilities are shaped by data availability
view article Article Saving Memory Using Padding-Free Transformer Layers during Finetuning Jun 11, 2024 • 21
view article Article Nemotron 3 Nano \- A new Standard for Efficient, Open, and Intelligent Agentic Models 11 days ago • 99
view article Article Tensor Parallelism (TP) in Transformers: 5 Minutes to Understand 22 days ago • 62
Running on CPU Upgrade Featured 2.69k The Smol Training Playbook 📚 2.69k The secrets to building world-class LLMs
Running 72 Unlocking On-Policy Distillation for Any Model Family 📝 72 Apply on-policy distillation to any model family