Running 249 The ultimate guide to RL environments: building and scaling them in the LLM era 📝 249 Building and scaling RL environments for LLM training
Running on CPU Upgrade 58 MiMo RL Environment Explorer 🧭 58 Explore the MiMo-V2.6 RL environments and run rollouts
view article Article The Road to Open Source Hell Is Paved With Good Intentions qgallouedec • 7 days ago • 11
view article Article Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps +1 iamleonie, burtenshaw, sergiopaniego • 28 days ago • 140
Running Featured 84 QED-Nano: Teaching a Tiny Model to Prove Hard Theorems 📝 84 Who needs 1T parameters? Olympiad proofs with a 4B model
view article Article Mixture of Experts (MoEs) in Transformers +5 ariG23498, pcuenq, merve, IlyasMoutawwakil, ArthurZ, sergiopaniego, Molbap • Feb 26 • 179
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 169
view article Article We Got Claude to Build CUDA Kernels and teach open models! +2 burtenshaw, evalstate, merve, pcuenq • Jan 28 • 158
view article Article Mixture of Experts Explained +4 osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq • Dec 11, 2023 • 1.19k
📝 Research & Long-Form Blog Posts Collection In-depth technical articles and research pieces published by Hugging Face • 20 items • Updated Aug 6 • 35