Training Data & Post-TrainingXu et al.
Magpie
Magpie — 4 million instructions generated from nothing but an empty chat template
Why it matters
Distillation became so cheap that it no longer even needs API calls
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2406.08464Added in Week 35, 2026 · See that week