Model Architecture & Training MethodsGreg Yang et al.

muP / Tensor Programs V

muP / Tensor Programs V

Why it matters

Transferred hyperparameters tuned on small models zero-shot to large ones, making the practice of getting it right in a single run possible

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2203.03466

Added in Week 35, 2026 · See that week

Same week

Model SoupsPaperMarcus writes Deep Learning Is Hitting a Wall for NautilusOfficial

Nearby on the same axis

Model SoupsPaperChinchillaPaperGoogle Research announces PaLM (540B)OfficialLi et al. present Diffusion-LMPaper