Model Architecture & Training MethodsDeepMind (Hoffmann et al.)Google DeepMind

Chinchilla

Chinchilla — derived from over 400 models that parameters and tokens should be scaled in equal proportion

Why it matters

Exposed that the large models of the time were undertrained; the 70B model outperformed the 280B Gopher

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2203.15556

Added in Week 35, 2026 · See that week

Nearby on the same axis

Google Research announces PaLM (540B)OfficialModel SoupsPapermuP / Tensor Programs VPaperLi et al. present Diffusion-LMPaper