Model Architecture & Training MethodsPearce & Song
Reconciling Kaplan and Chinchilla Scaling Laws
Reconciling Kaplan and Chinchilla Scaling Laws
Why it matters
Showed that the conflict between the two laws stems from counting non-embedding parameters and from analysis at small scale
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2406.12907Added in Week 35, 2026 · See that week