Ilya Sutskever says results from scaling up pretraining have plateaued
Said that results from scaling up pretraining have plateaued
Why it matters
The first public statement of skepticism about pretraining scaling
Source — Primary sources first; secondary reports are labelled “Press”
Pressmalaymail.comhttps://www.malaymail.com/news/money/2024/11/12/openai-and-rivals-seek-new-path-to-smarter-ai-as-current-methods-hit-limitations/156551Added in Week 35, 2026 · See that week