Ilya Sutskever gives the NeurIPS 2024 Test of Time talk
NeurIPS 2024 Test of Time talk — declared that pre-training as we know it will unquestionably end, likened data to the fossil fuel of AI, and diagnosed that peak data has been reached
Why it matters
Scaling skepticism came not from a critic but from one of the founders of the scaling paradigm. Peak data became an industry-standard term
Source — Primary sources first; secondary reports are labelled “Press”
Presstheverge.comhttps://www.theverge.com/2024/12/13/24320811/what-ilya-sutskever-sees-openai-model-data-trainingAdded in Week 35, 2026 · See that week