Prehistory — From Neural Networks to the TransformerQuoc V. Le, Jeff Dean, Andrew Y. Ng et al. (Google Brain)Quoc V. LeJeff DeanAndrew NgGoogle
Building high-level features using large scale unsupervised learning
Building high-level features using large scale unsupervised learning released on arXiv — unsupervised learning on 10 million YouTube frames
Why it matters
Showed that high-level concepts emerge from nothing more than large-scale unlabeled data and large-scale compute. A symbol of Google's investment in deep learning
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/1112.6209Added in Week 35, 2026 · See that week