Prehistory — From Neural Networks to the TransformerRajat Raina, Anand Madhavan, Andrew Y. Ng (Stanford University)Andrew NgStanford University

Large-scale Deep Unsupervised Learning using Graphics Processors

Large-scale Deep Unsupervised Learning using Graphics Processors — presented at ICML 2009

Why it matters

An early case of applying GPUs to deep learning training in earnest. The starting point of the premise that compute is a resource

Source — Primary sources first; secondary reports are labelled “Press”

Officialrobotics.stanford.eduhttp://robotics.stanford.edu/~ang/papers/icml09-LargeScaleUnsupervisedDeepLearningGPU.pdf

Added in Week 35, 2026 · See that week

Nearby on the same axis

ImageNet: A Large-Scale Hierarchical Image DatabaseOfficialDeep Big Simple Neural Nets Excel on Handwritten Digit RecognitionPaperUnderstanding the difficulty of training deep feedforward neural networksPaperImageNet holds the first ILSVRCOfficial