Prehistory — From Neural Networks to the TransformerDavid Rumelhart, Geoffrey Hinton, Ronald WilliamsGeoffrey Hinton

Learning representations by back-propagating errors

Learning representations by back-propagating errors — Nature 323(6088) 533–536

Why it matters

Showed that hidden layers learn useful internal representations for a task on their own, making the training of multilayer neural networks practical

Source — Primary sources first; secondary reports are labelled “Press”

Papernature.comhttps://www.nature.com/articles/323533a0

Added in Week 35, 2026 · See that week

Nearby on the same axis

Approximation by superpositions of a sigmoidal functionOfficialMultilayer feedforward networks are universal approximatorsPressBackpropagation Applied to Handwritten Zip Code RecognitionPressHochreiter's TU Munich thesis identifies the vanishing gradient problemPress