Prehistory — From Neural Networks to the TransformerKurt Hornik, Maxwell Stinchcombe, Halbert White

Multilayer feedforward networks are universal approximators

Multilayer feedforward networks are universal approximators — extended the universal approximation theorem to general conditions

Why it matters

Together with Cybenko, established the foundation for the approximation capability of multilayer feedforward neural networks

Source — Primary sources first; secondary reports are labelled “Press”

Pressen.wikipedia.orghttps://en.wikipedia.org/wiki/Universal_approximation_theorem

Added in Week 35, 2026 · See that week

Nearby on the same axis

Approximation by superpositions of a sigmoidal functionOfficialBackpropagation Applied to Handwritten Zip Code RecognitionPressHochreiter's TU Munich thesis identifies the vanishing gradient problemPressLearning representations by back-propagating errorsPaper