Understanding the difficulty of training deep feedforward neural networks

Understanding the difficulty of training deep feedforward neural networks — presented at AISTATS 2010

Why it matters

Showed that activation functions and initialization determine training stability. The origin of Glorot initialization

Source — Primary sources first; secondary reports are labelled “Press”

Paperproceedings.mlr.presshttp://proceedings.mlr.press/v9/glorot10a.html

Added in Week 35, 2026 · See that week

Nearby on the same axis

ImageNet holds the first ILSVRCOfficialRectified Linear Units Improve Restricted Boltzmann MachinesOfficialBergstra et al. present TheanoOfficialDeep Big Simple Neural Nets Excel on Handwritten Digit RecognitionPaper