Rectified Linear Units Improve Restricted Boltzmann Machines
Rectified Linear Units Improve Restricted Boltzmann Machines — presented at ICML 2010
Why it matters
An early paper demonstrating the advantages of ReLU, which later became the standard activation function
Source — Primary sources first; secondary reports are labelled “Press”
Officialcs.toronto.eduhttps://www.cs.toronto.edu/~hinton/absps/reluICML.pdfAdded in Week 35, 2026 · See that week