1991, in 1 pieces
1 records · 0 notes
Year only 1
Sepp Hochreiter
Hochreiter's TU Munich thesis identifies the vanishing gradient problem
The first to show that the learning signal vanishes as depth and sequence length grow. The problem definition behind LSTM and residual connections