Prehistory — From Neural Networks to the TransformerAlex Graves, Greg Wayne, Ivo Danihelka (DeepMind)Google DeepMind

DeepMind publishes Neural Turing Machines on arXiv

Neural Turing Machines released on arXiv — a neural network that reads from and writes to external memory

Why it matters

The idea of handling memory through attention-based addressing. The start of the memory-augmented lineage

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/1410.5401

Added in Week 35, 2026 · See that week

Nearby on the same axis

Google publishes Sequence to Sequence Learning with Neural Networks on arXivPaperVery Deep Convolutional Networks for Large-Scale Image Recognition (VGG)PaperNeural Machine Translation by Jointly Learning to Align and TranslatePaperAdam: A Method for Stochastic OptimizationPaper