Prehistory — From Neural Networks to the TransformerOlaf Ronneberger, Philipp Fischer, Thomas Brox (University of Freiburg)

Ronneberger, Fischer and Brox publish U-Net on arXiv

U-Net released on arXiv — an encoder-decoder segmentation architecture with skip connections

Why it matters

Proposed for medical imaging, but later became the basic backbone of generative work such as diffusion models

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/1505.04597

Added in Week 35, 2026 · See that week

Nearby on the same axis

Google publishes Distilling the Knowledge in a Neural Network on arXivPaperHuman-level control through deep reinforcement learningPaperGoogle publishes Batch Normalization on arXivPaperAdam: A Method for Stochastic OptimizationPaper