OpenAI publishes the original GPT (GPT-1) paper
The GPT (commonly called GPT-1) paper Improving Language Understanding by Generative Pre-Training — a 12-layer decoder-only Transformer pretrained on BooksCorpus, then fine-tuned for each task
Why it matters
Reported that combining unsupervised generative pre-training with supervised fine-tuning improved the state of the art on 9 of the 12 tasks studied
Source — Primary sources first; secondary reports are labelled “Press”
Officialopenai.comhttps://openai.com/index/language-unsupervised/Added in Week 41, 2026 · See that week