Google Research announces PaLM (540B)

PaLM (Pathways Language Model) announced — a 540B dense decoder-only Transformer trained on 6,144 TPU v4 chips with Pathways

Why it matters

The first large-scale use of the Pathways system; reported surpassing the few-shot performance of prior large models such as GPT-3, Gopher and Chinchilla on 28 of 29 English NLP tasks

Source — Primary sources first; secondary reports are labelled “Press”

Officialresearch.googlehttps://research.google/blog/pathways-language-model-palm-scaling-to-540-billion-parameters-for-breakthrough-performance/

Added in Week 41, 2026 · See that week

Nearby on the same axis

ChinchillaPaperModel SoupsPapermuP / Tensor Programs VPaperLi et al. present Diffusion-LMPaper