한국어EN
Model Architecture & Training MethodsKeller Jordan

Keller Jordan releases the Muon optimizer

Muon optimizer released

Why it matters

Set new training-speed records over AdamW using Newton-Schulz orthogonalization

Source — Primary sources first; secondary reports are labelled “Press”

Officialkellerjordan.github.iohttps://kellerjordan.github.io/posts/muon/

Added in Week 35, 2026 · See that week

Same week

Meta releases Llama 3.3 70BOfficialOpenAI launches ChatGPT Pro at $200 a month, full o1 and o1 pro modeOfficialBIS expands the FDPR, adds HBM controls and 140 Entity List entriesGovernmentNous Research releases DeMo paper and code; 15B model trained with DisTrOOfficial

Nearby on the same axis

Byte Latent TransformerPaperDeepSeek-V3 Technical ReportPaperNie et al. present LLaDAPaperNSA — Native Sparse AttentionPaper