Nous Research releases DeMo paper and code; 15B model trained with DisTrO

DeMo paper and code released; training of a 15B model with DisTrO completed

Why it matters

Claims at the level of a preliminary report turned into a reproducible paper and code

Source — Primary sources first; secondary reports are labelled “Press”

Officialgithub.comhttps://github.com/NousResearch/DisTrO

Added in Week 35, 2026 · See that week

Same week

Keller Jordan releases the Muon optimizerOfficialMeta releases Llama 3.3 70BOfficialOpenAI launches ChatGPT Pro at $200 a month, full o1 and o1 pro modeOfficialBIS expands the FDPR, adds HBM controls and 140 Entity List entriesGovernment

Nearby on the same axis

Tülu 3PaperOpenAI confirms talks with officials over DeepSeek distillation allegationsPressNous Research publishes DisTrO preliminary reportOfficialCan AI scaling continue through 2030?Official