Nous Research publishes DisTrO preliminary report
DisTrO preliminary report published — a family of optimizers that cuts inter-GPU communication by 3–4 orders of magnitude
Why it matters
The starting point of the approach of training over internet bandwidth, without data center interconnects
Source — Primary sources first; secondary reports are labelled “Press”
Officialgithub.comhttps://github.com/NousResearch/DisTrOAdded in Week 35, 2026 · See that week