AI Infrastructure SoftwareAlexander Sergeev et al. (Uber)

Uber presents Horovod

Presented Horovod — ring all-reduce cut communication overhead between GPUs and reduced the changes needed in user code to a few lines

Why it matters

The turning point that brought distributed training down from research infrastructure to an everyday tool

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/1802.05799

Added in Week 35, 2026 · See that week

Same week

Chen et al. present TVMPaper

Nearby on the same axis

Chen et al. present TVMPaperNVIDIA announces NVSwitch and DGX-2OfficialJAX goes open sourceOfficialNVIDIA releases a preview of CUTLASSOfficial