NVIDIA releases NCCL
Released NCCL — provides topology-aware collective communication primitives
Why it matters
The standard layer that optimizes all-reduce for the hardware topology. All data-parallel, ZeRO and FSDP training runs on top of it
Source — Primary sources first; secondary reports are labelled “Press”
Officialdeveloper.nvidia.comhttps://developer.nvidia.com/blog/fast-multi-gpu-collectives-nccl/Added in Week 35, 2026 · See that week