NVIDIA announces NVSwitch and DGX-2

Announced NVSwitch and DGX-2 — connects 16 V100 GPUs simultaneously at 2.4 TB/s, with 5 times the bandwidth of a PCIe switch

Why it matters

The layer that made the inside of a node one big GPU. The physical precondition for tensor parallelism becoming practical

Source — Primary sources first; secondary reports are labelled “Press”

Officialnvidianews.nvidia.comhttps://nvidianews.nvidia.com/news/nvidia-boosts-worlds-leading-deep-learning-computing-platform-bringing-10x-performance-gain-in-six-months

Added in Week 35, 2026 · See that week

Nearby on the same axis

Uber presents HorovodPaperChen et al. present TVMPaperJAX goes open sourceOfficialNVIDIA releases a preview of CUTLASSOfficial