PyTorch releases Monarch
Monarch released — a distributed framework that uses a single controller instead of SPMD to treat a cluster like an array. Separates the control plane (messaging) from the data plane (RDMA). In the VERL integration it scaled from 16 to 2,048 H200 GPUs; with the torchft integration, injecting a failure every 3 minutes on 240 H100 GPUs, recovery was 60% faster than a full SLURM restart (90 seconds on average for process failures, 2.5 minutes for machine failures)
Why it matters
The point at which the single-controller model proposed by Google's Pathways in 2022 entered the core PyTorch lineage. TorchTitan becomes an actor inside Monarch, and torchforge is built on top of Monarch
Source — Primary sources first; secondary reports are labelled “Press”
Officialpytorch.orghttps://pytorch.org/blog/introducing-pytorch-monarch/Added in Week 36, 2026 · See that week