Projects

PyTorch

Open-source deep learning framework

4recordsFirst record 2021Latest Oct 22, 2025

Records 4

Newest first. Open one to see it with its source.

PyTorch (Meta)
PyTorch releases Monarch

The point at which the single-controller model proposed by Google's Pathways in 2022 entered the core PyTorch lineage. TorchTitan becomes an actor inside Monarch, and torchforge is built on top of Monarch

PyTorch (Meta)
Helion released in beta

Just as Triton abstracted CUDA by one level, Helion abstracts Triton by one more. The next layer in the lineage of kernel authoring

PyTorch (Tristan Rice, Howard Huang et al.)
torchft + TorchTitan keep 81.2% efficiency on 300 GPUs with failures every 60 s

An attempt to replace the checkpoint-based recovery paradigm. Treats each step as a distributed transaction

PyTorch (Meta)
PyTorch opens the FSDP2 RFC

A redesign of FSDP1. The precondition that made FP8 training, partial freezing and compiler optimization possible