AI Infrastructure SoftwareYanli Zhao et al. (Meta)Meta

PyTorch FSDP paper published

PyTorch FSDP paper published — built ZeRO-style sharding into the PyTorch core

Why it matters

The turning point at which large-scale training became possible with the standard framework, without DeepSpeed

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2304.11277

Added in Week 35, 2026 · See that week

Same week

Weaviate announces $50 million Series BPressLLaVAPaperRedPajama-Data-1TOfficial

Nearby on the same axis

PyTorch 2.0 released (torch.compile in beta)OfficialZeRO++ publishedPaperFlashAttention-2 publishedPaperModular makes Mojo available for local downloadOfficial