AI Infrastructure SoftwareHouwen Peng et al. (Microsoft)Microsoft

FP8-LM published

FP8-LM published — training GPT-175B on H100 cut actual memory use by 39% and ran 75% faster than BF16 Megatron-LM

Why it matters

An early demonstration that FP8 training actually works for large models

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2310.18313

Added in Week 35, 2026 · See that week

Same week

NLP Evaluation in troublePaperBIS issues second round of export controlsGovernment

Nearby on the same axis

Modular makes Mojo available for local downloadOfficialFlashAttention-2 publishedPaperZeRO++ publishedPaperPyTorch FSDP paper publishedPaper