NVIDIA previews a 2.8 trillion token corpus for 22 Indian languages
NVIDIA announced the coming release of a 2.8 trillion token pretraining corpus for 22 Indian languages — Nemotron-pretraining-Indic-v1, built with AI4Bharat at IIT Madras, comes together with an open generation pipeline that combines translation, quality scoring and restoration
Why it matters
Company-reported, it covers 34 language and script combinations with 2.601 trillion tokens in native scripts plus 224.6 billion in Latin script, and includes 438.4 billion restored tokens kept only where the quality score was 75 or above. Continuing the training of Nemotron 3.5 Super VL on part of this corpus raised five Indic benchmarks by 4.98 to 9.82 percentage points, with the caveat that this is not the effect of the synthetic corpus alone
Source — Primary sources first; secondary reports are labelled “Press”
Officialhuggingface.cohttps://huggingface.co/blog/nvidia/scaling-indic-pretrainingAdded in Week 43, 2026 · See that week