Dolma

Dolma — 3 trillion tokens and a curation toolkit, open-sourced

Why it matters

Released the data together with the tools, making data science reproducible

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2402.00159

Added in Week 35, 2026 · See that week

Same week

KTO — alignment from binary signals based on prospect theoryPaperNomic Embed publishedPaperRAPTOR publishedPaperCorrective RAG publishedPaper

Nearby on the same axis

KTO — alignment from binary signals based on prospect theoryPaperDeepSeek introduces GRPO (DeepSeekMath)PaperRLOOPaperORPOPaper