Training Data & Post-TrainingKandpal et al.
Common Pile v0.1
Common Pile v0.1 — 8TB of openly licensed text
Why it matters
The data-side response to litigation risk; reached Llama 1 and 2 7B-class performance with openly licensed data alone
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2506.05209Added in Week 35, 2026 · See that week