Training Data & Post-TrainingTogether

RedPajama-Data-1T

RedPajama-Data-1T

Why it matters

An open reproduction of the LLaMA training recipe that opened an era of reverse-engineering the data behind closed models

Source — Primary sources first; secondary reports are labelled “Press”

Officialtogether.aihttps://www.together.ai/blog/redpajama

Added in Week 35, 2026 · See that week

Same week

Weaviate announces $50 million Series BPressPyTorch FSDP paper publishedPaperLLaVAPaper

Nearby on the same axis

RefinedWebPaperTextbooks Are All You NeedPaperSelf-InstructPaperNLP Evaluation in troublePaper