RAG, Fine-Tuning & ContextZhuowan Li et al. (Google DeepMind, University of Michigan)Google DeepMind

Retrieval Augmented Generation or Long-Context LLMs? published

Retrieval Augmented Generation or Long-Context LLMs? published — compares the two approaches and proposes a hybrid that routes based on the model's self-assessment

Why it matters

Framed the long-context vs RAG debate as a cost-performance trade-off

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2407.16833

Added in Week 35, 2026 · See that week

Same week

Google DeepMind announces AlphaProof and AlphaGeometry 2 results at IMO 2024OfficialAndrej Karpathy posts the term jagged intelligence on XPressAI models collapse when trained on recursively generated dataPaperMistral AI releases Mistral Large 2Official

Nearby on the same axis

Context Caching on DiskOfficialAnthropic launches prompt caching in public betaOfficialColPali publishedPaperGoogle opens Gemini 1.5 Pro's 2 million-token context to all developersOfficial