RAG, Fine-Tuning & ContextTim Dettmers et al.

QLoRA

QLoRA

Why it matters

Fine-tunes a 65B model on a single 48 GB GPU using 4-bit NF4, double quantization and paged optimizers

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2305.14314

Added in Week 35, 2026 · See that week

Same week

RAP (Reasoning via Planning) publishedPaperMultiagent Debate publishedPaperGQAPaperRWKVPaper

Nearby on the same axis

Anthropic expands Claude's context window from 9K to 100KOfficialPinecone raises $100 million Series B at a $750 million valuationOfficialLost in the Middle publishedPaperOpenAI releases ChatGPT plugins and open-sources the retrieval pluginOfficial