RAG, Fine-Tuning & ContextMicrosoft (Edward J. Hu et al.)Microsoft

LoRA

LoRA

Why it matters

Freezes the weights and trains only low-rank matrices, cutting trainable parameters to 1/10,000 for GPT-3 175B, with no increase in inference latency

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2106.09685

Added in Week 35, 2026 · See that week

Nearby on the same axis

Santhanam et al. present ColBERTv2PaperFAIR, UCL and NYU publish the original RAG paperPaperKhattab et al. present ColBERTPaperChase publishes the first public release of LangChain (PyPI 0.0.1)Official