Model Architecture & Training MethodsPeng et al. (Nous, EleutherAI)Nous ResearchEleutherAI

YaRN

YaRN

Why it matters

The de facto standard recipe for context extension, unifying Position Interpolation and NTK-aware interpolation

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2309.00071

Added in Week 35, 2026 · See that week

Same week

pgvector 0.5.0 adds HNSW indexesOfficial

Nearby on the same axis

StreamingLLMPaperMambaPaperGQAPaperRWKVPaper