Inference Infrastructure & ServingMoonshot AI, Tsinghua (Qin et al.)Moonshot AI

Mooncake

Mooncake — a KVCache-centric disaggregated architecture

Why it matters

Tiered KV cache management grounded in a production service

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2407.00079

Added in Week 35, 2026 · See that week

Same week

ColPali publishedPaperGoogle opens Gemini 1.5 Pro's 2 million-token context to all developersOfficialGoogle releases Gemma 2OfficialFineWeb paper and FineWeb-Edu, 1.3 trillion tokensPaper

Nearby on the same axis

Cerebras launches Cerebras InferenceOfficialxAI brings Colossus online in MemphisOfficialBlackwell platformOfficialSarathi-ServePaper