On-Device & Local InferenceGeorgi Gerganov

Georgi Gerganov starts developing llama.cpp

Started developing llama.cpp — Llama inference implemented in pure C/C++ with no dependencies

Why it matters

Spread among users without dedicated hardware. Being able to run on a CPU alone was decisive

Source — Primary sources first; secondary reports are labelled “Press”

Pressen.wikipedia.orghttps://en.wikipedia.org/wiki/Llama.cpp

Added in Week 35, 2026 · See that week

Nearby on the same axis

Frantar et al. present GPTQPaperggml project introduces the GGUF (GGML Universal File) formatPressDettmers et al. present LLM.int8()PaperMicrosoft Research publishes Phi-3 technical reportPaper