On-Device & Local InferenceElias Frantar et al. (IST Austria, ETH)ETH Zurich

Frantar et al. present GPTQ

Presented GPTQ — post-training quantization of a 175B model to 3–4 bits in about 4 GPU hours, fitting it on a single GPU

Why it matters

Standardized quantization as a post-processing step

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2210.17323

Added in Week 35, 2026 · See that week

Same week

APE — LLMs Are Human-Level Prompt EngineersPaper

Nearby on the same axis

Dettmers et al. present LLM.int8()PaperGeorgi Gerganov starts developing llama.cppPressggml project introduces the GGUF (GGML Universal File) formatPressMicrosoft Research publishes Phi-3 technical reportPaper