Evaluation & BenchmarksLianmin Zheng et al. (LMSYS)LMSYS

MT-Bench and LLM-as-a-judge published

MT-Bench and LLM-as-a-judge published — a GPT-4 judge agrees with human preferences more than 80% of the time

Why it matters

Became the basis for automated evaluation and synthetic rewards, flowing directly into post-training pipelines

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2306.05685

Added in Week 35, 2026 · See that week

Nearby on the same axis

Hugging Face explains the MMLU score mismatch on the Open LLM LeaderboardOfficialLMSYS launches Chatbot ArenaOfficialSWE-bench releasedPaperGPQA releasedPaper