EleutherAI releases lm-evaluation-harness v0.4.3

lm-evaluation-harness v0.4.3 released — a framework integrating more than 60 academic benchmarks, and the backend of the Open LLM Leaderboard

Why it matters

Created a structure in which evaluation infrastructure is concentrated in a few open-source implementations

Source — Primary sources first; secondary reports are labelled “Press”

Officialgithub.comhttps://github.com/EleutherAI/lm-evaluation-harness

Added in Week 35, 2026 · See that week

Nearby on the same axis

OpenAI releases SWE-bench VerifiedOfficialGSM1k releasedPaperEpoch AI releases FrontierMathPaperARC Prize releases o3's ARC-AGI resultsOfficial