Evaluation & Benchmarksdeedy (imo-2026 community project)Community

imo-2026 project runs 7 frontier models on IMO 2026, publishes audit trails

Ran the IMO 2026 problems autonomously on 7 frontier models and published the audit trails and independent grading — Claude Fable 5, GPT-5.6 Sol (xhigh) and Kimi K3 were checked at a perfect 42/42 (runs Jul 17–23)

Why it matters

A community-led release of audit trails, rather than a lab announcement, plus real-time olympiad evaluation with independent grading emerges as a new practice for checking results

Source — Primary sources first; secondary reports are labelled “Press”

Officialgithub.comhttps://github.com/deedy/imo-2026

Added in Week 35, 2026 · See that week

Same week

AMD launches Helios rack-scale system and Instinct MI455XOfficialUpstage releases Solar Open 2OfficialPlaintiffs file second amended complaint in Concord v. AnthropicPressSimon Willison blogs on OpenAI's accidental cyberattack against Hugging FaceOfficial

Nearby on the same axis

BioSecBench-Refusal releasedPaperSurge AI publishes LMArena is a cancer on AIOfficialGoogle DeepMind and partners pilot double-blind evaluation of frontier modelsOfficialResearchers release RealSWEPaper