METR

It described evaluator partnerships in 3 tiers and presented this as the deepest, saying it is in early discussions with other organizations including Hugging Face. It added the caveat that information about model archit

The first follow-up result of the methodology overhaul announced on Feb 24, 2026. It noted again that, in the 2025 study, respondents had overestimated the impact on time taken by 40 percentage points on average

Redesigned the experiment because of selection bias (a growing number of participants refusing to work without AI). It did not retract its 2025 result of 19%, but said developers in early 2026 were likely faster, explici

A case of the issuing organization itself showing that a change in methodology alone moves the numbers. The top model's 50% time horizon of about 5.3 hours is based on this revision and cannot be compared directly with t

A case of the issuing organization itself putting the brakes on its own metric being over-generalized when cited

Laid out 9 common elements across 12 companies' policies and became a de facto quasi-standard document for the industry

A consensus document on CoT monitoring, co-signed by major labs

The first RCT to measure a gap running in opposite directions between perceived and measured speed

Proposed a new coordinate system: time of autonomous work rather than benchmark scores