Evaluation & BenchmarksGoogle DeepMind, Singapore AI Safety Institute, OpenMined, AVERI, MLCommonsGoogle DeepMind
Google DeepMind and partners pilot double-blind evaluation of frontier models
Released a pilot of double-blind evaluation of frontier models — external evaluators tested Gemini Flash Lite-family models inside Google Cloud Confidential Space. The evaluators cannot see the model weights, and Google cannot see the evaluators' test prompts. It is at the pilot stage, and evaluation scores are not published
Why it matters
An attempt at evaluation infrastructure that aims both to prevent benchmark contamination and to protect IP — a path to checking frontier models with private benchmarks
Source — Primary sources first; secondary reports are labelled “Press”
Officialdeepmind.googlehttps://deepmind.google/blog/piloting-the-worlds-first-double-blind-ai-evaluations/Added in Week 36, 2026 · See that week