GSM1k released
GSM1k released — a check of GSM8k contamination. Performance drops by up to 8% on the new problem set
Why it matters
Measured benchmark contamination with a controlled experiment. However, reported that frontier models show few signs of overfitting
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2405.00332Added in Week 35, 2026 · See that week