Training Data & Post-TrainingSainz et al.

NLP Evaluation in trouble

NLP Evaluation in trouble

Why it matters

A proposal to make measuring contamination for each benchmark a community standard

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2310.18018

Added in Week 35, 2026 · See that week

Same week

FP8-LM publishedPaperBIS issues second round of export controlsGovernment

Nearby on the same axis

Rethinking Benchmark and ContaminationPaperDolmaPaperKTO — alignment from binary signals based on prospect theoryPaperDeepSeek introduces GRPO (DeepSeekMath)Paper