Loop & Harness EngineeringZhang et al. (arXiv:2605.23950)
Stop Comparing LLM Agents Without Disclosing the Harness
Stop Comparing LLM Agents Without Disclosing the Harness
Why it matters
Harness-induced variance was 7.80× model-induced variance, and rankings flipped in 6 of 9 model pairs
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2605.23950Added in Week 35, 2026 · See that week