Infrastructure noise in agentic coding evals
Anthropic · www.anthropic.com/research/infrastructure-noise
显示原文摘录
Agentic coding benchmarks are treated as precise measures of model capability, but infrastructure configuration alone can meaningfully shift scores.