SuanNi

Jun 17, 2026 · Artificial Intelligence

How Harness Design Alters Coding Agent Scores: Insights from the First Independent Claw‑SWE‑Bench

The Claw‑SWE‑Bench benchmark isolates model, harness, and task variables, showing that changing only the harness can shift Pass@1 scores by up to 27 points and affect cost dramatically, while also providing a lightweight 80‑question Lite version for rapid, low‑cost evaluation.