Machine Heart

Jul 19, 2026 · Artificial Intelligence

ACL 2026 Best Resource Paper Reveals AI Agents’ Expert-Level Capability Gap

The HSCodeComp benchmark shows that state‑of‑the‑art AI agents achieve only about 49.4% exact‑match accuracy on the 10‑digit HS Code classification task, far below the 95% accuracy of human customs experts, highlighting a structural gap in hierarchical rule application.