PaperAgent

Oct 30, 2026 · Artificial Intelligence

FDE-Gym Benchmark Exposes AI Delivery Gap: Top Models Solve Only 14 of 95 Tasks

Tsinghua, Microsoft, and collaborators introduce FDE-Gym, a reproducible benchmark for AI delivery agents across 20 customer scenarios and 95 tasks, revealing that even Claude Opus 5.5 solves only 14 tasks at the most realistic level, with the core bottleneck being discovery of implicit constraints and translation of facts into deployed systems.