SmartApe AI

Oct 24, 2026 · Artificial Intelligence

ByteDance TraceDance: 250K Real Trajectories Expose Frontier Model Behavioral Failures

ByteDance's TraceDance system automatically converts 252,557 real-world agent deployment trajectories into 107 behavioral benchmarks with 4,125 test instances, evaluating nine frontier models including Claude, GPT, and DeepSeek, which achieve only a 26.7% average pass rate on decision-point continuation tasks, revealing gaps between task completion and critical behavioral decisions.