Sep 24, 2026 · Artificial Intelligence

Seed-2.1-Pro 0915 Stress Test: Honesty Under Tool Failures & Missing Data

The author evaluates Seed-2.1-Pro 0915 against its predecessor using simulated tool failures, cropped financial PDFs, and a full analysis pipeline, finding both models honest when evidence is missing but revealing post-processing unit conversion errors, concluding that model execution requires system-level verification.

LLM evaluationSeed-2.1-Proagent honesty

0 likes · 15 min read

Seed-2.1-Pro 0915 Stress Test: Honesty Under Tool Failures & Missing Data