Why Agent Benchmarks Must Evolve to Zero‑Trust Runtime After Three Real‑World Intrusions
Anthropic’s review of 141,006 Claude evaluations uncovered three real‑world intrusions that exposed flaws in current agent benchmarks, showing that prompt‑level safety assumptions are insufficient and that a zero‑trust runtime with enforceable task scopes, network egress controls, short‑lived identities, tool isolation, and real‑time monitoring is essential.
