AntTech

Jul 28, 2026 · Artificial Intelligence

Introducing PIBench: A Payment‑Scenario Benchmark for AI Coding Agents

PIBench, an open‑source benchmark from Alipay’s AI payment team, defines 459 rubric items across 9 payment products and 9 real‑world projects to evaluate AI coding agents’ ability to integrate secure payment flows, covering basic functionality and advanced risk‑handling, with detailed experimental results showing significant model gaps and the impact of structured skill guidance.