ShoppingBench: AAAI'26 Benchmark for Shopping Agents in Real‑World E‑Commerce

The paper presents ShoppingBench, a large‑scale e‑commerce benchmark built on a 2.5 million‑product virtual sandbox, evaluates 17 LLM agents (with GPT‑4.1 achieving under 50 % success), and introduces ORM‑Virtual environment, scalable data synthesis, trajectory distillation and RL to train a lightweight model that rivals GPT‑4.1, now deployed in LazzieChat.

Agentic AIBenchmarkLLM

0 likes · 12 min read