Douyin and Peking University introduced STEPS, a self‑triggered agentic push recommendation system that redefines push notifications as a closed‑loop decision problem, achieving higher user activity, lower opt‑out rates, and 79% resource savings in a billion‑user online A/B test.
The article presents Tencent’s GRB (Generative Reinforcement Bidding) framework, a multi‑slot online advertising solution that combines a Decision‑Transformer‑based generative model with an Offline‑to‑On‑Policy (O2P) training paradigm and an adaptive constraint‑exploration module, and demonstrates statistically significant gains over strong baselines in both offline and large‑scale online A/B tests.
This article explains the core challenges of real‑time bidding, traces the evolution from PID to MPC to reinforcement learning, and details how generative reinforcement‑learning techniques such as GAVE and CBD combine diffusion models, value‑guided exploration, and score‑based return‑to‑go to dramatically improve ad‑bid efficiency and revenue.
The NeurIPS 2024 Auto‑Bidding competition attracted over 15,000 submissions and 1,500 teams, featuring two tracks—General and AI‑Generated Bidding—where Kuaishou’s commercial algorithm team secured first place in both by leveraging reinforcement‑learning‑based online exploration and a decision‑transformer‑driven generative approach, achieving more than a 5% lift in ad revenue.
