surrogate metrics

DataFunSummit

Mar 10, 2024 · Artificial Intelligence

Evaluating Long-Term Strategy Effects with A/B Experiments: Causes, Industry Solutions, and Business Cases

This article examines why A/B experiments often capture only short‑term impacts, explains external and internal factors behind short‑ and long‑term effects, and presents seven industrial methods—including user‑learning models, personalized recommendation adjustments, surrogate metrics, and bias correction—supported by real‑world case studies.