Didi Tech
Apr 10, 2025 · Product Management
AA Testing and Rerandomization Techniques for Reliable AB Experiments
The article outlines how AA testing and rerandomization can detect and correct non‑uniform traffic splits in short‑term AB experiments, detailing three solutions—AA tests, seed‑based rerandomization, and retrospective AA analysis—along with theoretical guarantees, empirical error‑rate reductions, and remaining challenges for long‑term or clustered designs.
AA testingAB testingCUPED
0 likes · 17 min read