Apr 10, 2025 · Product Management

AA Testing and Rerandomization Techniques for Reliable AB Experiments

The article outlines how AA testing and rerandomization can detect and correct non‑uniform traffic splits in short‑term AB experiments, detailing three solutions—AA tests, seed‑based rerandomization, and retrospective AA analysis—along with theoretical guarantees, empirical error‑rate reductions, and remaining challenges for long‑term or clustered designs.

AA testingAB testingCUPED

0 likes · 17 min read

AA Testing and Rerandomization Techniques for Reliable AB Experiments

Huolala Tech

Nov 17, 2023 · Fundamentals

Ensuring Homogeneity in AB Tests: Practical Solutions for Reliable Results

This article explains how to guarantee homogeneity in AB experiments by defining pre‑experiment bias, presenting statistical testing methods, outlining a three‑step workflow for both pre‑ and post‑experiment phases, and sharing real‑world case studies and correction techniques to improve decision‑making reliability.

AA testingAB testingCUPED

0 likes · 9 min read

Ensuring Homogeneity in AB Tests: Practical Solutions for Reliable Results