offline sampling

DataFunTalk

Jul 29, 2021 · Fundamentals

Offline Sampling in AB Testing: Challenges and Experimental Techniques

The article explains offline sampling for AB testing, detailing why it is needed, the main challenges of limited sample size, population heterogeneity, and non‑random interventions, and presents variance‑reduction, stratified sampling, IPW, and matching methods to address these issues.

AB testingVariance Reductioncausal inference

0 likes · 15 min read

Offline Sampling in AB Testing: Challenges and Experimental Techniques

Alimama Tech

Jul 28, 2021 · Product Management

Offline Sampling in AB Testing: Challenges and Experimental Techniques

Offline sampling in A/B testing assigns experimental units such as users or tags before a trial begins, but suffers from limited sample size, high heterogeneity, and non‑random allocation, which can be mitigated by variance‑reduction methods like CUPED, stratified sampling with inverse‑probability weighting, and matching approaches including propensity‑score matching.

AB testingVariance Reductioncausal inference

0 likes · 15 min read