In 2026, a leading e‑commerce platform cut A/B test preparation from 3.2 days to 47 minutes, boosted experiment throughput 4.3× and GMV 2.8% by applying a three‑step automation workflow, an intelligent analysis engine with three‑level reasoning, and a three‑tier human‑machine decision guard.
This article explains why and how to conduct A/B testing for UI design, outlines experiment setup, variable creation, and data analysis, and presents detailed case studies of JD Express mini‑program pop‑up and order‑completion page experiments that demonstrate measurable improvements in click‑through and conversion rates.
This article explains common pain points in A/B testing, introduces essential statistical concepts such as sampling distribution, parameter estimation, confidence intervals, and hypothesis testing, and provides step‑by‑step formulas and a concrete example for calculating the minimum sample size needed to run a trustworthy experiment.
This guide explains what A/B testing is, when it should be used, outlines an eight‑step framework—from building product funnels to analyzing results—and discusses specific challenges and solutions for applying A/B testing in e‑commerce environments.
This article reflects on Mark Zuckerberg’s early Facebook experience, emphasizing the importance of creating value, building learning‑focused organizations, rapid experimentation, hiring talent without experience, and embracing risk as essential for successful entrepreneurship.
Didi’s Apollo platform combines A/B testing with gradual (gray) release, letting product teams safely roll out new features to targeted user segments, monitor key metrics, and apply best‑practice guidelines—such as isolating variables, pre‑defining metrics, controlling duration, random grouping, and confidence analysis—to achieve statistically significant, data‑driven improvements across thousands of weekly releases.
