Tagged articles
experiment platform
30 articles · Page 1 of 1
This article explains how Tencent Music’s experiment platform automates strategy‑positive subpopulation mining using unified dimension tables, CATE model training, double‑difference estimation, and propensity‑score matching, enabling rapid recommendation‑strategy optimization and data‑driven product decisions.
CATECausal InferenceUplift Modeling
0 likes · 17 min read

The article outlines how Minsheng Bank designed a closed‑loop A/B testing system—covering culture, platform tools, and experiment mechanisms—to support data‑driven decision making during its digital transformation, detailing challenges, implementation methods, real‑world case studies, and future automation trends.
A/B testingbankingdata‑driven decision
0 likes · 15 min read

The article examines the key challenges of recommendation AB testing at Xiaohongshu—including change stability, single‑experiment precision, and multi‑strategy packaging—and presents a series of engineering and statistical solutions such as SDK‑based AB architecture, virtual PreAA experiments, CUPED/DID adjustments, and reverse experiments to improve reliability and metric impact.
AB TestingCUPEDPreAA
0 likes · 15 min read

In 2022 Tencent's A/B Test team created the overseas SaaS product ABetterChoice, abstracting internal experiment capabilities, adapting to multi‑cloud compliance, and unifying computation with StarRocks, enabling game titles like Honor of Kings, PUBG Mobile, and Ubisoft to run scalable, compliant A/B experiments worldwide.
A/B testingMulti-cloudMulti‑Tenant
0 likes · 14 min read

Huya’s data‑driven experiment platform showcases how causal inference, AB testing, and uplift modeling are applied to advertising, user activation, and growth scenarios, detailing platform evolution, metric design, statistical challenges, and practical solutions such as multi‑test correction, CUPED, RTA, and propensity‑score methods.
AB TestingCausal InferenceUplift Modeling
0 likes · 18 min read

This article traces the step‑by‑step evolution of an AB testing platform—from its initial 1.0 version with basic traffic splitting, through the 2.0 era that introduced multi‑layer orthogonal traffic models and real‑time metric pipelines, to the 3.0 era focused on usability, stability, and advanced analysis—while sharing concrete design decisions, implementation details, and lessons learned.
A/B testingexperiment platformreal-time analytics
0 likes · 25 min read

The article describes how NetEase Cloud Music designed and deployed a comprehensive AB testing platform, covering system infrastructure, metric modeling, scientific experiment validation (including SRM mitigation and statistical power), and operational efficiency improvements to support rapid product iteration across multiple devices.
AB TestingData Infrastructurebig data
0 likes · 13 min read

This article presents a comprehensive guide to A/B testing platforms, covering their business applicability, internal implementations at ByteDance, industry-specific case studies, platform architecture, experiment types, and strategies for building a sustainable experiment culture within organizations.
A/B testingBest PracticesCase Studies
0 likes · 17 min read

This article presents a comprehensive guide to A/B testing platforms, covering their business applicability, internal and external use cases across industries, detailed platform architecture, experiment types, statistical reporting, analysis tools, feature flag management, and recommendations for building a sustainable experiment culture within organizations.
A/B testingBest Practicesdata-driven
0 likes · 19 min read

This article shares practical experiences and insights on building an experiment platform, covering A/B testing applications, platform selection, broader business use cases, rapid system integration, and robust experiment analysis techniques such as pre‑AA checks, SRM, Welch’s T and Z tests.
A/B testingdata analysisexperiment platform
0 likes · 19 min read

The article examines why classic A/B testing frameworks struggle with modern internet services—highlighting issues of intervention, measurement, and analysis—while proposing an observational, dynamic, and decision‑oriented next‑generation experiment system that leverages statistical learning and Bayesian optimization.
A/B testingBayesian optimizationexperiment platform
0 likes · 11 min read

This article presents a comprehensive overview of Volcano Engine's A/B testing platform, detailing its four core stages—reliable experiment system, efficient data construction, scientific statistical analysis, and fine-grained governance—while explaining execution components, data pipelines, statistical methods, and operational best practices for large‑scale experimentation.
A/B testingOperationsbig data
0 likes · 16 min read

The Vivo Hawking platform provides a company‑wide, one‑stop A/B testing solution with a layered architecture, covariate‑balanced split algorithms, real‑time monitoring, and unified SDKs for Android, Java and H5, enabling thousands of daily experiments, automated analysis, and rapid product iteration across multiple departments.
Covariate balancingHiveJava SDK
0 likes · 22 min read

The article introduces the business background, architectural design, evolution challenges, and step‑by‑step methodology for building and operating a risk‑control experiment platform that supports online and offline A/B testing, data analysis, and strategy iteration in internet finance.
A/B testingRisk Controldata analysis
0 likes · 12 min read

This article explains the background, architecture, challenges, and step‑by‑step design of a big‑data‑driven risk control experiment platform used for online and offline strategy testing in internet finance.
Offline TestingOnline TestingRisk Control
0 likes · 12 min read


DevOpsSep 16, 2022 · Operations
After more than a year of effort, Uber migrated its entire experimentation and feature‑flag ecosystem—including thousands of developers, dozens of partners, multiple mobile apps, and hundreds of services—to a new, unified platform that improves reliability, flexibility, and data quality while retiring over 50,000 legacy experiments.
A/B testingUberexperiment platform
0 likes · 25 min read

Huolala’s A/B testing platform, serving over 200 business scenarios and thousands of experiments, combines a three‑stage workflow with a modular architecture—including a configuration console, SDK for traffic routing and data collection, and a robust data‑recovery pipeline—while offering five distinct allocation algorithms to ensure scientific experiment results.
A/B testingalgorithm designexperiment platform
0 likes · 17 min read

This article explains how the Picasso platform provides a standardized, high‑efficiency A/B testing pipeline for front‑end developers, covering traffic allocation algorithms, flow reuse, orthogonal and mutually exclusive experiments, multi‑scenario rules, custom metrics, reporting, and future enhancements.
A/B testingcustom metricsexperiment platform
0 likes · 12 min read

This article introduces the A/B testing platform used at AutoHome, detailing its architecture, experiment flow, traffic allocation strategies, and statistical evaluation techniques such as hypothesis testing, confidence intervals, and significance testing, to guide data‑driven decision making for recommendation system improvements.
A/B testingdata-driven decisionsexperiment platform
0 likes · 9 min read

This article examines the core challenges of running large‑scale A/B testing platforms—supporting thousands of engineers, generating fast reports from massive data sets, and reducing sampling variance—to enable data‑driven product decisions in the AI era.
A/B testingdata-drivenexperiment platform
0 likes · 2 min read

iQIYI’s AB testing platform integrates a layered traffic‑splitting architecture, real‑time SDK and API delivery, log‑replay data collection, and rigorous T‑test statistical analysis to enable fast, reliable product, algorithm, and operations experiments, exemplified by a UI redesign that boosted watch time by 17.85%.
AB Testingexperiment platformiQIYI
0 likes · 12 min read

At Tubi, the Popper experiment engine—a Scala‑based, Akka‑powered backend service—combined with a self‑serve UI, automated analysis pipelines, and rigorous health checks, enables teams across ML, mobile, and OTT to run scalable A/B tests, rapidly iterate, and make data‑driven product decisions.
A/B testingAkkaML
0 likes · 14 min read

The paper presents an AB‑testing platform that structures experiments into scenes, buckets, layers and traffic, uses a salted‑hash based allocation and a two‑step “multi‑withdraw‑fill” algorithm to adjust percentages while preserving user‑experiment stability, and describes a lightweight, cache‑centric system architecture with staggered config reloads and safeguards against database spikes and zombie nodes.
AB TestingAlgorithmexperiment platform
0 likes · 11 min read

Youzan created an internal A/B testing platform—combining Java/Node SDKs, a real‑time data pipeline, and a metadata‑driven workflow—to enable data‑driven product iteration, granular traffic allocation, automated logging, statistical analysis, and scalable growth insights across its merchant services, while planning further automation and integration.
A/B testingMetricsbig data
0 likes · 19 min read

This article introduces Didi's adaptive grouping algorithm, which enhances the uniformity of user allocation in AB experiments by replacing traditional complete randomization with a single-pass method that balances observed metrics across groups, and demonstrates its effectiveness through large‑scale experimental results.
AB TestingAlgorithmDidi
0 likes · 11 min read

This article explains the design of a standardized, simple, and efficient front‑end A/B testing pipeline, covering experiment configuration, data models, platform architecture, runtime JSSDK, traffic‑splitting strategies, and data back‑flow to enable reliable, data‑driven product decisions.
A/B testingJSSDKdata collection
0 likes · 16 min read

Wedge is a Meituan‑Dianping advertising experiment configuration platform that provides extensible, flow‑based A/B testing with version control, real‑time monitoring, and a user‑friendly UI, enabling algorithm, engineering, and business teams to rapidly iterate, audit, and roll back complex vertical and horizontal experiments.
AB TestingAdvertisingBackend
0 likes · 12 min read

The article details the design principles, layered traffic allocation model, architecture, data processing pipeline, and operational experience of the AB experiment platform used at Beike Zhaofang, highlighting its web, API, and storage layers, gray‑release capabilities, current limitations, and future improvements.
AB Testingbackend architectureexperiment platform
0 likes · 15 min read

The Sun Dial platform is a universal A/B testing system built for 58.com that supports single‑layer and multi‑layer experiments, provides uniform traffic splitting, real‑time OLAP analytics with Druid, and offers a web interface for easy configuration, enabling data‑driven product optimization across multiple business lines.
A/B testingDruidbig data
0 likes · 14 min read

The article describes the motivation, layered design, traffic allocation, statistical validation methods, and system architecture of a scalable A/B testing platform that enables multiple concurrent experiments while ensuring independent traffic segmentation and reliable data analysis for product growth.
A/B testingconfidence intervalexperiment platform
0 likes · 12 min read
