AB testing | BestHub

Didi Tech

Apr 10, 2025 · Product Management

AA Testing and Rerandomization Techniques for Reliable AB Experiments

The article outlines how AA testing and rerandomization can detect and correct non‑uniform traffic splits in short‑term AB experiments, detailing three solutions—AA tests, seed‑based rerandomization, and retrospective AA analysis—along with theoretical guarantees, empirical error‑rate reductions, and remaining challenges for long‑term or clustered designs.

AA testingAB testingCUPED

0 likes · 17 min read

AA Testing and Rerandomization Techniques for Reliable AB Experiments

Didi Tech

Dec 12, 2024 · Product Management

Key AB Testing Interview Questions and Answers for Data Science Candidates

The article reviews common AB‑testing interview questions for data‑science candidates, explaining the role of p‑values, Type I/II errors, the difference between statistical and business significance, why effects can vanish when scaling, and how to improve experiment sensitivity through larger samples, variance‑reduction methods, and careful metric design.

AB testingMDEexperiment design

0 likes · 12 min read

Key AB Testing Interview Questions and Answers for Data Science Candidates

DataFunSummit

Dec 1, 2024 · Big Data

Data Weaving for AB Experiment Automation: Architecture, Challenges, and Solutions

This article presents a comprehensive overview of JD Retail's data‑weaving approach to AB experiment automation, detailing the challenges of consistency, scientific rigor, and timeliness, the logical data platform architecture, key technologies, metric modeling, automated DAG orchestration, current progress, and future directions.

AB testingAutomationBig Data

0 likes · 21 min read

Data Weaving for AB Experiment Automation: Architecture, Challenges, and Solutions

Tencent Cloud Developer

Nov 27, 2024 · Artificial Intelligence

Tencent Cloud AI Code Assistant: Product Evolution, Architecture, and Technical Implementation

Tencent Cloud AI Code Assistant has evolved from token‑level IDE completions to LLM‑driven multi‑modal coding and chat features, employing a dual‑loop R&D system, Hunyuan‑based code models, and sophisticated trigger, prompt, stop, and display strategies to deliver context‑aware, secure, and efficient code generation within IDE and review environments.

AB testingAI code assistantAST Analysis

0 likes · 15 min read

Tencent Cloud AI Code Assistant: Product Evolution, Architecture, and Technical Implementation

DataFunSummit

Aug 18, 2024 · Artificial Intelligence

Challenges and Solutions in Recommendation AB Testing on Xiaohongshu's Experiment Platform

The article examines the key challenges of recommendation AB testing at Xiaohongshu—including change stability, single‑experiment precision, and multi‑strategy packaging—and presents a series of engineering and statistical solutions such as SDK‑based AB architecture, virtual PreAA experiments, CUPED/DID adjustments, and reverse experiments to improve reliability and metric impact.

AB testingCUPEDPreAA

0 likes · 15 min read

Challenges and Solutions in Recommendation AB Testing on Xiaohongshu's Experiment Platform

DataFunTalk

Aug 7, 2024 · Artificial Intelligence

Multi-Scenario Modeling for NetEase Cloud Music Recommendation: Architecture, Challenges, and Results

This article presents NetEase Cloud Music's multi‑scenario recommendation modeling work, detailing background, overall system architecture, key modules, modeling goals, technical difficulties, performance improvements, future outlook, and a comprehensive Q&A session that addresses practical deployment challenges.

AB testingAIModel Architecture

0 likes · 14 min read

Multi-Scenario Modeling for NetEase Cloud Music Recommendation: Architecture, Challenges, and Results

DataFunTalk

Jul 7, 2024 · Product Management

User Growth Strategies: From Information Management to a Data‑Driven Flywheel

This article shares a data‑centric perspective on user growth, covering the evolution of information management, distribution and production, the concept of entropy reduction in products, the data‑driven flywheel model, practical AB‑testing case studies, and a Q&A on analytics tools and team collaboration.

AB testinganalyticsdata-driven

0 likes · 16 min read

User Growth Strategies: From Information Management to a Data‑Driven Flywheel

DataFunSummit

Jul 5, 2024 · Artificial Intelligence

Building and Applying a User Profile Tagging System: Practices and Insights

This article presents a comprehensive overview of constructing and deploying a user and item profiling tag system at Qunar, covering tag taxonomy, integration challenges, technical architectures, algorithmic methods such as classification, recommendation, knowledge‑graph and causal inference, as well as real‑time streaming, ID‑mapping, and practical applications in marketing, attribution and A/B testing.

AB testingData EngineeringTagging System

0 likes · 21 min read

DataFunSummit

Jun 2, 2024 · Artificial Intelligence

Construction and Application of a User Profile Tag System: Methods, Platforms, and Use Cases

This article presents a comprehensive overview of building a user profile tag system—including tag taxonomy, platform architecture, construction methods, update cycles, access patterns, common algorithmic tags, and real‑world applications such as marketing, metric attribution, and A/B testing—illustrated with examples and a detailed Q&A session from a data‑mining senior manager at Qunar.

AB testingData MiningTag System

0 likes · 21 min read

Bilibili Tech

May 21, 2024 · Frontend Development

Bilibili Offline Package Solution for Accelerating H5 Page Load Speed

Bilibili's offline package solution accelerates H5 page load by pre‑downloading resources, intercepting WebView requests, offering snapshot, AB testing, QR‑code debugging, version control, and off‑peak releases; deployed across many projects, it cuts load times by roughly 20‑30% and improves first‑contentful‑paint.

AB testingH5 performanceMobile Frontend

0 likes · 35 min read

Bilibili Offline Package Solution for Accelerating H5 Page Load Speed

ByteDance Data Platform

May 15, 2024 · R&D Management

How ByteDance Embeds A/B Testing into Every Stage of Product Development

This article explains how ByteDance integrates data‑driven A/B testing throughout its R&D workflow—from feature design and large‑scale refactoring to bug fixes, release safety, SQL optimization, and cultural adoption—demonstrating the ROI and sustainable practices of a data‑centric development culture.

AB testingProduct DevelopmentR&D management

0 likes · 18 min read

How ByteDance Embeds A/B Testing into Every Stage of Product Development

DataFunSummit

May 7, 2024 · Artificial Intelligence

Regional Heterogeneity in Game AB Experiments: Detection, Decomposition, and Prediction

This article examines how game AB experiments can exhibit significant regional differences, outlines a meta‑analysis framework to detect heterogeneity, decomposes its sources into treatment‑effect and distributional factors, and demonstrates how to predict outcomes for unseen regions using machine‑learning models.

AB testingCATEcausal inference

0 likes · 11 min read

Regional Heterogeneity in Game AB Experiments: Detection, Decomposition, and Prediction

DataFunTalk

Mar 6, 2024 · Artificial Intelligence

Construction and Practical Application of a User Profile Tagging System

This article details the design, integration, and operational practices of a comprehensive user and item profiling tag system, covering tag taxonomy, construction methods, update cycles, access strategies, algorithmic implementations, and real‑world applications such as marketing, attribution analysis, and A/B testing.

AB testingData MiningTagging System

0 likes · 20 min read

Test Development Learning Exchange

Feb 2, 2024 · Product Management

Understanding AB Testing: Risks, Benefits, and Best Practices

AB testing is a statistical method for comparing multiple strategies or versions to determine the most effective one, and this article explains its risks, mitigation measures, advantages, key dimensions, step‑by‑step workflow, fairness considerations, data‑cleaning techniques, target goals, design guidelines, and alternative experimental approaches.

AB testingconversion ratedata analysis

0 likes · 9 min read

Understanding AB Testing: Risks, Benefits, and Best Practices

DaTaobao Tech

Dec 22, 2023 · Big Data

AB Incremental Evaluation and Contamination Mitigation in Social Viral Experiments

The paper defines AB increment, shows how to calculate DAU gains from per‑user visit rates, explains how social viral experiments introduce unidirectional or bidirectional contamination that biases increment estimates, and proposes four probability‑estimation schemes—exponential smoothing, expansion coefficients, and homogeneous‑group sampling—to correct the bias based on experiment design and business context.

AB testingExperiment Evaluationcontamination

0 likes · 10 min read

AB Incremental Evaluation and Contamination Mitigation in Social Viral Experiments

DataFunSummit

Dec 20, 2023 · Artificial Intelligence

Building and Applying an Image Tagging System: Architecture, Tag Design, Algorithms, and Business Use Cases

This presentation by senior data mining manager Zhou Yuanwei of Qunar outlines the architecture of an image tagging platform, the construction of a comprehensive tagging system, common algorithmic tags, and real-world applications such as look‑alike marketing, A/B test efficiency analysis, and business attribution, helping audiences understand tag types, design considerations, and value‑driven use cases.

AB testingData Miningbusiness analytics

0 likes · 2 min read

Building and Applying an Image Tagging System: Architecture, Tag Design, Algorithms, and Business Use Cases

DataFunTalk

Dec 10, 2023 · Operations

Designing Experiments for Peak Surge Pricing in Two‑Sided Markets: Lessons from Uber, Lyft, DoorDash and Didi

This article examines how two‑sided platforms such as Uber, Lyft, DoorDash and Didi design and evaluate peak‑surcharge experiments, addressing network effects, bias‑variance trade‑offs, time‑space slicing, random‑saturation designs, and continuous bandit‑based testing within an operations‑focused experimental system.

AB testingOperationscausal inference

0 likes · 16 min read

Designing Experiments for Peak Surge Pricing in Two‑Sided Markets: Lessons from Uber, Lyft, DoorDash and Didi

DataFunSummit

Dec 6, 2023 · Artificial Intelligence

Huya's Experiment Science Platform: Causal Inference, AB Testing, and Uplift Modeling Practices

Huya’s data‑driven experiment platform showcases how causal inference, AB testing, and uplift modeling are applied to advertising, user activation, and growth scenarios, detailing platform evolution, metric design, statistical challenges, and practical solutions such as multi‑test correction, CUPED, RTA, and propensity‑score methods.

AB testingcausal inferencedata science

0 likes · 18 min read

Huya's Experiment Science Platform: Causal Inference, AB Testing, and Uplift Modeling Practices

DataFunSummit

Dec 4, 2023 · Product Management

Designing an AB Experiment System for User Growth Scenarios

This article presents a comprehensive AB testing framework tailored for new‑user growth scenarios, detailing the challenges of early traffic allocation, the scientific validation of a new experiment system, real‑world case studies, and practical guidelines for evaluation and implementation.

AB testingMobiledata analysis

0 likes · 14 min read

Designing an AB Experiment System for User Growth Scenarios

ByteDance Data Platform

Oct 11, 2023 · Backend Development

How Volcano Engine Rebuilt Its Ad‑Testing Platform for Scalability and Reliability

This article explains how Volcano Engine identified the tangled authorization, data‑fetching, and performance problems of its advertising AB‑testing platform and refactored it by splitting services, redesigning the data model with MySQL and ClickHouse, applying DAG scheduling, time‑wheel algorithms, Domain‑Driven Design, and rigorous unit testing to achieve a more stable, extensible backend solution.

AB testingDAGDDD

0 likes · 16 min read

How Volcano Engine Rebuilt Its Ad‑Testing Platform for Scalability and Reliability