The article outlines a step‑by‑step framework for dissecting a product’s core value, business model, user experience, optimization, innovation, market environment, and technical feasibility, using a browser example to illustrate each analytical dimension.
This guide explains how to build a closed‑loop growth metric system and applies it to a video app, detailing metric design, data collection, analysis, hypothesis testing, validation, and deployment of optimization strategies to improve content submission rates.
This whitepaper introduces the importance of data‑driven A/B testing, outlines its theoretical foundations, practical challenges such as small samples and spillover effects, and presents a structured roadmap—including experiment basics, statistical principles, advanced designs, and SDK implementation—to help practitioners design trustworthy experiments.
In today's fast‑changing market, traditional intuition‑based decisions falter, but systematic A/B testing—illustrated by ByteDance’s academic‑loop culture and real‑world case studies—empowers organizations to replace guesswork with evidence, accelerate innovation, and achieve measurable performance gains across products and strategies.
This article introduces the free Tencent‑provided Rabbit Nest tool for managing user feedback, explains how to integrate it with web and app products, and then details the 2A3R (AARRR) growth funnel, offering practical optimization tactics for acquisition, activation, retention, referral, and revenue.
This article explains how A/B testing and feature‑flag experiments enable faster iteration, safer rollouts, and data‑driven optimization for large‑model AI products, offering practical steps and real‑world scenarios to improve quality and efficiency.
This article reviews the two‑decade evolution of online A/B testing, outlines the business and technical challenges enterprises face, and details three core technical challenges—experiment accuracy, analysis & interpretation, and efficiency—along with practical solutions for each.
AB testing is a statistical method for comparing multiple strategies or versions to determine the most effective one, and this article explains its risks, mitigation measures, advantages, key dimensions, step‑by‑step workflow, fairness considerations, data‑cleaning techniques, target goals, design guidelines, and alternative experimental approaches.
This article explains how to construct a metric system, identify bottlenecks, and design data‑driven growth strategies using Volcano Engine's DataFinder and DataTester, illustrated with real‑world case studies and step‑by‑step A/B testing practices.
This article outlines a systematic fine‑grained design methodology—covering user segmentation, scenario and time‑slot analysis, opportunity discovery, design optimization, and validation—demonstrating how targeted improvements can increase stickiness, conversion and overall product performance in financial search services.
This article explains the scientific foundations, historical origins, statistical principles, implementation techniques, and practical applications of A/B testing as a data‑driven growth tool for product optimization, algorithm iteration, and marketing decisions in modern internet companies.
This article explains the concept of A/B testing, details the architecture and implementation of an AB testing platform—including experiment, metric, whitelist, and traffic services—provides practical guidelines for experiment design, data reporting, statistical evaluation, and outlines future enhancements for product optimization.
This article explains the origins of online A/B testing, outlines three typical product scenarios—recommendation, operations, and UI/UX—and presents classic case studies from companies like Bing, Google, Amazon, and TikTok to illustrate how controlled experiments drive data‑driven product optimization and measurable business impact.
This article explains AB testing—from its biomedical origins and online adoption to its types, three essential components, core values of causal validation and quantitative growth, and key characteristics of pre‑evaluation and parallelism—providing a comprehensive guide for data‑driven product optimization.
This article presents a comprehensive case study of a mobile app event‑tracking visualization system that aggregates tracking data, intercepts app events via an AOP‑based interceptor, visualizes real‑time event information and conversion‑rate heatmaps, and demonstrates significant efficiency gains for product, operations, and development teams.
This article explains why A/B testing is essential for data‑driven decision making, describes the Volcano Engine A/B testing system architecture, outlines practical experiment design, statistical analysis methods, real‑world case studies, and forecasts industry and technical trends for the practice.
This article explains how designers can shift from macro metrics like DAU to analyzing raw user interaction data, infer user psychology, reconstruct real usage scenarios, and identify optimization opportunities through concrete examples and step‑by‑step methods.
This article explains why A/B testing is essential, illustrates real-world examples from ByteDance, details the multi-layer architecture of the Volcano Engine A/B testing system, outlines experiment design, implementation, statistical analysis, best practices, and future trends, providing a comprehensive guide for product teams.
iQIYI’s AB testing platform integrates a layered traffic‑splitting architecture, real‑time SDK and API delivery, log‑replay data collection, and rigorous T‑test statistical analysis to enable fast, reliable product, algorithm, and operations experiments, exemplified by a UI redesign that boosted watch time by 17.85%.
This article reports an eye‑tracking study conducted on a short‑video app to uncover users' visual strategies, evaluate the impact of title and recommendation layout variations, and identify subtle usability issues that traditional methods miss, providing data‑driven guidance for product design decisions.
This article explains the concept, history, and various forms of online experiments such as AB testing, ABn, AA, and multivariate tests, highlighting their role in causal inference, value evaluation, risk control, and product optimization within modern internet businesses.
Online experiments, rooted in biomedical randomized controlled trials, have become essential for internet businesses to achieve data‑driven growth by providing causal inference, quantifying value, and managing risk through various designs such as AB, ABn, AA, multivariate and quasi‑experimental tests.
This article outlines Zhuanzhuan's systematic approach to collecting, classifying, and resolving online user issues through weekly QA‑led meetings, detailed problem categorization, and targeted solutions, ultimately improving product design, reducing repetitive work, and enhancing overall operational efficiency.
This article explains how user profiling, using the AARRR and RARRA frameworks, can be applied at every stage of the e‑commerce user lifecycle—from pre‑arrival acquisition to post‑departure analysis—to drive product optimization, personalized services, and data‑driven decision making.
This comprehensive guide explains AB testing fundamentals—from defining control and experimental groups and avoiding confounding factors, to calculating sample size, selecting ratio‑based metrics, tracking data, monitoring experiments, and analyzing statistical significance—providing a step‑by‑step methodology for data‑driven product optimization.
This article explains how A/B testing serves as a vital measurement and optimization tool for internet products, covering metric definition, experiment management platforms, traffic splitting strategies, orthogonal and exclusive rules, and essential statistical concepts such as hypothesis testing, t‑test, z‑test, and p‑value analysis.
This article shares a comprehensive approach to improving the experience of backend admin systems, covering why experience matters, measurement methods such as satisfaction surveys and user‑experience maps, and practical design solutions like homepage redesign, notification tiering, complex form optimization, and transparent workflow visualization.
Learn how A/B testing and multivariate testing can identify the most effective UI designs, improve user experience, and increase conversion rates, while exploring essential tools such as Google Optimize, Crazy Egg, and Optimizely, and best practices for planning, executing, and analyzing experiments.
This article explains the basic principles, practical demo, platform architecture, statistical validation, sample size estimation, and reporting workflow of A/B testing used at Qunar to evaluate advertising strategies and product features, illustrating how data‑driven experiments are designed, executed, and analyzed.
From August 26 to September 1, Ctrip's Technology Center and the Basic Business R&D Department hosted an internal ABTest Promotion Week featuring eight expert talks that covered fundamentals, popular architectures, algorithms, future directions, and the critical role of AB testing in big‑data product development.
This article explains the basic principles of A/B testing, demonstrates a practical advertising experiment, describes effective experiment design, outlines Qunar's A/B testing platform architecture and workflow, and details statistical validation methods including Z‑test, minimum sample size calculation, and confidence interval estimation.
The article explains the core concepts of big data, emphasizing data breadth across product lines, illustrates how comprehensive user profiling can drive personalized marketing and product improvements, and provides practical examples of cross‑product data analysis in e‑commerce, finance, travel, and gaming contexts.
