Tagged articles
online experiments
18 articles · Page 1 of 1
EMER, Kuaishou’s end‑to‑end multi‑objective ensemble ranking framework, replaces handcrafted scoring formulas with a transformer‑based model that learns comparative preferences, integrates normalized rank features, optimizes relative satisfaction and multi‑dimensional proxy metrics, and dynamically balances objectives via a self‑evolving advantage evaluator, delivering significant online gains.
Transformermachine learningmulti-objective ranking
0 likes · 17 min read

This article details the EMER framework—a Transformer‑based, end‑to‑end multi‑objective ranking system that replaces handcrafted formulas with a learnable AI model, introduces relative‑satisfaction signals and dynamic loss weighting, and demonstrates significant offline and online performance gains in Kuaishou's short‑video recommendation pipeline.
AIRankingmulti-objective learning
0 likes · 16 min read

This article introduces Multi-Attribution Learning (MAL), a novel paradigm that jointly models multiple attribution labels to overcome the single-attribution bottleneck in conversion rate (CVR) prediction, detailing its architecture, auxiliary tasks, extensive offline and online experiments, and significant business gains.
Advertising Systemsconversion rate predictionmulti-attribution learning
0 likes · 24 min read

The article reviews the development of online A/B testing, covering sampling and traffic‑splitting techniques, metric computation improvements, statistical inference advances, and current challenges such as interference, real‑time inference, and large‑scale metric computation, while referencing recent research papers.
A/B testingCausal InferenceMetric Evaluation
0 likes · 10 min read

The DataFun Data Science Summit on May 25 will feature Tencent data scientist Li Yilin presenting a comprehensive overview of paired‑data A/B experiments, covering causal inference challenges, unbiased estimators under various randomization designs, theoretical analysis, and practical insights for network‑based online experiments.
A/B testingCausal Inferencenetwork experiments
0 likes · 5 min read

This article presents a comprehensive overview of multi‑task and multi‑scenario recommendation algorithms, detailing background challenges, algorithm classifications such as TAML, CausalInt, and DFFM, their modular designs, experimental validations, and practical Q&A insights for large‑scale advertising systems.
advertising algorithmsmachine learningmulti-task learning
0 likes · 19 min read

The DataFunSummit2023 online conference brings together experts from Tencent and Kuaishou to present cutting‑edge research on causal inference for large‑scale A/B testing, including deep‑learning‑based multi‑experiment effect estimation, a distributed causal inference framework (Fast‑Causal‑Inference), and strategies for evaluating long‑term policy impacts.
A/B testingCausal Inferencedata science
0 likes · 7 min read

The presentation explains how to detect, analyze, and leverage regional variations in overseas A/B test results to make more informed product decisions, using a systematic experimental analysis framework grounded in causal inference and online experimentation methods.
A/B testingCausal Inferencegame data science
0 likes · 2 min read

This article explains the scientific foundations, historical origins, statistical principles, implementation techniques, and practical applications of A/B testing as a data‑driven growth tool for product optimization, algorithm iteration, and marketing decisions in modern internet companies.
A/B testingdata-driven growthonline experiments
0 likes · 26 min read

This article explains AB testing—from its biomedical origins and online adoption to its types, three essential components, core values of causal validation and quantitative growth, and key characteristics of pre‑evaluation and parallelism—providing a comprehensive guide for data‑driven product optimization.
AB TestingCausal Inferencedata-driven growth
0 likes · 25 min read

This article presents DRL-Rec, a distilled reinforcement learning framework for recommendation that integrates an exploring‑filtering module and confidence‑guided distillation to compress RL‑based recommenders while improving accuracy, and reports significant offline and online performance gains on a large‑scale system.
knowledge distillationonline experimentsreinforcement learning
0 likes · 16 min read

This article presents a comprehensive overview of online experiment design and analysis, covering basic definitions, AB testing principles, complex experiment types, real-world case studies from Tencent's information flow platform, and practical guidelines for reliable experiment evaluation and product decision‑making.
A/B testingCausal Inferenceexperiment analysis
0 likes · 21 min read

The paper presents a comprehensive A/B testing framework for online experiments that guides practitioners through four stages—designing objectives and metrics, implementing random traffic allocation with robustness checks, evaluating effects using descriptive statistics and hypothesis testing, and making rollout decisions based on multidimensional significance and attribution analyses.
A/B testingExperimental Designdata analysis
0 likes · 22 min read

This article explains the concept, history, and various forms of online experiments such as AB testing, ABn, AA, and multivariate tests, highlighting their role in causal inference, value evaluation, risk control, and product optimization within modern internet businesses.
AB TestingCausal Inferenceexperiment design
0 likes · 16 min read

Online experiments, rooted in biomedical randomized controlled trials, have become essential for internet businesses to achieve data‑driven growth by providing causal inference, quantifying value, and managing risk through various designs such as AB, ABn, AA, multivariate and quasi‑experimental tests.
Causal Inferencedata-drivenonline experiments
0 likes · 18 min read

This article presents HRL-Rec, a hierarchical reinforcement learning model that jointly learns user preferences at the item and channel levels for integrated recommendation systems, and demonstrates its superior offline and online performance, stability, and scalability through extensive experiments on the WeChat "See" platform.
Recommendation Systemchannel selectorhierarchical reinforcement learning
0 likes · 12 min read

The article presents a novel multi‑channel sequential advertising framework that models budget‑constrained GMV optimization as a dynamic knapsack problem, introduces a long‑term value‑based RL solution (MSBCB), and validates its superiority through extensive offline and online experiments showing up to 10% ROI improvement.
Advertisingbudget optimizationdynamic knapsack
0 likes · 16 min read

This article details the evolution of AliExpress product ranking from simple DNN scoring to advanced reinforcement‑learning re‑ranking, comparing multiple models, exploring context effects, introducing pointer‑network generators, evaluating various RL algorithms, and reporting significant online gains in conversion and GMV.
e-commerceonline experimentsproduct ranking
0 likes · 28 min read
