Artificial Intelligence 16 min read

Causal Debiasing Methods for Ant Group's Marketing Recommendation Scenarios

This article presents Ant Group's research on causal debiasing for recommendation and marketing, covering the background of bias, common bias types, causal graph analysis, two correction approaches—data‑fusion based MDI and back‑door adjustment based DMBR—along with experimental results on public and proprietary datasets and real‑world deployment insights.

DataFunSummit
DataFunSummit
DataFunSummit
Causal Debiasing Methods for Ant Group's Marketing Recommendation Scenarios

The article introduces causal debiasing techniques applied to Ant Group's marketing recommendation scenarios, beginning with an overview of bias generation in closed‑loop recommendation systems and describing three typical biases: selection, exposure, and popularity.

It then explains causal debiasing, illustrating how confounders such as smoking (a common cause) can create spurious associations, and how do‑calculus can be used to remove these false links.

Two main correction methods are detailed:

Data‑fusion based debiasing (MDI model) : a meta‑learning framework that jointly leverages unbiased teacher data and biased data, training in two stages—pre‑training an unbiased teacher model on unbiased data, then iteratively updating a fusion model with weighted samples from both sources. Experiments on Yahoo R3, Coat, and an internal dataset show superior MSE/MAE performance compared to baselines such as IPS, Double‑Robust, and PFDR.

Back‑door adjustment debiasing (DMBR model) : constructs a causal graph for recommendation, identifies back‑door paths (e.g., U‑D‑T‑Y, I‑K‑T‑Y), and cuts them by modeling an unbiased representation T, enabling true causal inference. Evaluations on Tianchi, 84.51, and a real e‑commerce marketing dataset demonstrate higher AUC and better conversion rates than methods like IPW, Unawareness, FairCo, MACR, PDA, and DecRS.

The paper also discusses ablation studies confirming the necessity of the augmentation module and sensitivity analyses showing robustness across varying proportions of unbiased data.

Finally, practical applications within Ant Group are highlighted, where causal debiasing is employed in advertising and e‑commerce marketing to mitigate rule‑based or strategy‑driven biases, improving coupon redemption rates and overall user experience.

The article concludes with a thank‑you note.

machine learningdata fusionRecommendation systemsMarketingcausal inferencebias correctionAnt Group
DataFunSummit
Written by

DataFunSummit

Official account of the DataFun community, dedicated to sharing big data and AI industry summit news and speaker talks, with regular downloadable resource packs.

0 followers
Reader feedback

How this landed with the community

login Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.