Causal Debiasing Methods for Ant Group's Marketing Recommendation Scenarios
This article presents Ant Group's research on causal debiasing for recommendation and marketing, covering the background of bias, common bias types, causal graph analysis, two correction approaches—data‑fusion based MDI and back‑door adjustment based DMBR—along with experimental results on public and proprietary datasets and real‑world deployment insights.
The article introduces causal debiasing techniques applied to Ant Group's marketing recommendation scenarios, beginning with an overview of bias generation in closed‑loop recommendation systems and describing three typical biases: selection, exposure, and popularity.
It then explains causal debiasing, illustrating how confounders such as smoking (a common cause) can create spurious associations, and how do‑calculus can be used to remove these false links.
Two main correction methods are detailed:
Data‑fusion based debiasing (MDI model) : a meta‑learning framework that jointly leverages unbiased teacher data and biased data, training in two stages—pre‑training an unbiased teacher model on unbiased data, then iteratively updating a fusion model with weighted samples from both sources. Experiments on Yahoo R3, Coat, and an internal dataset show superior MSE/MAE performance compared to baselines such as IPS, Double‑Robust, and PFDR.
Back‑door adjustment debiasing (DMBR model) : constructs a causal graph for recommendation, identifies back‑door paths (e.g., U‑D‑T‑Y, I‑K‑T‑Y), and cuts them by modeling an unbiased representation T, enabling true causal inference. Evaluations on Tianchi, 84.51, and a real e‑commerce marketing dataset demonstrate higher AUC and better conversion rates than methods like IPW, Unawareness, FairCo, MACR, PDA, and DecRS.
The paper also discusses ablation studies confirming the necessity of the augmentation module and sensitivity analyses showing robustness across varying proportions of unbiased data.
Finally, practical applications within Ant Group are highlighted, where causal debiasing is employed in advertising and e‑commerce marketing to mitigate rule‑based or strategy‑driven biases, improving coupon redemption rates and overall user experience.
The article concludes with a thank‑you note.
DataFunSummit
Official account of the DataFun community, dedicated to sharing big data and AI industry summit news and speaker talks, with regular downloadable resource packs.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.