Tagged articles
AUC
12 articles · Page 1 of 1
The paper proposes CAIM, a context-aware user intent modeling framework for e-commerce relevant recommendation that decomposes intent into category, brand, shop, and price sub-intents via three modules (IEM, IRM, SIEM), achieving 0.20–0.21 AUC gains offline and 6.9% order and 7.7% GMV lifts in a 14-day online A/B test.
A/B testingAUCCIKM 2026
0 likes · 13 min read

This article details QueryFormer, the winning solution for KDD Cup 2026 Tencent UniRec Challenge, which introduces a cross-attention query generation mechanism to unify feature interaction and behavior sequence modeling, achieving 0.83254 AUC on the official test set.
AUCKDD Cup 2026QueryFormer
0 likes · 24 min read

Two senior undergraduates won the Scaling Law Original Breakthrough Award and 10th place in the academic track at the 2026 Tencent Advertising Algorithm Competition by running nearly 1000 experiments, discovering that increasing model width alone reduces AUC unless accompanied by new informative tokens, leading to their CoSFormer architecture that scales capacity and information jointly.
AUCCoSFormerScaling Laws
0 likes · 8 min read

The article reviews the evolution of recommendation systems from deep learning to large language models, analyzes core challenges such as noisy implicit feedback and limited semantic understanding, and details Huawei Noah’s KAR solution that uses factorized prompting, multi‑expert adapters, and AI‑Agent architectures to achieve a 1.5% AUC lift and validated online A/B test results.
AI AgentAUCHuawei
0 likes · 5 min read

This article explains the theoretical foundations of CTR modeling, why click‑through rates are intrinsically unpredictable at the micro level, the simplifying assumptions that make binary classification feasible, and how evaluation metrics like AUC, contradictory samples, theoretical AUC bounds, and calibration affect model performance.
AUCAdvertisingCTR
0 likes · 18 min read

This article provides a comprehensive summary of machine learning model evaluation metrics, covering accuracy, precision, recall, F1, RMSE, ROC/AUC, KS test, and scoring cards, with explanations, formulas, code examples, and practical considerations for model performance assessment.
AUCKSModel Evaluation
0 likes · 19 min read

CTR modeling predicts click probabilities despite inherent microscopic randomness, treating each impression as an i.i.d. Bernoulli event and framing the task as binary classification; because data are noisy and imbalanced, evaluation relies on AUC rather than accuracy, with theoretical upper bounds set by feature quality, and calibration is needed to align predicted values with observed frequencies.
AUCCTRbinary classification
0 likes · 20 min read


21CTOFeb 26, 2021 · Artificial Intelligence
The article explains why relying on a single metric like click‑through rate is insufficient for recommendation systems, and outlines a comprehensive, multi‑dimensional evaluation framework that combines business indicators, user behavior metrics, and algorithmic performance measures such as recall, precision, and AUC.
AB TestingAIAUC
0 likes · 10 min read

The article surveys typical challenges in recommendation systems, including ambiguous evaluation metrics, the trade‑off between precise algorithms and user experience, the exploration‑exploitation dilemma, and why offline AUC improvements often lead to online CTR/CPM drops due to data leakage, feature inconsistency, and distribution shifts.
AUCCTRExploration-Exploitation
0 likes · 14 min read

This article provides a comprehensive overview of the AUC metric used in ranking tasks, discussing its various interpretations, key properties such as score‑independence and sampling robustness, its relationship to business metrics, common pitfalls, and advanced variations like group AUC.
AUCRankingevaluation metric
0 likes · 8 min read

This article explains the fundamentals of ROC curve construction, the calculation of AUC, compares ROC with PR curves, and provides step‑by‑step examples—including a medical diagnosis scenario and threshold adjustments—to help readers accurately evaluate binary classification models.
AUCModel EvaluationRoc
0 likes · 10 min read

This article explains the challenges of testing machine‑learning models for strategy projects, outlines the overall testing workflow, describes key offline and online evaluation metrics such as AUC and AB‑testing, and summarizes best‑practice procedures for assessing model performance, user experience, and effect differences.
AB TestingAIAUC
0 likes · 8 min read
