Tagged articles
9 articles
Page 1 of 1
DataFunSummit
DataFunSummit
May 5, 2026 · Artificial Intelligence

How Huawei Noah’s KAR Project Leverages LLMs to Advance Recommendation Systems

The article reviews the evolution of recommendation systems from deep learning to large language models, analyzes core challenges such as noisy implicit feedback and limited semantic understanding, and details Huawei Noah’s KAR solution that uses factorized prompting, multi‑expert adapters, and AI‑Agent architectures to achieve a 1.5% AUC lift and validated online A/B test results.

AI AgentAUCHuawei
0 likes · 5 min read
How Huawei Noah’s KAR Project Leverages LLMs to Advance Recommendation Systems
DataFunTalk
DataFunTalk
May 20, 2021 · Artificial Intelligence

Fundamentals and Nuances of CTR (Click‑Through Rate) Modeling

This article explains the theoretical foundations of CTR modeling, why click‑through rates are intrinsically unpredictable at the micro level, the simplifying assumptions that make binary classification feasible, and how evaluation metrics like AUC, contradictory samples, theoretical AUC bounds, and calibration affect model performance.

AUCAdvertisingCTR
0 likes · 18 min read
Fundamentals and Nuances of CTR (Click‑Through Rate) Modeling
DataFunTalk
DataFunTalk
May 17, 2021 · Artificial Intelligence

Comprehensive Overview of Machine Learning Model Evaluation Metrics

This article provides a comprehensive summary of machine learning model evaluation metrics, covering accuracy, precision, recall, F1, RMSE, ROC/AUC, KS test, and scoring cards, with explanations, formulas, code examples, and practical considerations for model performance assessment.

AUCKSModel Evaluation
0 likes · 19 min read
Comprehensive Overview of Machine Learning Model Evaluation Metrics
Alimama Tech
Alimama Tech
May 13, 2021 · Artificial Intelligence

Fundamentals and Misconceptions of CTR (Click-Through Rate) Modeling

CTR modeling predicts click probabilities despite inherent microscopic randomness, treating each impression as an i.i.d. Bernoulli event and framing the task as binary classification; because data are noisy and imbalanced, evaluation relies on AUC rather than accuracy, with theoretical upper bounds set by feature quality, and calibration is needed to align predicted values with observed frequencies.

AUCCTRbinary classification
0 likes · 20 min read
Fundamentals and Misconceptions of CTR (Click-Through Rate) Modeling
21CTO
21CTO
Feb 26, 2021 · Artificial Intelligence

Why One Metric Isn't Enough: Multi‑Dimensional Evaluation of Recommendation Systems

The article explains why relying on a single metric like click‑through rate is insufficient for recommendation systems, and outlines a comprehensive, multi‑dimensional evaluation framework that combines business indicators, user behavior metrics, and algorithmic performance measures such as recall, precision, and AUC.

AB testingAUCCTR
0 likes · 10 min read
Why One Metric Isn't Enough: Multi‑Dimensional Evaluation of Recommendation Systems
DataFunTalk
DataFunTalk
Apr 24, 2020 · Artificial Intelligence

Common Pitfalls in Recommendation Systems: Metrics, Exploration‑Exploitation, and Offline‑Online Discrepancies

The article surveys typical challenges in recommendation systems, including ambiguous evaluation metrics, the trade‑off between precise algorithms and user experience, the exploration‑exploitation dilemma, and why offline AUC improvements often lead to online CTR/CPM drops due to data leakage, feature inconsistency, and distribution shifts.

AUCCTRExploration-Exploitation
0 likes · 14 min read
Common Pitfalls in Recommendation Systems: Metrics, Exploration‑Exploitation, and Offline‑Online Discrepancies
Hulu Beijing
Hulu Beijing
Nov 9, 2017 · Artificial Intelligence

Mastering ROC Curves: How to Plot and Compute AUC for Binary Classification

This article explains the fundamentals of ROC curve construction, the calculation of AUC, compares ROC with PR curves, and provides step‑by‑step examples—including a medical diagnosis scenario and threshold adjustments—to help readers accurately evaluate binary classification models.

AUCModel EvaluationROC
0 likes · 10 min read
Mastering ROC Curves: How to Plot and Compute AUC for Binary Classification
Baidu Waimai Technology Team
Baidu Waimai Technology Team
Aug 3, 2017 · Artificial Intelligence

Model Testing and Evaluation Metrics for Strategy Projects in the AI Era

This article explains the challenges of testing machine‑learning models for strategy projects, outlines the overall testing workflow, describes key offline and online evaluation metrics such as AUC and AB‑testing, and summarizes best‑practice procedures for assessing model performance, user experience, and effect differences.

AB testingAUCEvaluation Metrics
0 likes · 8 min read
Model Testing and Evaluation Metrics for Strategy Projects in the AI Era