Tagged articles

Metric design

8 articles · Page 1 of 1

Sep 1, 2026 · Artificial Intelligence

From Golden Metrics to Rubric: Building a Quantifiable, Explainable Evaluation Loop for AI Agents

This article walks through constructing a fully quantifiable and explainable evaluation system for AI agents—starting with business‑level golden metrics, using LLMs to break them into a detailed Rubric, embedding the Rubric in a custom evaluator, configuring evaluation tasks with trace data, and closing the loop by turning low‑scoring cases into actionable insights for continuous improvement.

AI evaluationAgentLoopData Flywheel

0 likes · 13 min read

From Golden Metrics to Rubric: Building a Quantifiable, Explainable Evaluation Loop for AI Agents

Smart Sea Tide

Apr 3, 2026 · Operations

How to Build an Effective Business Indicator System

The article explains what an indicator system is, why statistical measurement is essential for modern management, and provides a step‑by‑step, top‑down methodology—including business‑process decomposition, metric formulation, and cross‑departmental alignment—to construct a comprehensive KPI framework for enterprises.

Business ManagementIndicator SystemKPI

0 likes · 12 min read

How to Build an Effective Business Indicator System

Data Thinking Notes

Dec 3, 2024 · Fundamentals

How to Build a Robust Data Metric System: From Design to BI Application

This article explains how to construct a comprehensive data metric system—including classification of atomic and derived indicators, top‑down and bottom‑up design methods, data‑warehouse layer architecture, and BI analysis types—to ensure consistent, actionable insights across the enterprise.

BI analysisBusiness IntelligenceData Metrics

0 likes · 11 min read

How to Build a Robust Data Metric System: From Design to BI Application

Data Thinking Notes

Oct 8, 2023 · Product Management

How to Build a Robust Data Metric System for Business Success

This guide explains why many enterprises struggle with incomplete metric systems, outlines universal principles, methods, and step‑by‑step procedures—including defining a North Star metric, creating a metric dictionary, and systematic integration—to design effective, dynamic data indicator frameworks that drive informed decision‑making.

Business AnalyticsData AnalysisData Metrics

0 likes · 12 min read

How to Build a Robust Data Metric System for Business Success

DataFunSummit

Jul 2, 2023 · Big Data

Building a One‑Stop AB Testing Platform at NetEase Cloud Music: Architecture, Metric Infrastructure, Scientific Evaluation, and Efficiency

The article describes how NetEase Cloud Music designed and deployed a comprehensive AB testing platform, covering system infrastructure, metric modeling, scientific experiment validation (including SRM mitigation and statistical power), and operational efficiency improvements to support rapid product iteration across multiple devices.

AB TestingMetric designbig data

0 likes · 13 min read

Building a One‑Stop AB Testing Platform at NetEase Cloud Music: Architecture, Metric Infrastructure, Scientific Evaluation, and Efficiency

DataFunTalk

Nov 20, 2021 · Artificial Intelligence

Intelligent Pre‑Loan Risk Control: Multi‑Loop Feedback Model, AutoML Controller Selection, Unsupervised Feature Extraction, and Metric Design

The article presents Akulaku's intelligent pre‑loan risk control framework, detailing a multi‑loop feedback control model, AutoML‑driven controller selection, unsupervised feature extraction techniques, and a comprehensive metric quantification system to improve stability, steady‑state, and dynamic responses of financial risk management.

AutoMLFinancial TechnologyMetric design

0 likes · 12 min read

Intelligent Pre‑Loan Risk Control: Multi‑Loop Feedback Model, AutoML Controller Selection, Unsupervised Feature Extraction, and Metric Design

Alimama Tech

Oct 20, 2021 · Big Data

Designing Evaluation Metrics and Building an Overall Evaluation Index (OEC) for AB Testing

The article explains how to design experiment evaluation metrics—from top‑down objectives to core, quality, and observation types—and construct an Overall Evaluation Criterion by processing, weighting, and aggregating metrics, providing a robust, scalable framework for credible AB‑test assessment and product optimization.

AB TestingAnalyticsData Science

0 likes · 11 min read

Designing Evaluation Metrics and Building an Overall Evaluation Index (OEC) for AB Testing

Didi Tech

Aug 27, 2020 · Big Data

Building and Managing an Indicator System: Methodology, Models, and Practices

The article defines an indicator system as a structured set of interrelated metrics and dimensions, explains its lifecycle and hierarchy, presents OSM and AARRR models for construction, details metadata and dimension management, addresses business‑technical challenges, outlines a roadmap for implementation, and showcases DiDi’s deployment of thousands of indicators across dozens of domains.

AARRRIndicator SystemMetric design

0 likes · 19 min read

Building and Managing an Indicator System: Methodology, Models, and Practices