Skip to content
Tagged articles

Business Metrics

33 articles · Page 1 of 1
DataFunTalk
DataFunTalk
Nov 11, 2026 · Artificial Intelligence

Databricks Genie Ontology: Why Two AI Agents Failed on One Business Metric

Databricks launched Genie Ontology, a knowledge layer that captures multiple versions of business metrics with provenance, enabling AI agents to correctly answer questions like which CFD rate applied in a given financial year—achieving 91% test pass rate versus 45-58% for other agents by using ontology snippets and explicit modeling.

AI agentsBusiness MetricsData Agents
0 likes · 14 min read
Databricks Genie Ontology: Why Two AI Agents Failed on One Business Metric
PaperAgent
PaperAgent
Oct 30, 2026 · Artificial Intelligence

FDE-Gym Benchmark Exposes AI Delivery Gap: Top Models Solve Only 14 of 95 Tasks

Tsinghua, Microsoft, and collaborators introduce FDE-Gym, a reproducible benchmark for AI delivery agents across 20 customer scenarios and 95 tasks, revealing that even Claude Opus 5.5 solves only 14 tasks at the most realistic level, with the core bottleneck being discovery of implicit constraints and translation of facts into deployed systems.

AI delivery agentsAgent EvaluationBusiness Metrics
0 likes · 13 min read
FDE-Gym Benchmark Exposes AI Delivery Gap: Top Models Solve Only 14 of 95 Tasks
Data Practical Notes
Data Practical Notes
Oct 30, 2026 · Big Data

Why Data Warehouses Aren't Enough: The Essential Role of Metric Platforms in Unified Analytics

This article explains the distinct roles of data warehouses, metric platforms, and BI tools, demonstrating why a data warehouse alone cannot unify business metric definitions, and provides a five-step framework for building a metric management system that ensures consistent calculations, version control, and cross-departmental reuse.

BIBusiness Metricsdata analytics
0 likes · 17 min read
Why Data Warehouses Aren't Enough: The Essential Role of Metric Platforms in Unified Analytics
Data Bricklaying Diary
Data Bricklaying Diary
Oct 25, 2026 · R&D Management

Managing Multiple Valid Business Metrics: When Sales and Finance Both Are Right

This article explains how to manage conflicting but valid business metrics by sharing entity identity while maintaining distinct definitions, implementing explicit query conventions, preventing inference leaks through access controls, versioning definition changes, and validating systems with ambiguous query tests.

Business MetricsMetric VersioningSemantic Layer
0 likes · 22 min read
Managing Multiple Valid Business Metrics: When Sales and Finance Both Are Right
Data Bricklaying Diary
Data Bricklaying Diary
Oct 24, 2026 · Artificial Intelligence

Why AI Success Metrics Become Business Rework: Measuring Real Delivery in Agent Triage

This article argues that technical success metrics for AI agents (like API success rates) misrepresent business value, and proposes a framework for measuring actual delivery: define qualified outcomes per pre-agreed contracts, fix the task denominator, track human effort and rework across auto/collaborative/escalation paths, and feed verified operational feedback into knowledge, model, and regression improvements.

AI agent evaluationBusiness Metricsafter-sales triage
0 likes · 26 min read
Why AI Success Metrics Become Business Rework: Measuring Real Delivery in Agent Triage
Digital Deification
Digital Deification
Oct 13, 2026 · Industry Insights

AI's Second Half: Why Delivery Beats Parameters — The FDE Role in National Policy

China's 2026 national policy formally establishes Frontier Deployment Engineers (FDEs) as the linchpin of AI value delivery, mandating a shift from model-centric benchmarks to measurable business outcomes via a four-ring methodology and six-layer metrics framework that ties success to client financial, operational, and adoption indicators.

414 documentAI deliveryAI implementation
0 likes · 13 min read
AI's Second Half: Why Delivery Beats Parameters — The FDE Role in National Policy
DataFunSummit
DataFunSummit
Sep 1, 2026 · Industry Insights

How Ant Group Scaled Apache Ossie Semantic Layer from Zero to 5,000 Metrics

The article explains why large language models struggle with business data, introduces Ant Group's semantic‑layer approach built on Apache Ossie to impose strong business constraints, compares it with other retrieval methods, and details the engineering journey that delivered a unified source of truth for over 5,000 metrics while also announcing a related conference.

AI agentsAnt GroupApache Ossie
0 likes · 4 min read
How Ant Group Scaled Apache Ossie Semantic Layer from Zero to 5,000 Metrics
Woodpecker Software Testing
Woodpecker Software Testing
Apr 3, 2026 · Artificial Intelligence

Why 80% of AI Projects Fail: Bridging Model Evaluation from Theory to Real‑World Impact

The article explains that most AI project failures stem from unrealistic evaluation rather than model intelligence, and outlines concrete practices—business‑aligned metrics, scenario sandboxes, human‑in‑the‑loop reviews, and auditable documentation—to make model evaluation truly actionable.

AI DeploymentAI ReliabilityBusiness Metrics
0 likes · 7 min read
Why 80% of AI Projects Fail: Bridging Model Evaluation from Theory to Real‑World Impact
Data Integration and Governance
Data Integration and Governance
Mar 11, 2026 · Databases

Data Model vs Metric Model: Clear Differences Explained

The article clarifies the distinction between data models, which structure and store business data, and metric models, which define and manage business measurements, covering their core elements, construction logic, outputs, application stages, iteration frequency, and how they complement each other.

Business MetricsData ModelingETL
0 likes · 10 min read
Data Model vs Metric Model: Clear Differences Explained
Yuantong Information Technology
Yuantong Information Technology
Sep 29, 2025 · Product Management

How YTO Express Revamped Its Mobile App to Boost User Experience and Business Growth

This case study details YTO Express's comprehensive redesign of its member mini‑program—covering visual branding, interaction consistency, emotional resonance, and multi‑device adaptation—showing how systematic UX upgrades drove a 168% rise in experience scores and dramatic business metric improvements.

Business MetricsMobile AppUX design
0 likes · 9 min read
How YTO Express Revamped Its Mobile App to Boost User Experience and Business Growth
Architect
Architect
Sep 27, 2024 · Artificial Intelligence

How AI Detects and Diagnoses Anomalies in Ctrip Train Ticket Metrics

This article presents a comprehensive AI‑driven system for automatically detecting anomalies in over 1,000 Ctrip train‑ticket business metrics and pinpointing their root causes, detailing the background, unsupervised algorithms, detection and attribution pipelines, practical results, and future improvements.

AI anomaly detectionBusiness MetricsCtrip
0 likes · 21 min read
How AI Detects and Diagnoses Anomalies in Ctrip Train Ticket Metrics
DataFunSummit
DataFunSummit
Sep 3, 2024 · Artificial Intelligence

Metric Attribution on Internet Platforms: Concepts, Methods, and Tool Applications

This article explains metric attribution for internet platforms, covering its definition, a three‑step analytical framework, deterministic and probabilistic methods such as metric decomposition, machine‑learning models with SHAP values, case studies, and a practical tool that guides users through attribution analysis.

Business MetricsCausal InferenceInternet Platforms
0 likes · 15 min read
Metric Attribution on Internet Platforms: Concepts, Methods, and Tool Applications
Data Thinking Notes
Data Thinking Notes
Aug 8, 2024 · Fundamentals

How to Pinpoint the Real Drivers Behind Metric Fluctuations: Methods & Case Studies

This article explains the fundamentals of metric attribution, outlines a three‑step framework for identifying, analyzing, and solving metric changes, compares deterministic, probabilistic, and speculative methods, and illustrates the approach with two real‑world case studies using decomposition and machine‑learning techniques.

Business MetricsCausal Inferencedata analysis
0 likes · 16 min read
How to Pinpoint the Real Drivers Behind Metric Fluctuations: Methods & Case Studies
Architecture and Beyond
Architecture and Beyond
Dec 30, 2023 · Product Management

15 Essential SaaS Business Metrics Every Technical Professional Should Understand

This article explains the origins of SaaS, outlines the Chinese market landscape, and details fifteen crucial business metrics—including acquisition cost, LTV, MRR, ARR, NDR, and retention indicators—while also covering product development stages, GTM strategies, and growth models such as PLG and SLG for SaaS startups.

Business MetricsLTVMRR
0 likes · 25 min read
15 Essential SaaS Business Metrics Every Technical Professional Should Understand
Ctrip Technology
Ctrip Technology
Oct 26, 2023 · Artificial Intelligence

Time Series Forecasting of Key Business Indicators: Methods, Models, and Practical Deployment

This article presents a comprehensive study on forecasting critical business metrics such as traffic, order volume, and GMV using traditional, machine‑learning, and deep‑learning time‑series models, detailing feature engineering, model design, experimental comparison, online deployment, and monitoring strategies.

AutoformerBusiness MetricsInformer
0 likes · 18 min read
Time Series Forecasting of Key Business Indicators: Methods, Models, and Practical Deployment
Huolala Tech
Huolala Tech
Aug 18, 2023 · Operations

Beyond System Metrics: Building Effective Business Monitoring for Pricing Services

Facing unpredictable software behavior, the article explains why traditional system‑level monitoring often misses critical business issues, especially in complex pricing services, and presents a comprehensive approach that combines result (black‑box) and process (white‑box) monitoring, practical metrics, and actionable recommendations to improve observability and reduce operational risk.

Business MetricsOperationsmonitoring
0 likes · 14 min read
Beyond System Metrics: Building Effective Business Monitoring for Pricing Services
vivo Internet Technology
vivo Internet Technology
Jun 21, 2023 · Game Development

Post‑Darwin Method for Game Business Effect Evaluation Using Stratified Sampling

The paper presents the ‘Post‑Darwin’ evaluation framework, which uses stratified sampling to compare participants and non‑participants across uniform payment layers, overcoming uneven user distributions and the lack of viable A/B tests in game‑business effect analysis, and demonstrates its effectiveness through real‑world promotional and reservation case studies.

Business MetricsGame Analyticsdata analysis
0 likes · 13 min read
Post‑Darwin Method for Game Business Effect Evaluation Using Stratified Sampling
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Nov 18, 2022 · Artificial Intelligence

Machine Learning-Based Anomaly Detection for Core Business Metrics

The paper proposes a containerized, machine‑learning framework that fuses rule‑based and XGBoost‑driven anomaly detection to monitor daily active users on a cloud music platform, achieving 89 % recall, 81 % precision and up to 74 % recall improvement over traditional threshold methods, while outlining future model refinement and broader metric applicability.

3-sigmaBusiness MetricsHolt-Winters
0 likes · 11 min read
Machine Learning-Based Anomaly Detection for Core Business Metrics
DevOps
DevOps
May 5, 2022 · Product Management

Experience Measurement: A Five‑Step Framework for Driving Business Impact

The article presents a five‑step experience measurement methodology that combines operational and perception data to link customer experience with business performance, offering practical guidance on model building, metric decomposition, diagnosis, redesign, continuous monitoring, and long‑term implementation principles.

Business MetricsROIcustomer experience
0 likes · 10 min read
Experience Measurement: A Five‑Step Framework for Driving Business Impact
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 18, 2022 · Big Data

Overview of Meituan Merchant Version Data Metrics System

This article provides a comprehensive overview of Meituan's merchant platform data metric system, detailing its five main modules—overview, business, traffic, customer, and product—along with competitor analysis and actionable insights for merchants to improve operations and growth.

Business MetricsMeituanMerchant Insights
0 likes · 11 min read
Overview of Meituan Merchant Version Data Metrics System
Python Crawling & Data Mining
Python Crawling & Data Mining
Nov 16, 2021 · Product Management

How to Build a Universal Data Indicator System for Business Success

This article explains how data can empower business decisions, outlines a seven‑step workflow for constructing a cross‑departmental data indicator system, and demonstrates the use of OSM, AARRR/UJM, and MECE models to create a universal, hierarchical metric framework applicable to most internet products.

AARRRBusiness MetricsIndicator System
0 likes · 9 min read
How to Build a Universal Data Indicator System for Business Success
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Nov 1, 2021 · Fundamentals

Nine Basic Data Analysis Methods for Business Insights

This article introduces nine fundamental data analysis techniques—including periodic, structural, layered, matrix, decomposition, funnel, correlation, tag, and MECE methods—explaining how to apply each to interpret business metrics, uncover insights, and guide decision‑making without requiring advanced mathematics or complex algorithms.

Business MetricsFunnel AnalysisMEME
0 likes · 12 min read
Nine Basic Data Analysis Methods for Business Insights
58UXD
58UXD
May 7, 2021 · Product Management

How 58.com Boosted Used‑Car Phone Conversions by 95% Through User‑Mind‑Driven Design

This case study details how 58.com’s second‑hand car platform aligned product strategy with evolving consumer behavior, dissected user mind differences across key touchpoints, and implemented targeted design improvements on the homepage, filter, list, and detail pages, ultimately exceeding phone‑conversion targets by over 95%.

Business MetricsConversion OptimizationProduct Design
0 likes · 13 min read
How 58.com Boosted Used‑Car Phone Conversions by 95% Through User‑Mind‑Driven Design
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 10, 2020 · Operations

Understanding the “Magic Number” in Sales Operations: Common Pitfalls and Correct Approaches

Sales teams often chase arbitrary “magic numbers” like 100 calls or 100 minutes, mistaking correlation for causation; this article explains the original meaning of magic numbers in user retention analysis, highlights statistical errors, and outlines a data‑driven four‑step process to identify true performance drivers and actionable strategies.

Business MetricsOperationscausation
0 likes · 9 min read
Understanding the “Magic Number” in Sales Operations: Common Pitfalls and Correct Approaches
Didi Tech
Didi Tech
May 15, 2020 · Artificial Intelligence

Key Factors for Effective Data Product Development and Algorithm Engineer Evaluation

Effective data product development hinges on deep business understanding, clear metric decomposition, rigorous model evaluation, and translating technical performance into business impact, while algorithm engineers are best assessed by publication quality, problem significance, algorithmic contribution, and practical interview questions on model tuning and improvement.

Business Metricsalgorithm evaluationbig data
0 likes · 10 min read
Key Factors for Effective Data Product Development and Algorithm Engineer Evaluation
58 Tech
58 Tech
Mar 25, 2019 · Artificial Intelligence

Machine Learning‑Based Threshold‑Free Monitoring for Business Metrics

This article describes a monitoring system that leverages machine learning to perform threshold‑free, real‑time anomaly detection on macro business indicators such as network traffic and access volume, detailing its architecture, sample labeling, model training, and multi‑level alarm strategies.

AIBusiness MetricsOperations
0 likes · 7 min read
Machine Learning‑Based Threshold‑Free Monitoring for Business Metrics
58 Tech
58 Tech
Feb 21, 2019 · Artificial Intelligence

Threshold‑Free Business Metric Monitoring Using Machine Learning

This article describes how a machine‑learning‑driven monitoring system replaces fixed thresholds with personalized, anomaly‑based detection for business‑level metrics such as network traffic and access volume, detailing the architecture, sample labeling, model training, alarm grading, and operational benefits.

AI OpsBusiness Metricsalarm grading
0 likes · 8 min read
Threshold‑Free Business Metric Monitoring Using Machine Learning
Efficient Ops
Efficient Ops
Sep 17, 2018 · Operations

How Alibaba Scales Monitoring: From CMDB to AI‑Driven Full‑Link Observability

Alibaba’s monitoring evolution—from fragmented early tools to the standardized Sunfire platform and now AI‑powered full‑link observability—addresses scaling challenges, introduces business‑centric metrics, automated traceability, and intelligent anomaly detection, illustrating how massive, multi‑tenant infrastructures achieve unified, proactive operations at scale.

AIOpsAlibabaBusiness Metrics
0 likes · 19 min read
How Alibaba Scales Monitoring: From CMDB to AI‑Driven Full‑Link Observability
Alibaba Cloud Developer
Alibaba Cloud Developer
Aug 28, 2018 · Operations

How Alibaba Achieves Full‑Link Business Monitoring: A Practical Guide

Alibaba’s infrastructure team introduces a full‑link business monitoring approach that visualizes end‑to‑end health from a business perspective, unifies metrics, automates data collection, and leverages intelligent baseline alerts, enabling rapid issue detection, precise root‑cause analysis, and fine‑grained dimension monitoring across services.

AlibabaBusiness MetricsOperations
0 likes · 11 min read
How Alibaba Achieves Full‑Link Business Monitoring: A Practical Guide
dbaplus Community
dbaplus Community
Jan 29, 2018 · Operations

How Data‑Driven Monitoring Unlocks Real Value for Ops Teams

This article explains why quantifiable data is essential for evaluating the impact of operational changes, outlines common data‑collection stacks, defines core business and user‑centric metrics, and demonstrates practical monitoring techniques such as PCU analysis, simulated user flows, and intelligent scaling to turn ops work into measurable business value.

Business MetricsDevOpsOperations
0 likes · 15 min read
How Data‑Driven Monitoring Unlocks Real Value for Ops Teams