Tagged articles
Business Metrics
33 articles · Page 1 of 1
Databricks launched Genie Ontology, a knowledge layer that captures multiple versions of business metrics with provenance, enabling AI agents to correctly answer questions like which CFD rate applied in a given financial year—achieving 91% test pass rate versus 45-58% for other agents by using ontology snippets and explicit modeling.
AI agentsBusiness MetricsData Agents
0 likes · 14 min read

Tsinghua, Microsoft, and collaborators introduce FDE-Gym, a reproducible benchmark for AI delivery agents across 20 customer scenarios and 95 tasks, revealing that even Claude Opus 5.5 solves only 14 tasks at the most realistic level, with the core bottleneck being discovery of implicit constraints and translation of facts into deployed systems.
AI delivery agentsAgent EvaluationBusiness Metrics
0 likes · 13 min read

This article explains the distinct roles of data warehouses, metric platforms, and BI tools, demonstrating why a data warehouse alone cannot unify business metric definitions, and provides a five-step framework for building a metric management system that ensures consistent calculations, version control, and cross-departmental reuse.
BIBusiness Metricsdata analytics
0 likes · 17 min read

This article explains how to manage conflicting but valid business metrics by sharing entity identity while maintaining distinct definitions, implementing explicit query conventions, preventing inference leaks through access controls, versioning definition changes, and validating systems with ambiguous query tests.
Business MetricsMetric VersioningSemantic Layer
0 likes · 22 min read

This article argues that technical success metrics for AI agents (like API success rates) misrepresent business value, and proposes a framework for measuring actual delivery: define qualified outcomes per pre-agreed contracts, fix the task denominator, track human effort and rework across auto/collaborative/escalation paths, and feed verified operational feedback into knowledge, model, and regression improvements.
AI agent evaluationBusiness Metricsafter-sales triage
0 likes · 26 min read

China's 2026 national policy formally establishes Frontier Deployment Engineers (FDEs) as the linchpin of AI value delivery, mandating a shift from model-centric benchmarks to measurable business outcomes via a four-ring methodology and six-layer metrics framework that ties success to client financial, operational, and adoption indicators.
414 documentAI deliveryAI implementation
0 likes · 13 min read

The article explains why large language models struggle with business data, introduces Ant Group's semantic‑layer approach built on Apache Ossie to impose strong business constraints, compares it with other retrieval methods, and details the engineering journey that delivered a unified source of truth for over 5,000 metrics while also announcing a related conference.
AI agentsAnt GroupApache Ossie
0 likes · 4 min read

This article walks readers through the entire data‑modeling lifecycle—from clarifying business goals and inventorying data sources to defining metrics, designing schema, processing data, validating quality, and iterating the model for sustainable business impact.
Business MetricsData ModelingETL
0 likes · 11 min read

The article explains that most AI project failures stem from unrealistic evaluation rather than model intelligence, and outlines concrete practices—business‑aligned metrics, scenario sandboxes, human‑in‑the‑loop reviews, and auditable documentation—to make model evaluation truly actionable.
AI DeploymentAI ReliabilityBusiness Metrics
0 likes · 7 min read

The article clarifies the distinction between data models, which structure and store business data, and metric models, which define and manage business measurements, covering their core elements, construction logic, outputs, application stages, iteration frequency, and how they complement each other.
Business MetricsData ModelingETL
0 likes · 10 min read

The article reflects on a CTO‑level reading approach, explains why architects must align with CEOs by measuring economic value rather than pure technical metrics, outlines concrete ways architects create revenue and cut costs, and proposes a capability ladder to guide career growth.
Business MetricsCTOarchitectural value
0 likes · 11 min read

This case study details YTO Express's comprehensive redesign of its member mini‑program—covering visual branding, interaction consistency, emotional resonance, and multi‑device adaptation—showing how systematic UX upgrades drove a 168% rise in experience scores and dramatic business metric improvements.
Business MetricsMobile AppUX design
0 likes · 9 min read

This article explains the definition of ROI, provides the standard calculation formula with examples, and explores its practical applications in project evaluation, budgeting, risk management, and operational optimization while also highlighting its key limitations.
Business MetricsROIReturn on Investment
0 likes · 6 min read


ArchitectSep 27, 2024 · Artificial Intelligence
This article presents a comprehensive AI‑driven system for automatically detecting anomalies in over 1,000 Ctrip train‑ticket business metrics and pinpointing their root causes, detailing the background, unsupervised algorithms, detection and attribution pipelines, practical results, and future improvements.
AI anomaly detectionBusiness MetricsCtrip
0 likes · 21 min read

This article explains metric attribution for internet platforms, covering its definition, a three‑step analytical framework, deterministic and probabilistic methods such as metric decomposition, machine‑learning models with SHAP values, case studies, and a practical tool that guides users through attribution analysis.
Business MetricsCausal InferenceInternet Platforms
0 likes · 15 min read

This article explains the fundamentals of metric attribution, outlines a three‑step framework for identifying, analyzing, and solving metric changes, compares deterministic, probabilistic, and speculative methods, and illustrates the approach with two real‑world case studies using decomposition and machine‑learning techniques.
Business MetricsCausal Inferencedata analysis
0 likes · 16 min read

This article explains the origins of SaaS, outlines the Chinese market landscape, and details fifteen crucial business metrics—including acquisition cost, LTV, MRR, ARR, NDR, and retention indicators—while also covering product development stages, GTM strategies, and growth models such as PLG and SLG for SaaS startups.
Business MetricsLTVMRR
0 likes · 25 min read

This article presents a comprehensive study on forecasting critical business metrics such as traffic, order volume, and GMV using traditional, machine‑learning, and deep‑learning time‑series models, detailing feature engineering, model design, experimental comparison, online deployment, and monitoring strategies.
AutoformerBusiness MetricsInformer
0 likes · 18 min read

Facing unpredictable software behavior, the article explains why traditional system‑level monitoring often misses critical business issues, especially in complex pricing services, and presents a comprehensive approach that combines result (black‑box) and process (white‑box) monitoring, practical metrics, and actionable recommendations to improve observability and reduce operational risk.
Business MetricsOperationsmonitoring
0 likes · 14 min read

The paper presents the ‘Post‑Darwin’ evaluation framework, which uses stratified sampling to compare participants and non‑participants across uniform payment layers, overcoming uneven user distributions and the lack of viable A/B tests in game‑business effect analysis, and demonstrates its effectiveness through real‑world promotional and reservation case studies.
Business MetricsGame Analyticsdata analysis
0 likes · 13 min read

The paper proposes a containerized, machine‑learning framework that fuses rule‑based and XGBoost‑driven anomaly detection to monitor daily active users on a cloud music platform, achieving 89 % recall, 81 % precision and up to 74 % recall improvement over traditional threshold methods, while outlining future model refinement and broader metric applicability.
3-sigmaBusiness MetricsHolt-Winters
0 likes · 11 min read


DevOpsMay 5, 2022 · Product Management
The article presents a five‑step experience measurement methodology that combines operational and perception data to link customer experience with business performance, offering practical guidance on model building, metric decomposition, diagnosis, redesign, continuous monitoring, and long‑term implementation principles.
Business MetricsROIcustomer experience
0 likes · 10 min read

This article provides a comprehensive overview of Meituan's merchant platform data metric system, detailing its five main modules—overview, business, traffic, customer, and product—along with competitor analysis and actionable insights for merchants to improve operations and growth.
Business MetricsMeituanMerchant Insights
0 likes · 11 min read

This article explains how data can empower business decisions, outlines a seven‑step workflow for constructing a cross‑departmental data indicator system, and demonstrates the use of OSM, AARRR/UJM, and MECE models to create a universal, hierarchical metric framework applicable to most internet products.
AARRRBusiness MetricsIndicator System
0 likes · 9 min read

This article introduces nine fundamental data analysis techniques—including periodic, structural, layered, matrix, decomposition, funnel, correlation, tag, and MECE methods—explaining how to apply each to interpret business metrics, uncover insights, and guide decision‑making without requiring advanced mathematics or complex algorithms.
Business MetricsFunnel AnalysisMEME
0 likes · 12 min read


58UXDMay 7, 2021 · Product Management
This case study details how 58.com’s second‑hand car platform aligned product strategy with evolving consumer behavior, dissected user mind differences across key touchpoints, and implemented targeted design improvements on the homepage, filter, list, and detail pages, ultimately exceeding phone‑conversion targets by over 95%.
Business MetricsConversion OptimizationProduct Design
0 likes · 13 min read

Sales teams often chase arbitrary “magic numbers” like 100 calls or 100 minutes, mistaking correlation for causation; this article explains the original meaning of magic numbers in user retention analysis, highlights statistical errors, and outlines a data‑driven four‑step process to identify true performance drivers and actionable strategies.
Business MetricsOperationscausation
0 likes · 9 min read


Didi TechMay 15, 2020 · Artificial Intelligence
Effective data product development hinges on deep business understanding, clear metric decomposition, rigorous model evaluation, and translating technical performance into business impact, while algorithm engineers are best assessed by publication quality, problem significance, algorithmic contribution, and practical interview questions on model tuning and improvement.
Business Metricsalgorithm evaluationbig data
0 likes · 10 min read


58 TechMar 25, 2019 · Artificial Intelligence
This article describes a monitoring system that leverages machine learning to perform threshold‑free, real‑time anomaly detection on macro business indicators such as network traffic and access volume, detailing its architecture, sample labeling, model training, and multi‑level alarm strategies.
AIBusiness MetricsOperations
0 likes · 7 min read


58 TechFeb 21, 2019 · Artificial Intelligence
This article describes how a machine‑learning‑driven monitoring system replaces fixed thresholds with personalized, anomaly‑based detection for business‑level metrics such as network traffic and access volume, detailing the architecture, sample labeling, model training, alarm grading, and operational benefits.
AI OpsBusiness Metricsalarm grading
0 likes · 8 min read

Alibaba’s monitoring evolution—from fragmented early tools to the standardized Sunfire platform and now AI‑powered full‑link observability—addresses scaling challenges, introduces business‑centric metrics, automated traceability, and intelligent anomaly detection, illustrating how massive, multi‑tenant infrastructures achieve unified, proactive operations at scale.
AIOpsAlibabaBusiness Metrics
0 likes · 19 min read

Alibaba’s infrastructure team introduces a full‑link business monitoring approach that visualizes end‑to‑end health from a business perspective, unifies metrics, automates data collection, and leverages intelligent baseline alerts, enabling rapid issue detection, precise root‑cause analysis, and fine‑grained dimension monitoring across services.
AlibabaBusiness MetricsOperations
0 likes · 11 min read

This article explains why quantifiable data is essential for evaluating the impact of operational changes, outlines common data‑collection stacks, defines core business and user‑centric metrics, and demonstrates practical monitoring techniques such as PCU analysis, simulated user flows, and intelligent scaling to turn ops work into measurable business value.
Business MetricsDevOpsOperations
0 likes · 15 min read
