BestHub
Sign in
Tagged articles

data monitoring

19 articles · Page 1 of 1
Smart Sea Tide
Smart Sea Tide
Sep 18, 2026 · Databases

6 Core Data Quality Metrics for Robust Data Governance

This article outlines six fundamental data quality metrics—accuracy, completeness, consistency, timeliness, uniqueness, and validity—detailing their focus areas and measurement approaches, and illustrates how a monitoring dashboard with radar charts and trend analysis can track a 92.1 composite score, 96.3% compliance rate, 8.7% daily issue reduction, and 268% ROI, emphasizing that sustained quality requires standards, organization, processes, technology, and continuous improvement.

Data QualityROIdata governance
0 likes · 3 min read
6 Core Data Quality Metrics for Robust Data Governance
Data Integration and Governance
Data Integration and Governance
Sep 1, 2026 · Big Data

Building a Real-Time Data Warehouse: End-to-End Pipeline from Kafka to BI

This article details the end-to-end architecture of a real-time data warehouse, covering data ingestion via CDC and Kafka, stream processing challenges like deduplication and event-time handling, layered modeling (ODS/DWD/DWS/ADS), unified metric definitions, and critical production monitoring for latency, lag, data reconciliation, and consistency with offline results.

CDCData ModelingFlink
0 likes · 20 min read
Building a Real-Time Data Warehouse: End-to-End Pipeline from Kafka to BI
Data Integration and Governance
Data Integration and Governance
Mar 18, 2026 · Fundamentals

Finally, a Clear Guide to Managing Data Quality End‑to‑End

The article explains why data quality is critical for reliable business decisions and walks through a complete end‑to‑end management framework—including lifecycle stages, organizational responsibilities, processes, tools, culture, and six practical methods such as cleaning, deduplication, standardization, validation, monitoring, and repair.

Data QualityETLdata cleaning
0 likes · 12 min read
Finally, a Clear Guide to Managing Data Quality End‑to‑End
Lakehouse Research Base
Lakehouse Research Base
May 28, 2025 · Big Data

End-to-End Data Lifecycle Management: Closed-Loop Framework for Data Value

This article details a closed-loop Data Lifecycle Management (DLM) framework covering six stages—requirement confirmation, model design, development, testing, monitoring, and archiving—with governance practices, toolchains, and a bank case study showing reduced rework, storage costs, and model drift.

Data ArchivingData Lifecycle ManagementData Modeling
0 likes · 12 min read
End-to-End Data Lifecycle Management: Closed-Loop Framework for Data Value
iQIYI Technical Product Team
iQIYI Technical Product Team
Feb 7, 2024 · Backend Development

Optimization of TV Streaming Service Architecture and Performance

The article describes how redesigning a TV streaming service from a single to a dual‑service architecture, leveraging Android Binder, optimized protocol startup, adaptive networking, and session‑based monitoring dramatically boosted stability above 99%, protocol success over 98.5%, and issue‑resolution efficiency via systematic batch analysis and A/B testing.

Android ServiceIssue ResolutionTV Streaming Optimization
0 likes · 11 min read
Optimization of TV Streaming Service Architecture and Performance
Data Thinking Notes
Data Thinking Notes
Dec 7, 2023 · Big Data

How NetEase Yanxuan Detects and Diagnoses Metric Anomalies at Scale

This article explains NetEase Yanxuan's end‑to‑end practice for automatically detecting, classifying, and diagnosing metric anomalies in e‑commerce, covering background motivation, three anomaly types, statistical detection frameworks (GESD, volatility, trend), post‑processing, contribution‑decomposition methods, dimension‑explosion challenges, and practical optimizations.

contribution decompositiondata monitoringe-commerce
0 likes · 20 min read
How NetEase Yanxuan Detects and Diagnoses Metric Anomalies at Scale
Ziru Technology
Ziru Technology
May 9, 2023 · Big Data

Boost Data Reliability: Automated Testing for Big Data Metrics

This article analyzes how 33% of data‑center defects stem from big‑data scheduling errors and proposes an automated testing system that monitors data metric integrity, accuracy, and timeliness through interface automation, visual dashboards, alert bots, and a custom ORM framework to dramatically improve ROI.

ORMROIautomated testing
0 likes · 7 min read
Boost Data Reliability: Automated Testing for Big Data Metrics
Data Thinking Notes
Data Thinking Notes
Apr 25, 2023 · Operations

Why Data Quality Matters: A Practical Guide to Governance and Seven‑Dimensional Evaluation

This article explains why data quality is critical for businesses, outlines common data quality problems, their root causes, and presents a comprehensive governance framework—including monitoring rules, alerting, full‑link monitoring, and a seven‑dimensional evaluation model—to ensure high‑quality data delivery.

Data Qualitybig datadata governance
0 likes · 12 min read
Why Data Quality Matters: A Practical Guide to Governance and Seven‑Dimensional Evaluation
Efficient Ops
Efficient Ops
Nov 22, 2022 · Operations

Why Data Quality Is the Hidden Cost Killer and How to Master Its Governance

This article explains why data quality is critical for business success, outlines common data quality problems and their root causes, and presents a practical governance framework with monitoring rules, alerts, full‑link monitoring, and a seven‑dimensional evaluation model to continuously improve data reliability.

Data Qualitydata governancedata monitoring
0 likes · 12 min read
Why Data Quality Is the Hidden Cost Killer and How to Master Its Governance
58UXD
58UXD
Dec 9, 2021 · Product Management

How We Built an Experience Cockpit: From Data Collection to Actionable Insights

This article details the design and implementation of the Experience Cockpit, a one‑stop platform for monitoring user experience data, covering its purpose, metric hierarchy, non‑intrusive data collection, AI‑driven processing, visualization dashboards, alerting mechanisms, and how it drives product decisions.

AI NLPUX Researchdata monitoring
0 likes · 10 min read
How We Built an Experience Cockpit: From Data Collection to Actionable Insights
Youzan Coder
Youzan Coder
Jun 30, 2021 · Big Data

Online Monitoring Practices for Offline and Real-Time Data at Youzan

Youzan Data Report Center monitors offline batch and real‑time data pipelines using accuracy and timeliness rules, cross‑table checks, upstream‑downstream comparisons, and scheduled alerts to detect anomalies early; since 2021 it has generated over 25 alerts, and plans a unified data‑quality dashboard.

Data QualityFlinkHive
0 likes · 12 min read
Online Monitoring Practices for Offline and Real-Time Data at Youzan
TAL Education Technology
TAL Education Technology
Jun 11, 2020 · Big Data

Data Quality Monitoring: Standards, Practices, and Technical Solutions

This article outlines the importance of data quality in the big‑data era, defines evaluation criteria such as integrity, accuracy, consistency and timeliness, describes daily monitoring and reconciliation processes, and proposes technical solutions and challenges for building a comprehensive data‑quality monitoring platform.

Data Qualitydata governancedata monitoring
0 likes · 7 min read
Data Quality Monitoring: Standards, Practices, and Technical Solutions
Youku Technology
Youku Technology
Dec 6, 2019 · Backend Development

Technical Architecture and Strategies of Youku's Demand‑Side Platform (DSP)

Youku’s Demand‑Side Platform combines integrated RTB channel access, sophisticated delivery strategies, personalized recommendation algorithms, and real‑time monitoring to acquire and re‑engage segmented users, optimizing budgets, creative performance, and conversion funnels while continuously iterating on traffic value estimation and bidding models.

BackendDSPUser Acquisition
0 likes · 13 min read
Technical Architecture and Strategies of Youku's Demand‑Side Platform (DSP)
DataFunTalk
DataFunTalk
Dec 6, 2019 · Backend Development

Technical Architecture and Practices of Youku's Demand‑Side Platform (DSP)

This article explains how Youku built and iterated its Demand‑Side Platform, covering business goals, system architecture, channel integration, bidding and frequency strategies, material selection, smooth budget delivery, retargeting, algorithmic recall, data monitoring, and conversion‑funnel optimization to drive user growth.

DSPbackend architecturedata monitoring
0 likes · 12 min read
Technical Architecture and Practices of Youku's Demand‑Side Platform (DSP)
Youzan Coder
Youzan Coder
Oct 20, 2018 · Operations

Highlights of the Second Hangzhou Testing Salon – Full‑Chain Performance Testing, Test Engine Design, Quality Platforms, and More

The second Hangzhou Testing Salon, organized by Youzan with partners KuJiaLe, Mogujie and 51 Credit Card, gathered over 300 attendees from 130 companies to share practical insights on full‑chain performance testing, a distributed pressure‑testing engine, rule‑based quality platforms, front‑end coverage tools, search‑service reliability and data‑quality monitoring.

data monitoringfrontend coveragefull-chain testing
0 likes · 6 min read
Highlights of the Second Hangzhou Testing Salon – Full‑Chain Performance Testing, Test Engine Design, Quality Platforms, and More