BestHub
Sign in
Tagged articles

Data Governance

687 articles · Page 4 of 7
DataFunSummit
DataFunSummit
Apr 17, 2024 · Big Data

White‑Box Cost Governance in Big Data: Engine, Data Warehouse, and Tool Optimizations

This article presents a year‑long, white‑box cost‑governance practice for big‑data platforms, detailing the data‑governance framework, engine auto‑tuning (HBO), compression algorithm replacement, operator analysis, data‑warehouse white‑boxing, duplicate‑computation reduction, link‑depth minimisation, automation of routine governance, benefit analysis, and future plans.

Data Governancecost optimizationengine tuning
0 likes · 17 min read
White‑Box Cost Governance in Big Data: Engine, Data Warehouse, and Tool Optimizations
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Apr 16, 2024 · Big Data

MaxCompute’s Integrated Offline & Near‑Real‑Time Architecture: Transaction Table 2.0 Explained

This article explains MaxCompute’s new integrated offline‑and‑near‑real‑time architecture, Transaction Table 2.0, detailing its unified storage and compute design, automatic data governance, schema evolution, upsert and time‑travel capabilities, and how it simplifies complex big‑data pipelines while delivering minute‑level latency and lower costs.

Big DataData GovernanceMaxCompute
0 likes · 27 min read
MaxCompute’s Integrated Offline & Near‑Real‑Time Architecture: Transaction Table 2.0 Explained
DataFunTalk
DataFunTalk
Apr 12, 2024 · Big Data

Building and Managing an Indicator System in a Data Warehouse: Practices from the Dongchedi Business

This article explains how the Dongchedi team designed, implemented, and monitored a comprehensive indicator system within a petabyte‑scale data warehouse, covering standards, metadata management, model construction, quality monitoring, and diverse application scenarios to improve data reliability and business insight.

Big DataData GovernanceData Warehouse
0 likes · 18 min read
Building and Managing an Indicator System in a Data Warehouse: Practices from the Dongchedi Business
Data Thinking Notes
Data Thinking Notes
Apr 9, 2024 · Big Data

What Is a Data Middle Platform and Why It’s Essential for Modern Enterprises

Data middle platforms transform raw enterprise data into reusable assets by integrating collection, storage, processing, governance, and service layers, enabling faster deployment, consistent metrics, improved data quality, and business value across digital transformation, while addressing challenges like siloed data, low efficiency, and inconsistent standards.

Big DataData GovernanceData Integration
0 likes · 23 min read
What Is a Data Middle Platform and Why It’s Essential for Modern Enterprises
DataFunTalk
DataFunTalk
Apr 3, 2024 · Artificial Intelligence

DataFunCon 2024 Shanghai: AI, Big Data, Cloud and Industry Forum Program

DataFunCon 2024 Shanghai brings together leading experts from AI, big data, cloud computing, and industry sectors to discuss cutting‑edge technologies, large‑model applications, intelligent operations, and digital transformation across automotive, healthcare, finance, retail, and entertainment.

Big DataCloud ComputingData Governance
0 likes · 69 min read
DataFunCon 2024 Shanghai: AI, Big Data, Cloud and Industry Forum Program
DataFunTalk
DataFunTalk
Mar 29, 2024 · Big Data

Best Practices for Building an International Ride‑Hailing Data Metric System at Didi

This article outlines Didi’s best‑practice approach to constructing a global ride‑hailing data metric system, covering business scenarios, metric categories, pain points such as definition and technical challenges, and a comprehensive solution involving organizational structure, processes, model design, tooling, timezone handling, and governance.

Data GovernanceData MetricsDidi
0 likes · 13 min read
Best Practices for Building an International Ride‑Hailing Data Metric System at Didi
DataFunTalk
DataFunTalk
Mar 27, 2024 · Big Data

Data Collection Quality Review: From Compliance to Reasonableness and Toolchain Overview

This article explores data collection governance by distinguishing data quality compliance from reasonableness, introduces a comprehensive quality review tool suite—including visual inspection, intelligent judgment, and self‑diagnosis—detailing its architecture, key techniques, and practical case studies for ensuring reliable data metrics.

Big DataData GovernanceIntelligent Judgment
0 likes · 19 min read
Data Collection Quality Review: From Compliance to Reasonableness and Toolchain Overview
DataFunTalk
DataFunTalk
Mar 24, 2024 · Big Data

Didi's Big Data Asset Governance Practices: Hadoop and Elasticsearch Governance

This article details Didi's comprehensive big‑data asset governance platform, covering its architectural layers, Hadoop and Elasticsearch governance practices, health‑score models, lifecycle recommendations, and future plans for automated and intelligent data governance to reduce cost and manual effort.

Asset ManagementBig DataData Governance
0 likes · 17 min read
Didi's Big Data Asset Governance Practices: Hadoop and Elasticsearch Governance
DataFunSummit
DataFunSummit
Mar 15, 2024 · Product Management

How to Build a Good Data Platform: Insights from Tencent’s Senior Product Manager

This presentation shares the speaker’s experience and practical methods for creating an effective data platform, covering the transition from technical roles to product management, deep understanding of data workers' needs, Tencent Oura asset‑factory practices, a product‑management methodology, and a Q&A session that addresses governance, performance, and engineering challenges.

Data EngineeringData Governanceproduct management
0 likes · 15 min read
How to Build a Good Data Platform: Insights from Tencent’s Senior Product Manager
JD Tech
JD Tech
Mar 5, 2024 · Big Data

JD Retail Data Asset Management: Upgrading Practices and Technical Innovations

This article examines JD Retail's comprehensive upgrade of data asset management, detailing innovations in data governance, multi‑level acceleration engines, intelligent materialization, unified DSL, visualization tools, low‑code orchestration, and large‑model AI applications that boost efficiency, reliability, and business decision‑making.

Data GovernanceLow-codedata asset management
0 likes · 43 min read
JD Retail Data Asset Management: Upgrading Practices and Technical Innovations
JD Retail Technology
JD Retail Technology
Feb 22, 2024 · Big Data

JD Retail Data Platform: Data Asset Governance, Metric Middle Platform, Visualization Tools, and AI‑Driven Applications

This technical article details JD Retail’s 2023 data platform advancements, covering data‑asset certification and governance, a metric middle‑platform for unified indicator management, sophisticated visualization components, low‑code orchestration, and large‑model AI applications that together improve data retrieval efficiency, reduce storage‑compute costs, and support rapid business decision‑making.

AIData GovernanceLow-code
0 likes · 39 min read
JD Retail Data Platform: Data Asset Governance, Metric Middle Platform, Visualization Tools, and AI‑Driven Applications
ByteDance Data Platform
ByteDance Data Platform
Feb 21, 2024 · Big Data

How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance

ByteDance’s DataLeap suite tackles the complexities of large‑scale data platform governance by identifying manual tuning pain points, deploying automated rule‑engine recommendations, and optimizing resource allocation, ultimately improving stability, reducing costs, and enhancing overall system health across thousands of Spark, Flink and other tasks.

Data GovernanceResource Optimizationreal-time monitoring
0 likes · 14 min read
How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance
DataFunTalk
DataFunTalk
Feb 17, 2024 · Big Data

JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization

This article presents JD Logistics' one‑stop agile BI platform, detailing the complex data sources, rapid requirement changes, and Chinese‑style reporting challenges it addresses, while outlining the UData solution, product methodology, performance enhancements, and real‑world case studies that demonstrate significant efficiency gains.

Agile AnalyticsBIBig Data
0 likes · 26 min read
JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization
DataFunTalk
DataFunTalk
Feb 15, 2024 · Big Data

Data Quality Review: From Compliance to Reasonableness and Toolchain Overview

This article explores data collection governance by distinguishing compliance from reasonableness, introduces a comprehensive quality review tool system—including visual inspection, intelligent judgement, and self‑diagnosis—details key techniques such as comparison operators and sampling, and outlines a three‑layer architecture and future directions for data quality assurance.

Big DataData GovernanceQuality Assurance
0 likes · 18 min read
Data Quality Review: From Compliance to Reasonableness and Toolchain Overview
Data Thinking Notes
Data Thinking Notes
Jan 30, 2024 · Operations

How Banks Can Build an Effective Data Governance Framework

This article outlines a two‑step approach for banks to design a data governance system—clarifying organizational responsibilities and constructing a layered institutional framework—while detailing cross‑department collaboration, head‑office and branch coordination, and practical policy, procedure, and work‑detail levels to sustain continuous improvement and support digital transformation.

BankingData GovernanceData Management
0 likes · 10 min read
How Banks Can Build an Effective Data Governance Framework
DataFunSummit
DataFunSummit
Jan 29, 2024 · Big Data

Building Bilibili's Data Service Middle Platform: Architecture, Practices, and Future Plans

This article presents Bilibili's data service middle platform, detailing its background, pain points of traditional data acquisition, the one‑stop service architecture, core processes, model and API construction, query mechanisms, practical solutions for full‑link control, cost reduction, efficiency gains, high‑availability design, and future roadmap.

APIData Governancedata services
0 likes · 19 min read
Building Bilibili's Data Service Middle Platform: Architecture, Practices, and Future Plans
政采云技术
政采云技术
Jan 24, 2024 · Big Data

A Business Analyst’s End‑to‑End Journey Using a Data Middle Platform: From Issue Identification to Data‑Driven Solutions

The article walks through a detailed, real‑world scenario where a business analyst leverages a data middle platform—covering metric analysis, exploratory queries, data development, visualization, and productization—to diagnose a 30% sales decline and implement data‑driven remediation, illustrating core concepts such as OneData and OneService.

Data DevelopmentData Governanceanalytics
0 likes · 12 min read
A Business Analyst’s End‑to‑End Journey Using a Data Middle Platform: From Issue Identification to Data‑Driven Solutions
DataFunTalk
DataFunTalk
Jan 22, 2024 · Big Data

Design and Implementation of Bilibili's Big Data Development Governance Platform

This article details Bilibili's five‑year development of a comprehensive big‑data governance platform, covering its usage scenarios, product positioning, data map and governance solutions, abstract configuration approach, operational mechanisms, and future plans, highlighting significant improvements in data efficiency and value assessment.

Big Data PlatformBilibiliData Governance
0 likes · 10 min read
Design and Implementation of Bilibili's Big Data Development Governance Platform
DataFunTalk
DataFunTalk
Jan 20, 2024 · Big Data

How ByteDance Leverages the Data Flywheel in Large‑Scale Projects

This article explains how ByteDance (Douyin) transforms its data infrastructure from isolated workshops to a unified middle platform and finally to a data flywheel, detailing the three development stages, the Data BP organizational model, real‑time analytics, A/B testing, and the resulting business benefits for large‑scale event projects.

Big DataData EngineeringData Flywheel
0 likes · 13 min read
How ByteDance Leverages the Data Flywheel in Large‑Scale Projects
DevOps
DevOps
Jan 17, 2024 · Operations

Agile Data Management: Principles, Practices, and Implementation Guide

This article explains how agile methodologies can be applied to data management, covering the need for agile data practices, core principles, iterative modeling, governance, CI/CD pipelines, tooling, metrics, security, case studies, challenges, and future outlooks in a comprehensive, step‑by‑step guide.

Data GovernanceData ManagementData Modeling
0 likes · 13 min read
Agile Data Management: Principles, Practices, and Implementation Guide
DataFunTalk
DataFunTalk
Jan 12, 2024 · Big Data

Building a Unified Data Empowerment Layer with Apache Kyuubi at GF Securities

The article describes how GF Securities designed and implemented a unified big‑data empowerment layer based on Apache Kyuubi to address data‑centric challenges, improve efficiency, ensure controllable governance, and support agile data scenarios across ingestion, processing, storage, and security.

Apache KyuubiBig DataData Empowerment
0 likes · 33 min read
Building a Unified Data Empowerment Layer with Apache Kyuubi at GF Securities
Data Thinking Notes
Data Thinking Notes
Jan 9, 2024 · Fundamentals

How to Build an Effective Enterprise Data Governance Framework

Designing a data governance system involves defining data architecture, standards, and master data, documenting mechanisms, aligning them with actual business and analytical data processes, forming joint teams for specialized governance activities, and institutionalizing these practices through formal processes to sustain continuous data capability across the enterprise.

Data Governancedata architecturedata standards
0 likes · 3 min read
How to Build an Effective Enterprise Data Governance Framework
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 5, 2024 · Big Data

Tencent PCG Data Governance System Overview

This article presents a comprehensive overview of Tencent PCG's data governance system, describing its challenges, four‑stage solution architecture—including data governance overview, meta‑warehouse construction, asset‑scoring framework, and a one‑stop governance workbench—along with detailed mechanisms such as lineage analysis, rule‑engine driven governance items, and cost‑aware asset scoring.

Asset ScoringData GovernanceLineage
0 likes · 13 min read
Tencent PCG Data Governance System Overview
Data Thinking Notes
Data Thinking Notes
Jan 2, 2024 · Big Data

How a Three-Dimensional Data Governance Model Breaks Silos and Boosts Efficiency

Enterprise data governance faces challenges like information silos, departmental walls, and unclear responsibilities; adopting a three‑dimensional “business‑technology‑organization” framework—setting standards, optimizing processes, and innovating structures—helps eliminate these obstacles, enhance collaboration, improve data quality, and drive cost‑saving, efficiency, and innovation.

Big DataBusiness CollaborationData Governance
0 likes · 10 min read
How a Three-Dimensional Data Governance Model Breaks Silos and Boosts Efficiency
DataFunSummit
DataFunSummit
Jan 2, 2024 · Big Data

Data Quality Governance: From Compliance to Reasonableness – Tools, Techniques, and Key Technologies

This article explores how data collection quality can be elevated from mere compliance to true reasonableness by introducing a comprehensive quality‑review toolchain, visual comparison methods, intelligent rule‑based detection, and self‑diagnosis utilities, while also detailing the underlying sample‑library and three‑layer architecture that power these capabilities.

Data Governancequality inspectionvisual analytics
0 likes · 21 min read
Data Quality Governance: From Compliance to Reasonableness – Tools, Techniques, and Key Technologies
Data Thinking Notes
Data Thinking Notes
Dec 28, 2023 · Big Data

How Xiaomi Built a Scalable Metric System: Best Practices and Methodology

This article explains Xiaomi's end‑to‑end metric system construction, covering the definition of metrics, business pain points, the OSM (Object‑Strategy‑Measure) model, MECE principle, model design guidelines, data‑warehouse implementation, metric management, and the resulting data‑driven workflow across the company.

Big DataData GovernanceData Warehouse
0 likes · 10 min read
How Xiaomi Built a Scalable Metric System: Best Practices and Methodology
DataFunTalk
DataFunTalk
Dec 28, 2023 · Product Management

Building an Effective Data Platform: Insights and Practices from Tencent's Senior Product Manager

Senior Tencent product manager He Zhichao shares his experience and methodology for creating a high‑quality data platform, covering the transition from technical roles to product, understanding data users’ needs, the Euler asset‑factory implementation, product‑manager best practices, and solutions to common data‑engineering challenges.

Data EngineeringData GovernanceDataOps
0 likes · 16 min read
Building an Effective Data Platform: Insights and Practices from Tencent's Senior Product Manager
DataFunTalk
DataFunTalk
Dec 26, 2023 · Artificial Intelligence

The Evolution of AI and Its Challenges in the Data Industry

This article reviews the historical development of artificial intelligence, explains how AI technologies such as large language models are reshaping data processing and analysis, and discusses the practical challenges, trust issues, and governance requirements when applying AI to the data industry.

Data GovernanceData IndustryGPT
0 likes · 10 min read
The Evolution of AI and Its Challenges in the Data Industry
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Dec 26, 2023 · Big Data

How Panasonic Overcame Data Silos: A Big Data Governance Journey

Panasonic's digital transformation case study details the challenges of fragmented data across 64 subsidiaries, the strategic adoption of a serverless big‑data platform, governance milestones from 2021 to 2023, tool comparisons, standardization efforts, talent development, and future outlook driven by five core values.

Big DataCloud ComputingData Governance
0 likes · 15 min read
How Panasonic Overcame Data Silos: A Big Data Governance Journey
DataFunSummit
DataFunSummit
Dec 16, 2023 · Artificial Intelligence

Enterprise Large Model Deployment: Data Governance, Fine‑Tuning Strategies, and Cost Economics

The article examines how enterprises can adopt domain‑specific large models by addressing talent and cost challenges, outlining self‑supervised pre‑training, instruction fine‑tuning, data governance for unstructured data, dataset balance, model‑type selection, and integrated product solutions to achieve efficient, high‑performance AI deployments.

AI deploymentData GovernanceEnterprise AI
0 likes · 13 min read
Enterprise Large Model Deployment: Data Governance, Fine‑Tuning Strategies, and Cost Economics
Zhuanzhuan Tech
Zhuanzhuan Tech
Dec 14, 2023 · Big Data

Design and Implementation of a Data Service Platform for New Media Business

This article details the background, challenges, design principles, and implementation of a unified data service platform—including data modeling, multi-source governance, real-time processing, and a Doris-based storage solution—to support large‑scale video data for a new media operation.

Apache DorisData GovernanceData Modeling
0 likes · 7 min read
Design and Implementation of a Data Service Platform for New Media Business
DataFunSummit
DataFunSummit
Dec 13, 2023 · Artificial Intelligence

Enterprise Large‑Model Deployment: Data Governance, Fine‑Tuning Strategies, and Cost Economics

The article explores how enterprises can adopt domain‑specific large language models by addressing talent and cost challenges, outlining training pipelines, data governance for unstructured data, dataset balancing, fine‑tuning techniques, and a product ecosystem that lowers deployment barriers while optimizing performance and economics.

AI deploymentData Governancecost economics
0 likes · 13 min read
Enterprise Large‑Model Deployment: Data Governance, Fine‑Tuning Strategies, and Cost Economics
Data Thinking Notes
Data Thinking Notes
Dec 5, 2023 · Big Data

How to Overcome Data Governance Challenges and Unlock Business Value

Enterprises face significant hurdles in data governance and integration, from siloed systems and unclear responsibilities to poor data quality, but by establishing clear rules, fostering user department engagement, and aligning governance with business-driven data applications, they can create a cohesive data asset management framework that drives value.

Big DataData GovernanceData Integration
0 likes · 10 min read
How to Overcome Data Governance Challenges and Unlock Business Value
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 5, 2023 · Big Data

NetEase EasyData Metric Middle Platform: Architecture, Core Technologies, and Future Plans

This article details NetEase EasyData's evolution and product matrix, explains why a metric middle platform is needed, describes its core technical architecture—including a unified logical semantic model, a custom metric query language, and engine decoupling—and outlines future development directions.

Big DataData GovernanceData Modeling
0 likes · 12 min read
NetEase EasyData Metric Middle Platform: Architecture, Core Technologies, and Future Plans
DataFunTalk
DataFunTalk
Nov 28, 2023 · Big Data

Xiaomi Metric System Construction and Management Best Practices

This article presents Xiaomi's comprehensive metric system framework, covering its definition, business pain points, the OSM and MECE methodologies, model design principles, data warehouse construction, metric management, and future outlook, illustrating how a unified data platform drives efficient business decision‑making.

Business IntelligenceData GovernanceData Warehouse
0 likes · 10 min read
Xiaomi Metric System Construction and Management Best Practices
Data Thinking Notes
Data Thinking Notes
Nov 26, 2023 · Fundamentals

How a Large Enterprise Overcame Master Data Chaos: A Practical Case Study

This article outlines a real‑world enterprise master data project, detailing the definition of master data, the four critical data‑quality challenges faced, the comprehensive solution framework with executive backing, and the six measurable outcomes that improved data governance, efficiency, and decision‑making across the organization.

Data GovernanceEnterprise Architecturedata quality
0 likes · 10 min read
How a Large Enterprise Overcame Master Data Chaos: A Practical Case Study
DataFunTalk
DataFunTalk
Nov 23, 2023 · Big Data

Tencent PCG Data Governance System: Architecture, Asset Scoring, and One‑Stop Governance Platform

The article presents Tencent PCG's comprehensive data governance solution, detailing the challenges of massive, heterogeneous data, the four‑chapter framework covering governance overview, meta‑warehouse construction, an open asset‑scoring system, and a one‑stop governance workbench, and explains how lineage, scoring, and rule‑engine mechanisms enable cost‑effective, continuous data governance.

Asset ScoringBig DataData Governance
0 likes · 14 min read
Tencent PCG Data Governance System: Architecture, Asset Scoring, and One‑Stop Governance Platform
DataFunTalk
DataFunTalk
Nov 20, 2023 · Big Data

Automated Data Governance and Optimization with Volcano Engine DataLeap: Challenges, Solutions, and Benefits

This article examines the challenges faced by Volcano Engine's DataLeap in computational governance, outlines automated solutions such as real‑time rule engines and monitoring, and presents concrete performance and cost benefits achieved through resource optimization across large‑scale Spark and Hadoop workloads.

AutomationBig DataData Governance
0 likes · 13 min read
Automated Data Governance and Optimization with Volcano Engine DataLeap: Challenges, Solutions, and Benefits
Data Thinking Notes
Data Thinking Notes
Nov 19, 2023 · Fundamentals

How to Build an Effective Data Asset Management Framework for Enterprises

This article explains why enterprises need a data asset framework, outlines its key components such as catalog management, policy support, and development trends, and provides a step‑by‑step guide with visual diagrams for constructing and operating a comprehensive data asset management system.

Data Governancedata catalogdata quality
0 likes · 5 min read
How to Build an Effective Data Asset Management Framework for Enterprises
HomeTech
HomeTech
Nov 15, 2023 · Industry Insights

How to Build Accurate Data Asset Lineage for Data Warehouse Governance

This article explains the challenges of data asset lineage in large data warehouses, presents a comprehensive approach using business‑level instrumentation, SQL interceptor plugins, and ETL script parsing to generate fine‑grained lineage graphs, and demonstrates measurable improvements in coverage and zombie‑table cleanup.

Data GovernanceData WarehouseETL parsing
0 likes · 18 min read
How to Build Accurate Data Asset Lineage for Data Warehouse Governance
Data Thinking Notes
Data Thinking Notes
Nov 14, 2023 · Big Data

How Financial Institutions Master Data Governance for Digital Transformation

This article examines why data governance has become a critical pillar for Chinese financial institutions, outlining external regulations and internal business drivers, describing a comprehensive governance architecture, and presenting a detailed case study of a securities company's data‑asset inventory, platform implementation, and quality management.

Big DataData GovernanceFinancial Services
0 likes · 16 min read
How Financial Institutions Master Data Governance for Digital Transformation
Architects Research Society
Architects Research Society
Nov 14, 2023 · Fundamentals

MIKE2.0 Method: An Open‑Source Approach to Information Development

The MIKE2.0 method is an open‑source, integrated‑knowledge‑environment framework that guides enterprises through information development, data governance, and architecture via five structured phases, key structures such as SAFE, and practical task outputs, while also offering community resources and implementation guidance.

Data GovernanceInformation DevelopmentMIKE2.0
0 likes · 7 min read
MIKE2.0 Method: An Open‑Source Approach to Information Development
DataFunSummit
DataFunSummit
Nov 10, 2023 · Operations

Data Model Governance Practices at Taobao (Tao Tian Group)

This article presents a comprehensive overview of Taobao's data model governance, covering background challenges, a four‑pillar solution framework, detailed practices such as invalid table decommissioning, source‑table consolidation, data handover, public‑layer operations, incremental control, productization, and future planning to improve efficiency, cost, and quality of large‑scale data models.

Data GovernanceMetadatamodel governance
0 likes · 26 min read
Data Model Governance Practices at Taobao (Tao Tian Group)
Data Thinking Notes
Data Thinking Notes
Nov 9, 2023 · Big Data

How to Build a Scalable Data Governance System for Massive E‑Commerce Warehouses

This article outlines the challenges of ultra‑large e‑commerce data warehouses—such as SLA pressure, model instability, soaring resource costs, low governance efficiency, and fragmented processes—and presents a one‑stop, tiered data‑governance framework with stability, cost, and efficiency subsystems that drives distributed autonomous governance and measurable business value.

AutomationBig DataData Governance
0 likes · 11 min read
How to Build a Scalable Data Governance System for Massive E‑Commerce Warehouses
DataFunSummit
DataFunSummit
Nov 6, 2023 · Big Data

Building and Managing Huolala's User Event Tracking System: Architecture, Governance, and Monitoring

This article details Huolala's user event tracking (埋点) system, covering its background, challenges, the construction of a four‑module management platform, backend SDK design, monitoring and quality assurance mechanisms, and future plans for service integration, data lineage, and governance optimization.

Data GovernanceData PipelineMonitoring
0 likes · 16 min read
Building and Managing Huolala's User Event Tracking System: Architecture, Governance, and Monitoring
Data Thinking Notes
Data Thinking Notes
Nov 5, 2023 · Fundamentals

Why Poor Data Quality Costs Companies $15M Annually and How to Fix It

Low‑quality data can cost enterprises up to $15 million each year, making data quality management essential for accurate decision‑making, compliance, and operational efficiency, and this article explains its importance, evaluation dimensions, common issues, monitoring metrics, responsible roles, and a three‑phase management framework of prevention, control, and remediation.

Big DataBusiness IntelligenceData Governance
0 likes · 32 min read
Why Poor Data Quality Costs Companies $15M Annually and How to Fix It
ByteDance Data Platform
ByteDance Data Platform
Nov 1, 2023 · Big Data

How a Leading E‑Commerce Platform Solves EB‑Scale Data Governance Challenges

Facing massive data volumes and strict SLA requirements during the Double 11 shopping festival, a major e‑commerce platform built a systematic data‑governance framework that addresses quality, stability, cost, and efficiency through multi‑layered grading, digital cost models, automated tools, and full‑lifecycle management.

Big DataData GovernanceSLA management
0 likes · 23 min read
How a Leading E‑Commerce Platform Solves EB‑Scale Data Governance Challenges
Data Thinking Notes
Data Thinking Notes
Oct 31, 2023 · Information Security

Why Data Classification & Grading Is Critical for Enterprise Security

This article explains the legal and strategic importance of data classification and grading in China, outlines the relevant regulations, describes the principles and processes for implementing classification, and offers practical steps for enterprises to secure data while meeting compliance and business needs.

Data GovernanceEnterprise Compliancedata classification
0 likes · 11 min read
Why Data Classification & Grading Is Critical for Enterprise Security
DataFunTalk
DataFunTalk
Oct 28, 2023 · Big Data

Insights from the First Data Governance Forum: Challenges, Opportunities, and the Role of Large AI Models

The first Data Governance Forum in Shanghai highlighted the intertwined challenges of data quality, compliance, and integration, emphasized the mutual reinforcement between large AI models and data governance, and presented perspectives from industry, academia, and legal experts on how to advance data as a strategic production factor.

Data GovernanceData MarketRegulation
0 likes · 21 min read
Insights from the First Data Governance Forum: Challenges, Opportunities, and the Role of Large AI Models
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 23, 2023 · Big Data

Bilibili Data Quality Assurance: Architecture, Goals, Core Capabilities, and Future Outlook

This article outlines Bilibili's data quality assurance framework, detailing its evolution across four development stages, the current data platform architecture, identified pain points, four key quality objectives, core capabilities such as a quality data warehouse, comprehensive monitoring, digital optimization, fault handling, and future directions.

Big DataData GovernanceData Warehouse
0 likes · 22 min read
Bilibili Data Quality Assurance: Architecture, Goals, Core Capabilities, and Future Outlook
Data Thinking Notes
Data Thinking Notes
Oct 22, 2023 · Big Data

Boosting Big Data Governance Capabilities for Digital Transformation

This article outlines how enterprises can enhance their big data governance capabilities during digital transformation, covering the background and challenges of data governance, the emergence of data capability as a core competency with implementation paths, and practical suggestions for governance projects, illustrated with national-level examples.

Big DataData Governancedigital transformation
0 likes · 3 min read
Boosting Big Data Governance Capabilities for Digital Transformation
DataFunSummit
DataFunSummit
Oct 20, 2023 · Big Data

Tencent OLA t‑Metric Metric Platform: Headless BI Practices and Architecture

The article introduces Tencent's OLA data‑governance platform and its t‑Metric metric middle‑platform, explains the Headless BI concept, details the configuration‑driven metric production workflow, core capabilities, architecture, unified query service, ecosystem integration, and answers audience questions about real‑time analysis, dimension handling, and trust mechanisms.

Data GovernanceDataOpsHeadless BI
0 likes · 21 min read
Tencent OLA t‑Metric Metric Platform: Headless BI Practices and Architecture
dbaplus Community
dbaplus Community
Oct 14, 2023 · Big Data

What Is a Data Warehouse? From Basics to Modern Practices

This article explains what a data warehouse is, contrasts it with traditional databases, outlines the evolution from classic to internet‑scale warehouses, details modeling approaches and layered architectures, discusses KPI dictionaries, date dimensions, naming standards, data governance, incremental loading techniques, and upstream/downstream coordination.

Big DataData GovernanceData Modeling
0 likes · 25 min read
What Is a Data Warehouse? From Basics to Modern Practices
DataFunSummit
DataFunSummit
Oct 11, 2023 · Big Data

Tencent Oula Data Asset Suite: End‑to‑End Data Production and Governance Framework

The article presents Tencent Oula’s comprehensive data‑asset platform that integrates data collection, integration, warehouse and metric modeling, governance engines, and AI‑enabled analytics to reduce information entropy, standardize assets, and enable production‑as‑governance across the modern data stack.

AI for BIData GovernanceData Ops
0 likes · 21 min read
Tencent Oula Data Asset Suite: End‑to‑End Data Production and Governance Framework
DataFunTalk
DataFunTalk
Oct 7, 2023 · Big Data

Alibaba DataWorks Data Stability Governance: Challenges, Solutions, and Practices

This article presents Alibaba's experience in addressing large‑scale data stability challenges by outlining common problems, governance principles, baseline monitoring, team collaboration methods, practical implementations, and proactive measures to ensure reliable and accurate data production on the DataWorks platform.

AlibabaBig DataData Governance
0 likes · 12 min read
Alibaba DataWorks Data Stability Governance: Challenges, Solutions, and Practices
iQIYI Technical Product Team
iQIYI Technical Product Team
Sep 22, 2023 · Big Data

Data Lake: Concepts, Architecture, and Application in iQIYI's Data Platform

iQIYI’s data‑middle‑platform team built a four‑zone data lake—raw, product, work, and sensitive—integrated with unified ODS/DWD/MID layers, a metadata catalog, and self‑service tools, leveraging HDFS, Hive/Iceberg, Spark/Trino, and Flink, migrated to Apache Iceberg for real‑time freshness, and now aims to further streamline modules and adopt new technologies.

Apache IcebergData GovernanceData Lake
0 likes · 13 min read
Data Lake: Concepts, Architecture, and Application in iQIYI's Data Platform
Data Thinking Notes
Data Thinking Notes
Sep 17, 2023 · Big Data

How to Overcome Data Fragmentation: A Practical Guide to Enterprise Data Governance

Large enterprises generate massive, diverse data across departments, leading to fragmented storage and trust issues, so this article outlines a comprehensive data governance implementation plan covering standards, metadata, quality, integration, asset, and security management to unify and secure enterprise data.

Big DataData Governancedata fragmentation
0 likes · 4 min read
How to Overcome Data Fragmentation: A Practical Guide to Enterprise Data Governance
DataFunSummit
DataFunSummit
Sep 14, 2023 · Big Data

Data Governance Practices for E‑commerce Platforms Using Volcano Engine DataLeap

The article presents Volcano Engine DataLeap's comprehensive data‑governance framework for e‑commerce platforms, covering challenges of large‑scale warehouses, a top‑level governance architecture, systematic stability, cost, and tool efficiency systems, and detailed implementation steps to achieve autonomous, distributed governance.

Data Governance
0 likes · 19 min read
Data Governance Practices for E‑commerce Platforms Using Volcano Engine DataLeap
DataFunTalk
DataFunTalk
Sep 13, 2023 · Big Data

Design and Implementation of a Lakehouse Data Platform Based on Apache Hudi at Taikang Life Insurance

This article details Taikang Life Insurance's end‑to‑end technical selection, architecture design, implementation, and custom enhancements of an Apache Hudi‑driven lakehouse platform for large‑scale health‑insurance data, covering background, component evaluation, performance benchmarking, multi‑layer architecture, and real‑world results.

Apache HudiBig DataData Governance
0 likes · 44 min read
Design and Implementation of a Lakehouse Data Platform Based on Apache Hudi at Taikang Life Insurance
DataFunTalk
DataFunTalk
Sep 12, 2023 · Big Data

Building an Intelligent Data Governance Platform at NetEase Cloud Music: Architecture, Practices, and Future Plans

This article presents a comprehensive case study of NetEase Cloud Music’s metadata‑driven intelligent governance platform, detailing its scale, construction background, modular architecture, rule‑based automation, practical deployment, and future roadmap for sustainable data ecosystem management.

AutomationBig DataData Governance
0 likes · 22 min read
Building an Intelligent Data Governance Platform at NetEase Cloud Music: Architecture, Practices, and Future Plans
DataFunTalk
DataFunTalk
Sep 10, 2023 · Big Data

Ping An Life Insurance’s Data Middle Platform Construction Practice

The presentation details Ping An Life’s four‑stage data middle‑platform initiative—defining data capability as the foundation of digital transformation, outlining the platform’s architecture and governance, showcasing business‑value applications, and discussing talent and cultural considerations—to illustrate how a large insurer builds a scalable, real‑time data ecosystem.

Big DataData GovernanceInsurance
0 likes · 9 min read
Ping An Life Insurance’s Data Middle Platform Construction Practice
Data Thinking Notes
Data Thinking Notes
Sep 3, 2023 · Big Data

How to Build an Effective Data Governance Framework: Steps & Best Practices

This article outlines a comprehensive data governance framework for Chinese enterprises, covering organizational structures, data asset inventory, six‑stage methodology, and the creation of unified data standards and quality rules to support effective digital transformation and data‑driven decision making.

Big DataData GovernanceData Management
0 likes · 13 min read
How to Build an Effective Data Governance Framework: Steps & Best Practices
Data Thinking Notes
Data Thinking Notes
Aug 30, 2023 · Fundamentals

Mastering Data Governance: A Complete Guide to Metadata, Standards, Quality, and Security

Data governance encompasses a comprehensive framework—including metadata, master data, standards, quality, assets, exchange, security, and lifecycle management—to ensure data’s accuracy, consistency, and value across an organization, offering step‑by‑step guidance, best‑practice models, and visual references for effective implementation.

Data Governancedata lifecycledata quality
0 likes · 19 min read
Mastering Data Governance: A Complete Guide to Metadata, Standards, Quality, and Security
ByteDance Data Platform
ByteDance Data Platform
Aug 30, 2023 · Big Data

How We Cut Offline Data Warehouse SLA Delay from 13 Days to Zero with DataLeap

The article details how the "Xingfu Li" real‑estate platform tackled a 13‑day offline data‑warehouse SLA delay by adopting Volcano Engine's DataLeap suite, outlining the challenges, the three‑step governance process, and the measurable improvements achieved across task coverage, alert reduction, and data stability.

Big DataData GovernanceData Warehouse
0 likes · 10 min read
How We Cut Offline Data Warehouse SLA Delay from 13 Days to Zero with DataLeap
Data Thinking Notes
Data Thinking Notes
Aug 23, 2023 · Fundamentals

Mastering Data Metrics and Tags: Build Powerful Indicator Systems

This article provides a comprehensive guide to data metrics and tags, explaining their definitions, classifications, conversion methods, practical usage scenarios, and step‑by‑step approaches for building robust metric and tag systems that support strategic decision‑making and operational efficiency.

Data GovernanceData MetricsIndicator System
0 likes · 10 min read
Mastering Data Metrics and Tags: Build Powerful Indicator Systems
Big Data Technology & Architecture
Big Data Technology & Architecture
Aug 22, 2023 · Big Data

DataOps Practices and Challenges at ByteDance: From Model to Productization

The article summarizes ByteDance's DataOps journey, detailing its mid‑platform tool and Data BP model, core performance metrics, quality, hardware and human efficiency challenges, concrete DataOps implementation, productization through DataLeap, best‑practice promotion, and future outlook for data‑driven business value.

Big DataByteDanceData Governance
0 likes · 17 min read
DataOps Practices and Challenges at ByteDance: From Model to Productization
DataFunSummit
DataFunSummit
Aug 21, 2023 · Big Data

Data-Driven Data Governance and Asset Health Scoring at Xiaomi

This article presents Xiaomi's data‑driven governance framework, detailing a three‑level "rocket" plan, the asset health scoring model covering storage, compute, quality, security and compliance, productization efforts, future enhancements, and a Q&A session on implementation challenges.

Data Governanceasset healthdata security
0 likes · 13 min read
Data-Driven Data Governance and Asset Health Scoring at Xiaomi
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
Aug 18, 2023 · Big Data

How Lakehouse Architecture is Transforming Hadoop: A Deep Dive into Hudi, Iceberg, and Delta Lake

This article analyzes the rise of lake‑house architecture in the Hadoop ecosystem, compares the technical capabilities of Hudi, Iceberg and Delta Lake, details implementation enhancements such as MOR and multi‑writer support, showcases Flink integration, presents a real‑time marketing use case, and outlines future development directions.

Big DataData GovernanceDelta Lake
0 likes · 14 min read
How Lakehouse Architecture is Transforming Hadoop: A Deep Dive into Hudi, Iceberg, and Delta Lake
21CTO
21CTO
Aug 16, 2023 · Big Data

6 Must-Have Snowflake Tools to Supercharge Your Data Workflow

This guide reviews six popular Snowflake‑compatible tools—covering data preparation, visualization, integration/ETL, business intelligence, and governance—that can dramatically boost productivity for data professionals.

Business IntelligenceData GovernanceData Preparation
0 likes · 11 min read
6 Must-Have Snowflake Tools to Supercharge Your Data Workflow
Data Thinking Notes
Data Thinking Notes
Aug 13, 2023 · Big Data

How to Successfully Deliver a Data Governance Project: Step‑by‑Step Guide

This article outlines a comprehensive methodology for delivering a data governance project, covering planning, blueprint design, implementation, and acceptance phases, with detailed guidance on team formation, stakeholder roles, requirement analysis, platform architecture, management processes, and post‑deployment operations.

Big DataData GovernanceProject Management
0 likes · 12 min read
How to Successfully Deliver a Data Governance Project: Step‑by‑Step Guide
Architects Research Society
Architects Research Society
Aug 5, 2023 · Big Data

Getting Started with Data Mesh: A Quick‑Start Guide

This guide introduces the concept of a data mesh, explains why modern data‑driven organizations need domain‑driven self‑serve design, outlines its three core principles, and provides a curated reading list to help teams transition from monolithic data lakes to distributed, observable data products.

Data GovernanceDomain‑Driven Designdistributed systems
0 likes · 10 min read
Getting Started with Data Mesh: A Quick‑Start Guide
Data Thinking Notes
Data Thinking Notes
Aug 2, 2023 · Fundamentals

Mastering Enterprise Data: A Practical Guide to Master Data Management

This article explains why fragmented data hampers business insight in large enterprises and provides a comprehensive overview of master data concepts, governance structures, standards, processes, and step‑by‑step implementation practices to achieve consistent, high‑quality enterprise data.

Data GovernanceData IntegrationMDM
0 likes · 18 min read
Mastering Enterprise Data: A Practical Guide to Master Data Management
Weimob Technology Center
Weimob Technology Center
Aug 1, 2023 · Big Data

How Weimeng Transformed Data Asset Governance: A Practical Blueprint for Enterprises

Facing fragmented metadata, unclear ownership, and costly data duplication, Weimeng implemented a comprehensive data asset governance framework—covering metadata standards, lineage visualization, metric normalization, and cost management—to boost data quality, security, and business value across its new‑retail platform.

Data Governancedata lineagedata operations
0 likes · 15 min read
How Weimeng Transformed Data Asset Governance: A Practical Blueprint for Enterprises
Data Thinking Notes
Data Thinking Notes
Jul 26, 2023 · Big Data

How to Build an Effective Data Asset Catalog for Enterprise Data Governance

This article explains what data assets are, why a data asset catalog is essential for data governance, and provides a step‑by‑step framework—including identification criteria, value dimensions, construction phases, tool support, and core functional modules—to help enterprises systematically create, manage, and leverage a data asset catalog.

Data AssetData Governancedata catalog
0 likes · 16 min read
How to Build an Effective Data Asset Catalog for Enterprise Data Governance
DataFunSummit
DataFunSummit
Jul 15, 2023 · Big Data

Intelligent and Automated Data Quality Management in Big Data Systems

This article explores the challenges of data quality in mature big‑data environments and presents intelligent, automated approaches—including assertions, automatic detection, rule recommendation, link checking, and collaborative mechanisms—to embed quality checks throughout the data pipeline, improving efficiency and reliability.

AutomationData GovernanceData Observability
0 likes · 18 min read
Intelligent and Automated Data Quality Management in Big Data Systems
Data Thinking Notes
Data Thinking Notes
Jul 12, 2023 · Fundamentals

Why Metadata Governance Is the Backbone of Modern Data Platforms

This article explains how metadata serves as essential infrastructure for data platforms, detailing Huawei's classification framework, governance challenges, management architecture, integrated modeling, data lake handling, service management, and data map construction to bridge business and IT domains.

Data GovernanceData LakeData Management
0 likes · 24 min read
Why Metadata Governance Is the Backbone of Modern Data Platforms
AntTech
AntTech
Jul 6, 2023 · Industry Insights

Unlocking AI Value: Data Quality, Privacy, and Blockchain in the Smart Era

The article examines how high‑quality data, robust privacy protection, and blockchain‑enabled trust infrastructure are essential for unlocking the value of AI models, citing market forecasts, examples from smart‑car and fintech firms, and the growing Chinese big‑data market through 2026.

AIBig DataBlockchain
0 likes · 9 min read
Unlocking AI Value: Data Quality, Privacy, and Blockchain in the Smart Era
Data Thinking Notes
Data Thinking Notes
Jul 5, 2023 · Big Data

Top 10 Big Data Trends Shaping China’s Data Industry in 2023

At the 2023 Big Data Industry Development Conference in Beijing, the China Communications Standards Association unveiled the top ten big‑data keywords, highlighting trends such as lake‑warehouse integration, data assetization, DataOps, intelligent analytics, data ethics, security, public data licensing, and cross‑border data flows.

Big DataData EthicsData Governance
0 likes · 16 min read
Top 10 Big Data Trends Shaping China’s Data Industry in 2023
Data Thinking Notes
Data Thinking Notes
Jul 2, 2023 · Big Data

Mastering Data Governance: A Comprehensive Framework for Enterprise Success

This article outlines a complete data governance framework, detailing the five managerial domains—control, process, governance, technology, and value—along with strategies for data strategy, organizational structure, policies, processes, standards, quality, security, and platform tools, and highlights AI’s pivotal role in enhancing governance efficiency.

Big DataData Governancedata quality
0 likes · 10 min read
Mastering Data Governance: A Comprehensive Framework for Enterprise Success
DataFunTalk
DataFunTalk
Jul 2, 2023 · Big Data

Bilibili Data Service Middle Platform: Architecture, Practices, and Future Roadmap

This article presents Bilibili's data service middle platform, detailing its background, one‑stop data service architecture, core processes, model and API construction, query mechanisms, full‑link control, cost‑reduction, high‑availability strategies, achieved results, and future roadmap.

Big DataData GovernanceData Service
0 likes · 18 min read
Bilibili Data Service Middle Platform: Architecture, Practices, and Future Roadmap
DataFunSummit
DataFunSummit
Jun 29, 2023 · Big Data

iQIYI Data Link Governance: Offline and Real‑time Pipeline Management and Exploration

This article presents iQIYI’s comprehensive data link governance practice, covering the motivations, offline and real‑time pipeline governance strategies, monitoring mechanisms, data lineage, and exploratory work such as intelligent attribution and field‑level lineage to improve data accuracy, timeliness, and reliability.

Data Governancedata lineageiQIYI
0 likes · 11 min read
iQIYI Data Link Governance: Offline and Real‑time Pipeline Management and Exploration
DataFunTalk
DataFunTalk
Jun 14, 2023 · Big Data

Active Data Governance with Operator-Level Lineage: Practices and Exploration

This article presents Big Data company's active data governance practice using operator-level lineage, detailing the shortcomings of traditional lineage, the implementation of indicator chain governance, and the exploration of proactive model governance to achieve smarter, more precise data management.

Big DataData GovernanceData Warehouse
0 likes · 14 min read
Active Data Governance with Operator-Level Lineage: Practices and Exploration
Data Thinking Notes
Data Thinking Notes
Jun 11, 2023 · Product Management

How to Score Data Tags for Better Governance and Resource Optimization

This article explains why tag scoring is essential for data governance, outlines a five‑dimensional scoring model—including usage, attention, quality, continuous optimization, and security—and demonstrates how the scores can drive dashboards, alerts, and resource‑saving decisions.

Data GovernanceResource Optimizationmetrics
0 likes · 9 min read
How to Score Data Tags for Better Governance and Resource Optimization
Huolala Safety Emergency Response Center
Huolala Safety Emergency Response Center
Jun 9, 2023 · Information Security

How Huolala Built a Robust Big Data Security Framework: Lessons & Practices

This article presents a detailed case study of Huolala's big data security architecture, covering background challenges, lifecycle‑wide protection standards, data classification, encryption, disaster recovery, governance processes, and future improvement plans to enhance data asset protection and compliance.

Data GovernanceHuolalasecurity architecture
0 likes · 10 min read
How Huolala Built a Robust Big Data Security Framework: Lessons & Practices
Huolala Tech
Huolala Tech
Jun 8, 2023 · Big Data

How Huolala Built a Robust Big Data Security Framework: Lessons and Practices

This article details Huolala's practical experience in constructing a comprehensive big data security system, covering data lifecycle protection, classification standards, capability development, and governance, while balancing regulatory compliance and business growth.

Big DataCloud InfrastructureData Governance
0 likes · 10 min read
How Huolala Built a Robust Big Data Security Framework: Lessons and Practices
Data Thinking Notes
Data Thinking Notes
Jun 4, 2023 · Big Data

How Distributed Lakehouse Architecture Solves Data Swamp Challenges

This article examines the explosion of heterogeneous data sources, the limitations of traditional data lakes and warehouses, and proposes a distributed lakehouse architecture that integrates advanced management layers to improve data governance, reliability, and support both SQL and advanced analytics workloads.

Data GovernanceData LakeData Warehouse
0 likes · 29 min read
How Distributed Lakehouse Architecture Solves Data Swamp Challenges
Ziru Technology
Ziru Technology
Jun 2, 2023 · Information Security

Mastering Data Classification & Grading: Ziroom’s Compliance Blueprint

This article explains how Ziroom implements a comprehensive data classification and grading system to meet the 2021 Data Security Law, improve risk management, optimize security resources, and boost user trust through automated tools, multi‑level categorization, and continuous manual verification.

Data Governancecompliancedata classification
0 likes · 12 min read
Mastering Data Classification & Grading: Ziroom’s Compliance Blueprint