BestHub
Sign in
Tagged articles

data governance

767 articles · Page 6 of 8
Bilibili Tech
Bilibili Tech
Apr 11, 2023 · Big Data

Bilibili Big Data Governance: From Reactive Storage Management to Proactive Multi‑Dimensional Governance

Bilibili’s exabyte‑scale big‑data platform, after rapid growth created fragmented ownership and costly storage, launched the Wanglou project to build a metadata‑driven, indicator‑based governance framework that cut storage use by half, introduced compliance scoring and automation, and now plans to extend proactive, multi‑dimensional governance to compute, traffic and lake‑house resources.

Bilibilidata governancestorage optimization
0 likes · 21 min read
Bilibili Big Data Governance: From Reactive Storage Management to Proactive Multi‑Dimensional Governance
Data Thinking Notes
Data Thinking Notes
Apr 9, 2023 · Big Data

Why Data Quality Is the Hidden Driver of Big Data Success

In the big‑data era, high‑quality data are essential for reliable analytics, and this article explains data‑quality concepts, key dimensions, analysis methods for missing values, outliers, inconsistencies and duplicates, as well as practical management practices to ensure data assets become a competitive advantage.

Data AnalysisData QualityETL
0 likes · 15 min read
Why Data Quality Is the Hidden Driver of Big Data Success
DataFunSummit
DataFunSummit
Apr 8, 2023 · Big Data

DataCake: A Multi‑Cloud Self‑Service Big Data Platform from SHAREit Group

The article introduces DataCake, a cloud‑native, multi‑cloud big data platform built by SHAREit Group that addresses massive data volume, diverse application scenarios, and governance challenges through a Data Mesh‑inspired self‑service architecture, offering unified data management, intelligent governance, and a roadmap for future enhancements.

Data MeshMulti-CloudSelf-Service Platform
0 likes · 10 min read
DataCake: A Multi‑Cloud Self‑Service Big Data Platform from SHAREit Group
Data Thinking Notes
Data Thinking Notes
Apr 5, 2023 · Big Data

Mastering Data Governance: From Challenges to End‑to‑End Solutions

This article explores the key problems data governance aims to solve, outlines a comprehensive governance framework, and details practical implementation steps—including tool integration, metadata management, lake‑in and lake‑out processes, and governance policies—to achieve a closed‑loop, value‑driven data ecosystem.

Data LakeData QualityEnterprise Data
0 likes · 13 min read
Mastering Data Governance: From Challenges to End‑to‑End Solutions
Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 3, 2023 · Databases

SQL Quality Management with Open-Source SQLE: Insights from the 2023 DAMS China Data Intelligence Management Summit

The 2023 DAMS China Data Intelligence Management Summit in Shanghai featured a technical presentation by Zhang Shenbo on an open‑source SQLE solution for SQL quality control, covering multi‑database auditing, automated review workflows, and practical tips to reduce DBA workload and cross‑department communication.

Data QualityDatabase ManagementSQL
0 likes · 3 min read
SQL Quality Management with Open-Source SQLE: Insights from the 2023 DAMS China Data Intelligence Management Summit
Data Thinking Notes
Data Thinking Notes
Apr 2, 2023 · Fundamentals

Transforming Bank Data: A Practical Guide to Data Governance and Quality Management

This article explains how modern commercial banks can turn massive operational data into a strategic asset by building a comprehensive data governance framework that addresses data standards, quality management, metadata, master data, and security, while outlining a six‑step methodology for continuous improvement.

Data Qualitybankingdata governance
0 likes · 18 min read
Transforming Bank Data: A Practical Guide to Data Governance and Quality Management
Efficient Ops
Efficient Ops
Mar 30, 2023 · Cloud Computing

How China Merchants Bank Completed Full Cloud Migration and Cut Costs

China Merchants Bank became the first among China's top system‑important banks to fully migrate all debit, credit, corporate accounts and applications to the cloud, detailing the multi‑year effort, architectural overhaul, cost savings, and the strategic shift toward open, distributed systems.

Cloud Computingbanking digital transformationcost efficiency
0 likes · 10 min read
How China Merchants Bank Completed Full Cloud Migration and Cut Costs
Data Thinking Notes
Data Thinking Notes
Mar 26, 2023 · Big Data

Why Data Governance Is the Key to Unlocking Your Data’s True Value

This article explains how effective data governance transforms raw data into a trusted enterprise asset, outlines common pitfalls such as backward and passive governance, and presents a structured, four‑phase approach—including organizational setup, standards, platform selection, and continuous operations—to successfully implement data governance at scale.

Data QualityEnterprise Databig data
0 likes · 10 min read
Why Data Governance Is the Key to Unlocking Your Data’s True Value
Volcano Engine Developer Services
Volcano Engine Developer Services
Mar 22, 2023 · Fundamentals

How ByteDance Scales Data Governance: Challenges, Distributed Solutions, and Best Practices

This article examines ByteDance's data governance journey, outlining business, organizational, and cultural challenges, the six-stage evolution framework, real‑world case studies, and the shift from centralized to distributed autonomous governance to improve quality, security, cost, and team efficiency.

Data QualityDistributed ArchitecturePlatform
0 likes · 18 min read
How ByteDance Scales Data Governance: Challenges, Distributed Solutions, and Best Practices
Data Thinking Notes
Data Thinking Notes
Mar 19, 2023 · Big Data

Why Data Quality Is the Key to Successful Big Data Initiatives

The article explains that while big data aims to boost organizational insight and innovation, its true value depends on high data quality, outlines industry standards, identifies technical, business, and management causes of poor quality, and proposes a three‑phase strategy of prevention, monitoring, and post‑improvement to ensure reliable data for decision‑making.

Data QualityQuality Managementbig data
0 likes · 21 min read
Why Data Quality Is the Key to Successful Big Data Initiatives
Airbnb Technology Team
Airbnb Technology Team
Mar 17, 2023 · Information Security

Airbnb Data Privacy and Security Engineering: Automated Data Protection Service Overview

Airbnb’s Data Protection Service unifies privacy and security metadata, offering APIs that automate annotation verification, export and IDL validation, data‑subject‑rights orchestration, and secret‑leak detection, while assigning ownership, minimizing manual effort, and ensuring global, consistent compliance across the platform.

AirbnbCI checksSecurity Engineering
0 likes · 13 min read
Airbnb Data Privacy and Security Engineering: Automated Data Protection Service Overview
Data Thinking Notes
Data Thinking Notes
Mar 14, 2023 · Fundamentals

Practical Data Governance Guide for SMEs: Strategies, Steps, and Tools

This article explains why data governance matters for small‑to‑medium enterprises, outlines its four key values, describes essential governance components, and provides a step‑by‑step framework—including timing, roles, standards, execution mechanisms, tools, and common pitfalls—to help organizations implement effective data governance.

Performance MonitoringSMEStandardization
0 likes · 16 min read
Practical Data Governance Guide for SMEs: Strategies, Steps, and Tools
Data Thinking Notes
Data Thinking Notes
Mar 12, 2023 · Big Data

Why Data Middle Platforms Are Evolving: New Trends in Data Governance and DataOps

The article examines how China's data middle platform concept is reshaping enterprise data strategy, highlighting a shift toward value‑driven adoption, the intertwined relationship with data governance, and emerging trends such as fine‑grained business governance, full‑link monitoring, integrated platforms, and DataOps.

DataOpsEnterprise Databig data
0 likes · 9 min read
Why Data Middle Platforms Are Evolving: New Trends in Data Governance and DataOps
ITPUB
ITPUB
Mar 10, 2023 · Databases

How ICBC Secures MySQL at Scale: Insights from a Senior Database Architect

In this interview, ICBC senior manager Wei Yadong shares the bank's challenges with massive data, the five‑point criteria for database selection, the DevOps‑driven MySQL governance framework, evolving security demands, future database trends for finance, and practical advice for database professionals.

Database ManagementDevOpsFinancial Industry
0 likes · 16 min read
How ICBC Secures MySQL at Scale: Insights from a Senior Database Architect
Data Thinking Notes
Data Thinking Notes
Mar 8, 2023 · Fundamentals

How BI Portals Transform Enterprise Data Governance for Scalable Analytics

This whitepaper explains why effective BI governance is essential for modern enterprises, outlines the key capabilities of data‑governance tools—including data quality, certification, usage statistics, classification, lineage, glossary, and lifecycle management—and shows how BI portals and data catalogs together enable scalable, user‑centric analytics.

AnalyticsBI governanceBI portal
0 likes · 12 min read
How BI Portals Transform Enterprise Data Governance for Scalable Analytics
Architects Research Society
Architects Research Society
Mar 8, 2023 · Big Data

Understanding DataOps: Principles, Benefits, and Implementation

DataOps, rooted in agile and DevOps philosophies, uses automation and collaborative practices to streamline data processing, improve quality, and align analytics with business goals, offering continuous analytics, faster insights, and breaking data silos for better decision‑making across organizations.

Continuous AnalyticsDataOpsDevOps
0 likes · 10 min read
Understanding DataOps: Principles, Benefits, and Implementation
DataFunTalk
DataFunTalk
Mar 8, 2023 · Artificial Intelligence

Applying AI Algorithms to Big Data Governance: Use Cases and Future Directions

This article presents Datacake's experience of integrating AI algorithms into big data governance, covering the bidirectional relationship between AI and big data, health‑score assessment of data tasks, intelligent Spark parameter tuning, SQL engine selection, and future application scenarios across the data lifecycle.

AISQLSpark
0 likes · 18 min read
Applying AI Algorithms to Big Data Governance: Use Cases and Future Directions
Baidu Geek Talk
Baidu Geek Talk
Mar 6, 2023 · Big Data

Accelerating Data Production and Consumption in Baidu's Performance Platform

Baidu's Performance Platform speeds data production and consumption by adopting a unified stream‑batch architecture with TM and Spark, leveraging the Turing warehouse, introducing tiered service grading, robust governance and compliance measures, and offering self‑service analytics, cutting latency from minutes or days to milliseconds while handling billions of daily records and boosting SLA adherence, data accuracy, and user satisfaction.

big datadata engineeringdata governance
0 likes · 12 min read
Accelerating Data Production and Consumption in Baidu's Performance Platform
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 3, 2023 · Fundamentals

Understanding Data Management Principles and Governance: Insights from DMBOK

This article explains the core principles, strategies, frameworks, and governance practices of data management based on DAMA's DMBOK, covering data lifecycle, value, leadership responsibilities, strategic planning, governance models, metrics, and implementation guidelines to help organizations derive business value from high‑quality data.

DMBOKData Qualitybusiness value
0 likes · 17 min read
Understanding Data Management Principles and Governance: Insights from DMBOK
DataFunTalk
DataFunTalk
Mar 2, 2023 · Information Security

Data Security Governance Practices at Zhongyuan Bank: Framework, Management System, Technical Architecture, and Future Planning

The article details Zhongyuan Bank's comprehensive data security governance, covering the regulatory background, protection objectives, classification of data assets, organizational and procedural management mechanisms, technical safeguards across the data lifecycle, and future planning to enhance compliance and risk mitigation in the banking sector.

bankingcompliancedata governance
0 likes · 30 min read
Data Security Governance Practices at Zhongyuan Bank: Framework, Management System, Technical Architecture, and Future Planning
DataFunTalk
DataFunTalk
Feb 27, 2023 · Big Data

Comprehensive Overview of Data Middle Platform Architecture and Its Core Frameworks

This article provides a detailed overview of data middle platform concepts, describing a decoupled six‑subsystem architecture—including storage, collection, processing, governance, security, and operation frameworks—while illustrating typical enterprise implementations, industry‑specific solutions, and best‑practice considerations for building scalable, secure, and value‑driven data platforms.

Data Integrationbig datadata governance
0 likes · 25 min read
Comprehensive Overview of Data Middle Platform Architecture and Its Core Frameworks
DataFunTalk
DataFunTalk
Feb 26, 2023 · Big Data

Design, Optimization, and Use Cases of Data Lineage in ByteDance's DataLeap Platform

This article presents an in‑depth overview of DataLeap's data lineage capabilities, covering the challenges, multi‑layer model design, implementation with Apache Atlas and JanusGraph, performance optimizations, diverse use cases across asset, development, governance and security domains, and future trends for lineage technology.

Apache Atlasbig datadata governance
0 likes · 19 min read
Design, Optimization, and Use Cases of Data Lineage in ByteDance's DataLeap Platform
DataFunSummit
DataFunSummit
Feb 21, 2023 · Artificial Intelligence

Practices and Reflections on Building an AI Platform at Zhongyuan Bank

This article details Zhongyuan Bank's AI platform construction, covering its objectives, MLOps-driven design, core modules such as data ingestion, processing, model development, training, evaluation, deployment, monitoring, as well as resource orchestration with Kubernetes and Docker, and the accompanying ModelOps governance framework.

AICloud ComputingMLOps
0 likes · 22 min read
Practices and Reflections on Building an AI Platform at Zhongyuan Bank
StarRocks
StarRocks
Feb 21, 2023 · Databases

How Yidian Tianxia Built a Unified Real‑Time & Offline Data Warehouse with StarRocks

Yidian Tianxia tackled massive daily data volumes and complex analytics by defining a five‑layer data‑warehouse standard, comparing ClickHouse and StarRocks performance, and implementing a unified real‑time/offline architecture with StarRocks, DataPlus, and EasyJob, achieving multi‑fold query speedups and lower operational costs.

ClickHouseReal-time AnalyticsStarRocks
0 likes · 14 min read
How Yidian Tianxia Built a Unified Real‑Time & Offline Data Warehouse with StarRocks
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Feb 20, 2023 · Big Data

How Alibaba’s DataWorks Transforms Data Governance for Efficiency, Security, and Cost Savings

This article explores Alibaba's DataWorks platform and its comprehensive data governance practices, covering application efficiency, security controls, cost optimization, organizational structure, and cultural initiatives that together enable scalable, secure, and cost‑effective data management across the enterprise.

Cost OptimizationDataWorksSecurity
0 likes · 31 min read
How Alibaba’s DataWorks Transforms Data Governance for Efficiency, Security, and Cost Savings
DataFunTalk
DataFunTalk
Feb 18, 2023 · Big Data

Xiaomi Data Governance Evolution: Cost Governance Practices for HDFS and HBase

The article outlines Xiaomi's data governance journey, focusing on storage‑service cost governance, describing the transition from simple cost‑centered governance to big‑data‑driven asset management, and detailing concrete HDFS and HBase practices that achieved significant resource and cost reductions.

HBaseHDFSStorage
0 likes · 15 min read
Xiaomi Data Governance Evolution: Cost Governance Practices for HDFS and HBase
DataFunSummit
DataFunSummit
Feb 17, 2023 · Big Data

Data Governance Practices and Platform Construction with Alibaba DataWorks

Alibaba’s DataWorks team shares extensive experiences in building and operating a large‑scale data platform, covering data governance across stages—from data stability and quality to security, cost control, and organizational culture—illustrating how systematic practices and tools drive efficiency, reliability, and value for enterprises.

Cost Optimizationbig datadata governance
0 likes · 55 min read
Data Governance Practices and Platform Construction with Alibaba DataWorks
Data Thinking Notes
Data Thinking Notes
Feb 14, 2023 · Big Data

How Cloud Music Turned 60k Tables into Valuable Data Assets

This article details Cloud Music's year‑long data assetization journey, covering the background, practical achievements, governance methods, and future roadmap for turning massive data warehouses into high‑value, well‑governed assets that drive cost reduction and business insight.

big datadata assetizationdata governance
0 likes · 10 min read
How Cloud Music Turned 60k Tables into Valuable Data Assets
Data Thinking Notes
Data Thinking Notes
Feb 9, 2023 · Fundamentals

Why Data Standards Are the Key to Unlocking Business Value

This article explains how data standards form the foundation of data governance, clarifies data assets, breaks silos, accelerates data flow, and outlines their definitions, benefits, common challenges, essential components, and best practices for effective implementation.

Best Practicesdata governancedata management
0 likes · 14 min read
Why Data Standards Are the Key to Unlocking Business Value
DataFunSummit
DataFunSummit
Feb 8, 2023 · Product Management

Content‑Driven Data Product Management: Challenges, Governance Frameworks, and Implementation Strategies

This article shares practical insights from a data product expert on the problems faced by content‑oriented data products, outlines a comprehensive governance methodology—including DAMA, Huawei, and Alibaba frameworks—and demonstrates how to operationalize these ideas through concrete examples such as event‑tracking and metric governance.

Data Product Managementbig datadata governance
0 likes · 16 min read
Content‑Driven Data Product Management: Challenges, Governance Frameworks, and Implementation Strategies
Youzan Coder
Youzan Coder
Feb 7, 2023 · Big Data

Automated Offline Data Cost Optimization in Youzan's Data Platform

Youzan built an automated offline data cost‑optimization platform that gathers accurate metadata, mines unused or failing tables and tasks, and safely decommissions them through a backend‑frontend workflow with owner validation, notifications, rollback safeguards, and plans to extend lineage coverage and real‑time asset handling.

automated decommissionbig datacost reduction
0 likes · 11 min read
Automated Offline Data Cost Optimization in Youzan's Data Platform
Data Thinking Notes
Data Thinking Notes
Feb 6, 2023 · Big Data

How Tencent Tackles Data Governance Challenges with the WeData Platform

This article outlines Tencent's data governance challenges, its internal three‑stage practice, detailed case studies such as Tencent News and PCG cost governance, and introduces the WeData platform's architecture and tools for standardization, quality, security, and metadata management, concluding with a Q&A session.

TencentWeDatabig data
0 likes · 17 min read
How Tencent Tackles Data Governance Challenges with the WeData Platform
Big Data Technology & Architecture
Big Data Technology & Architecture
Feb 4, 2023 · Big Data

Apache Linkis Graduates to Top-Level Project – Overview, Core Features, Roadmap, and Ecosystem

The article announces Apache Linkis’s graduation to an Apache top‑level project, explains its role as a computing middleware linking applications to engines like Spark, Hive, and Flink, details its core capabilities, roadmap, ecosystem integrations, and provides official resources for the community.

ApacheComputing MiddlewareLinkis
0 likes · 8 min read
Apache Linkis Graduates to Top-Level Project – Overview, Core Features, Roadmap, and Ecosystem
Data Thinking Notes
Data Thinking Notes
Feb 2, 2023 · Fundamentals

Why Metadata Management Is the Key to Unlocking Data Value

This article explains how effective metadata management provides context, improves data quality, enables data lineage tracing, supports governance, and ultimately turns raw data into valuable assets for enterprises navigating complex, evolving data environments.

Enterprise Datadata governancedata lineage
0 likes · 35 min read
Why Metadata Management Is the Key to Unlocking Data Value
Data Thinking Notes
Data Thinking Notes
Jan 31, 2023 · Fundamentals

Mastering Data Governance: From Metadata to ETL in One Guide

This comprehensive guide walks you through the entire data governance ecosystem, covering metadata fundamentals, classification, maturity models, data standards, modeling, integration, lifecycle management, quality assurance, security, and ETL processes, all illustrated with clear diagrams and practical steps.

Data IntegrationData ModelingData Quality
0 likes · 13 min read
Mastering Data Governance: From Metadata to ETL in One Guide
DataFunTalk
DataFunTalk
Jan 31, 2023 · Big Data

Tencent's Data Governance Practices and Technical Implementation

This article presents Tencent's comprehensive data governance framework, covering its definition, objectives, challenges, methodology, organizational structure, metadata management, data asset lifecycle, security measures, and technical implementation details such as microservice architecture, data collection, lineage analysis, and storage solutions.

Tencentbig datadata governance
0 likes · 19 min read
Tencent's Data Governance Practices and Technical Implementation
DataFunTalk
DataFunTalk
Jan 30, 2023 · Big Data

Data Governance Strategies: Principles, Practices, and Real‑World Case Studies

The article explains why data governance is essential for high‑quality data in big‑data organizations, outlines narrow and broad governance scopes, presents strategic principles, and shares eight detailed case studies from leading Chinese tech companies illustrating practical implementation and lessons learned.

big datadata governance
0 likes · 7 min read
Data Governance Strategies: Principles, Practices, and Real‑World Case Studies
Data Thinking Notes
Data Thinking Notes
Jan 29, 2023 · Big Data

How to Turn Data Assets into Business Value: A Roadmap for Enterprises

Enterprises must shift their perception of data assets and embed data‑value into every digital process, establishing governance, unified asset catalogs, operational metrics, security controls, integration, services, and visualization to transform raw data into strategic business outcomes.

Data Integrationbig datadata governance
0 likes · 12 min read
How to Turn Data Assets into Business Value: A Roadmap for Enterprises
DataFunSummit
DataFunSummit
Jan 27, 2023 · Big Data

Data Governance Strategies: Principles, Practices, and Case Studies

The article explains the importance of data governance, distinguishes narrow and broad governance, outlines strategic principles such as systemic engineering and prioritization, and presents eight case studies from leading Chinese tech companies illustrating practical implementations and effective strategies.

big datacase studydata governance
0 likes · 8 min read
Data Governance Strategies: Principles, Practices, and Case Studies
DataFunTalk
DataFunTalk
Jan 26, 2023 · Big Data

Tencent Data Governance Practices and the WeData Platform

This article outlines Tencent's data governance challenges, internal practices across three maturity stages, and introduces the WeData platform that provides comprehensive capabilities for data assetization, cost control, quality assurance, security, and metadata management to support large‑scale big‑data operations.

TencentWeDatabig data
0 likes · 15 min read
Tencent Data Governance Practices and the WeData Platform
DataFunTalk
DataFunTalk
Jan 26, 2023 · Big Data

Data Governance Strategies: Principles, Practices, and Real‑World Case Studies

This article explains why data is a company's most valuable asset, distinguishes narrow and broad data‑governance approaches, outlines strategic design principles, and presents eight detailed case studies from leading Chinese tech firms illustrating practical governance implementations and lessons learned.

big datadata governance
0 likes · 8 min read
Data Governance Strategies: Principles, Practices, and Real‑World Case Studies
DataFunSummit
DataFunSummit
Jan 21, 2023 · Big Data

Building and Evolving Data Management Systems: From IT to DT Era, Standards, Models, and Marketization

This article outlines the evolution of data management in the big‑data era, covering the history of the industry, key governance frameworks such as DMBOK, DCMM and DMM, the steps to construct a data‑management system, the requirements for a data‑factor market, and an introduction to the DataEasy company and its services.

DCMMDMBOKData Market
0 likes · 15 min read
Building and Evolving Data Management Systems: From IT to DT Era, Standards, Models, and Marketization
Huolala Tech
Huolala Tech
Jan 16, 2023 · Big Data

How Leading Logistics Companies Master Data Governance for Cost and Stability

At the 2022 DataFun Summit, data governance experts from Huolala, Zhongtong, and SF Express shared comprehensive practices—including governance drivers, quality monitoring, model management, master data processes, platform architecture, cost control, and stability measures—illustrating how large logistics firms implement end‑to‑end data governance to boost efficiency, compliance, and business value.

Cost ManagementData Qualitybig data
0 likes · 13 min read
How Leading Logistics Companies Master Data Governance for Cost and Stability
DataFunTalk
DataFunTalk
Jan 14, 2023 · Big Data

Lean Data Methodology: A Visual Guide to Data‑Driven Digital Transformation

Lean Data Methodology combines lean thinking, design thinking, the Cynefin framework, and agile principles to create a data‑driven digital transformation system that defines value, eliminates waste, and equips enterprises with strategic, product, governance, collaboration, platform, and cultural capabilities for building lean digital enterprises.

Lean Datadata governancedata platform
0 likes · 11 min read
Lean Data Methodology: A Visual Guide to Data‑Driven Digital Transformation
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jan 12, 2023 · Operations

What Is DataOps and How Can It Transform Your Data Management?

DataOps, the data‑centric counterpart of DevOps, combines agile principles, standardized tools, and cross‑team collaboration to manage the full data lifecycle—from integration and development to storage, governance, and service—enabling organizations to handle massive, diverse datasets efficiently, reduce silos, and turn data into actionable value.

Data IntegrationDataOpsbig data
0 likes · 15 min read
What Is DataOps and How Can It Transform Your Data Management?
DataFunSummit
DataFunSummit
Jan 9, 2023 · Big Data

JD Data‑Driven Business Development: Building a Business Metric Data System and Marketplace Governance

The article outlines JD's data‑driven business development strategy, describing the current challenges of its business data marketplace, the governance framework—including layered architecture, standardization, ClickHouse dictionary refresh, and optimization measures—and the resulting performance improvements and future outlook.

ClickHouseJD.combig data
0 likes · 13 min read
JD Data‑Driven Business Development: Building a Business Metric Data System and Marketplace Governance
DataFunTalk
DataFunTalk
Jan 8, 2023 · Big Data

ByteDance Event‑Tracking Data Cost Governance Practices

This article describes ByteDance's comprehensive approach to managing the massive volume of event‑tracking (埋点) data, detailing the background, cost‑reduction strategies, experience review, future plans, and a Q&A session that together illustrate how systematic data governance can dramatically cut storage and processing expenses.

ByteDancebig datadata cost optimization
0 likes · 18 min read
ByteDance Event‑Tracking Data Cost Governance Practices
DataFunSummit
DataFunSummit
Jan 4, 2023 · Big Data

Data Intelligence Expert Interview – Maturity, Trends, and Practices of Data Middle Platforms

The interview gathers insights from data‑platform experts on the maturity stages, technology trends, implementation methodologies, open‑source ecosystems, system architectures, governance, security, and assessment criteria of modern data middle platforms, offering a comprehensive guide for practitioners.

Data Observabilitybig datadata governance
0 likes · 28 min read
Data Intelligence Expert Interview – Maturity, Trends, and Practices of Data Middle Platforms
Meituan Technology Team
Meituan Technology Team
Dec 29, 2022 · Artificial Intelligence

Top 20 Most Popular Meituan Tech Blog Articles of 2022

Meituan’s technology team highlights its twenty most‑read 2022 blog posts, spanning observability, system design, data governance, AI, cloud‑native engineering, and practical innovations such as visual log tracing, Kafka scaling, functional programming, Elasticsearch optimization, CI/CD pipelines, and advanced object‑detection frameworks.

2022 HighlightsArtificial IntelligenceMeituan
0 likes · 13 min read
Top 20 Most Popular Meituan Tech Blog Articles of 2022
DataFunTalk
DataFunTalk
Dec 26, 2022 · Product Management

How Product and Business Teams Should Participate in Building Data Metric Systems

The article explains how product and business teams should collaborate with data teams to build and promote data metric systems, emphasizing mutual empowerment, joint methodology, pilot testing, and scaling, while also announcing DataFun's 5‑year anniversary activities and upcoming big‑data and AI publications.

AnalyticsBusiness CollaborationData Metrics
0 likes · 3 min read
How Product and Business Teams Should Participate in Building Data Metric Systems
DataFunSummit
DataFunSummit
Dec 24, 2022 · Operations

Understanding DataOps: Evolution, Technology Stacks, and Industry Applications

This article explores DataOps from its historical evolution through the digital 3.0 era, outlines its core technology stacks such as Data Fabric, Data Mesh, and Modern Data Stack, and demonstrates practical applications across finance, manufacturing, telecom, and public services, highlighting its role in agile, cloud‑native data management.

DataOpsbig datadata governance
0 likes · 18 min read
Understanding DataOps: Evolution, Technology Stacks, and Industry Applications
DataFunTalk
DataFunTalk
Dec 21, 2022 · Fundamentals

The Closed‑Loop Logic of Data Governance at Kuaikan Manhua

Kuaikan Manhua ensures continuous data governance by establishing a closed‑loop of business scope management, data asset standards, and feedback mechanisms that keep data pollution slower than governance speed, enabling systematic, long‑term data quality improvement.

Data Qualitybusiness scope managementclosed loop
0 likes · 6 min read
The Closed‑Loop Logic of Data Governance at Kuaikan Manhua
DataFunTalk
DataFunTalk
Dec 20, 2022 · Big Data

ByteDance's Practices for Tracking Data Governance and Pipeline Management

This article explains ByteDance's end‑to‑end tracking data lifecycle management, including pre‑report validation, the rationale for using BMQ over Kafka, quality governance examples, and how Flink‑based pipelines ensure data accuracy through SLA monitoring and checkpoint strategies.

FlinkMQdata governance
0 likes · 5 min read
ByteDance's Practices for Tracking Data Governance and Pipeline Management
Data Thinking Notes
Data Thinking Notes
Dec 19, 2022 · Big Data

Data Quality Mastery: From Expectations to Operational Assurance

This article outlines a comprehensive data quality management framework, covering expectations, measurement, assurance, and operational practices, and provides concrete templates, rule designs, and governance processes to help data teams systematically assess, monitor, and improve data reliability throughout the lifecycle.

Data OperationsData Qualitybig data
0 likes · 18 min read
Data Quality Mastery: From Expectations to Operational Assurance
iQIYI Technical Product Team
iQIYI Technical Product Team
Dec 16, 2022 · Databases

Database Mesh 2.0 and Pisanix: Cloud‑Native Database Governance at iQIYI

iQIYI adopts SphereEx’s Database Mesh 2.0 by extending ShardingSphere‑JDBC and integrating the cloud‑native Pisanix proxy, creating a unified, encrypted configuration center that enables dynamic sharding, load‑balancing, read‑write separation, hot‑updates and observability, dramatically simplifying database governance and cloud migration.

Database MeshMySQLPisanix
0 likes · 14 min read
Database Mesh 2.0 and Pisanix: Cloud‑Native Database Governance at iQIYI
DataFunSummit
DataFunSummit
Dec 13, 2022 · Big Data

Introducing the Star River Big Data Development Platform: Architecture, Core Capabilities, and Future Plans

This article presents an in‑depth overview of 58.com’s self‑built Star River big data platform, covering its evolution across three eras, resource management hierarchy, core technical capabilities such as metadata services, data maps and lineage, governance practices, and the roadmap for further enhancements.

architecturebig datadata governance
0 likes · 14 min read
Introducing the Star River Big Data Development Platform: Architecture, Core Capabilities, and Future Plans
DataFunTalk
DataFunTalk
Dec 12, 2022 · Big Data

Cloud‑Native and Intelligent Fusion: Key Trends Shaping the Future of Big Data

The article explains how cloud‑native architectures, data governance, intelligent fusion, and privacy computing are driving the evolution of big data, recounting the history from Google’s early papers and Hadoop to modern managed services, compute‑storage separation, AI‑powered recommendation platforms, and real‑world success cases.

Cloud Computingbig datacloud-native
0 likes · 10 min read
Cloud‑Native and Intelligent Fusion: Key Trends Shaping the Future of Big Data
DataFunSummit
DataFunSummit
Dec 7, 2022 · Big Data

Modern Data Governance at NetEase DataFan: Evolution, Challenges, and Solutions

This article details NetEase DataFan's journey in building a full‑stack big‑data platform, explains the design‑first data‑mid‑platform approach, analyzes cost, quality, and security problems encountered, and presents the modern data‑governance framework that integrates development, governance, and consumption into a closed loop.

Cost ManagementDataOpsbig data
0 likes · 22 min read
Modern Data Governance at NetEase DataFan: Evolution, Challenges, and Solutions
Data Thinking Notes
Data Thinking Notes
Dec 5, 2022 · Big Data

How NetEase Cloud Music Cut Storage Costs by 30% Through Data Governance

This article details NetEase Cloud Music's year‑long data governance initiative, covering data background, governance strategy, project plan, practical actions, results, and future outlook, and shows how metadata‑driven management reduced storage by over 30% while improving reliability and efficiency.

Cost OptimizationHadoopbig data
0 likes · 17 min read
How NetEase Cloud Music Cut Storage Costs by 30% Through Data Governance
Bilibili Tech
Bilibili Tech
Dec 2, 2022 · Big Data

Data Quality Management: Expectations, Measurement, Assurance, and Operation

The article outlines a complete data‑quality‑management framework that first captures business expectations, then translates them into basic and personalized measurement rules, defines four assurance approaches for handling violations, and scales operation with indicators, tooling, and metrics to continuously improve data quality across the lifecycle.

Data Qualitydata governancemetrics
0 likes · 19 min read
Data Quality Management: Expectations, Measurement, Assurance, and Operation
Data Thinking Notes
Data Thinking Notes
Nov 24, 2022 · Fundamentals

How to Build an Enterprise Data Governance System from Scratch

This article explains what data governance is, why enterprises need it, the key components such as data quality, metadata, master data, asset and security management, and provides a step‑by‑step framework, organizational structure, platform features, evaluation methods and common pitfalls.

Data QualityEnterprise Datadata assets
0 likes · 17 min read
How to Build an Enterprise Data Governance System from Scratch
Efficient Ops
Efficient Ops
Nov 22, 2022 · Operations

Why Data Quality Is the Hidden Cost Killer and How to Master Its Governance

This article explains why data quality is critical for business success, outlines common data quality problems and their root causes, and presents a practical governance framework with monitoring rules, alerts, full‑link monitoring, and a seven‑dimensional evaluation model to continuously improve data reliability.

Data Qualitydata governancedata monitoring
0 likes · 12 min read
Why Data Quality Is the Hidden Cost Killer and How to Master Its Governance
TAL Education Technology
TAL Education Technology
Nov 17, 2022 · Big Data

Real-Time Data Warehouse: Background, Value Assessment, and Half-Year Progress

This article outlines the background and terminology of data warehousing, presents a formula for evaluating warehouse value, and details the team's half‑year efforts—including architecture selection, quality assurance, stability governance, and data‑value externalization—to improve efficiency, quality, stability, and cost in real‑time data services.

Data OperationsReal-time Analyticsdata governance
0 likes · 10 min read
Real-Time Data Warehouse: Background, Value Assessment, and Half-Year Progress
Data Thinking Notes
Data Thinking Notes
Nov 16, 2022 · Big Data

Why Metadata Management Is Essential for Data Warehouses

This article explains the concept of metadata, its role in data warehouses, why managing metadata is critical for building, maintaining, and scaling data warehouse systems, and outlines practical steps, use cases, and tools for effective metadata management.

ETLdata governancedata warehouse
0 likes · 15 min read
Why Metadata Management Is Essential for Data Warehouses
DataFunSummit
DataFunSummit
Nov 15, 2022 · Big Data

Industrial Data Governance: Challenges, Practices, and Insights

Industrial data governance, essential for digital transformation, faces challenges such as data heterogeneity, volume, quality, and integration across the value chain, and the presentation outlines background, practical approaches, strategic thinking, and a phased, demand‑driven model to enhance data quality, assetization, and business value.

big datadata assetizationdata governance
0 likes · 24 min read
Industrial Data Governance: Challenges, Practices, and Insights
DataFunSummit
DataFunSummit
Nov 12, 2022 · Big Data

SF Express Technology Data Governance Practice and Framework

This article details SF Express Technology’s decade‑long data governance journey, outlining its three‑phase evolution, comprehensive framework, key policies, organizational structure, and practical implementations such as master data management, data quality, metadata, data market, and security, highlighting lessons and best practices for enterprise data management.

Enterprise DataMaster Data Managementdata governance
0 likes · 17 min read
SF Express Technology Data Governance Practice and Framework
Data Thinking Notes
Data Thinking Notes
Nov 10, 2022 · Big Data

Building Kuaishou’s Scalable Metadata Management Platform for Big Data

This article details Kuaishou’s evolution of its metadata management platform—from early Hive‑centric beginnings to a unified 2.0 architecture and a forward‑looking 3.0 vision—highlighting challenges, key technologies, and how metadata drives data production, consumption, governance, and cost optimization across the big‑data middle platform.

data governancedata platformmetadata lineage
0 likes · 17 min read
Building Kuaishou’s Scalable Metadata Management Platform for Big Data
DataFunSummit
DataFunSummit
Nov 7, 2022 · Big Data

Huolala's Data Governance Practices: Data Quality, Metadata, and Cost Management Platforms

This article details Huolala's end‑to‑end data governance practice, covering the construction of a data governance framework, the implementation of a zero‑code data quality platform, a metadata management platform, and a cost‑governance system that together improve data reliability, reduce waste, and support scalable big‑data operations.

Cost ManagementPlatform Architecturebig data
0 likes · 14 min read
Huolala's Data Governance Practices: Data Quality, Metadata, and Cost Management Platforms
Tencent Cloud Developer
Tencent Cloud Developer
Nov 7, 2022 · Big Data

Data Engineering and Data Warehouse Design: Principles, Practices, and Governance

The article outlines comprehensive data‑engineering and warehouse‑design principles—covering collection (four Ws and methods like SDK, point‑code, binlog), reporting strategies, source selection, modeling with fact, aggregation, dimension and model tables, quality checks, and governance practices such as standardized SDKs, metric libraries, automated lineage, and cost optimization—to share actionable experience for any organization.

ETLbig datadata engineering
0 likes · 32 min read
Data Engineering and Data Warehouse Design: Principles, Practices, and Governance
DevOps Cloud Academy
DevOps Cloud Academy
Nov 5, 2022 · Fundamentals

Understanding Data Architecture: Definitions, Problems Solved, Core Components, and Future Trends

This article explains what data architecture is, why it is essential for linking business and technology, outlines its main components such as data models, data flows, value streams and standards, and discusses emerging trends toward service‑oriented, consumption‑focused data architectures.

Data Modelingdata architecturedata governance
0 likes · 9 min read
Understanding Data Architecture: Definitions, Problems Solved, Core Components, and Future Trends
DataFunSummit
DataFunSummit
Nov 1, 2022 · Big Data

Case Study of DCMM Standard Implementation at State Grid Tianjin Electric Power

This article details State Grid Tianjin Electric Power's early adoption and successful certification of the national DCMM data management maturity model, outlining background, certification milestones, systematic practices, and lessons learned that illustrate how data governance, architecture, and application strategies drive digital transformation.

DCMMbig datacase study
0 likes · 11 min read
Case Study of DCMM Standard Implementation at State Grid Tianjin Electric Power
DevOps Cloud Academy
DevOps Cloud Academy
Oct 27, 2022 · Big Data

Understanding DataOps: Concepts, Standards, and Enterprise Practices

This article explains DataOps as a methodology for improving data analysis quality and efficiency, outlines its origins, standards, and maturity model, and presents practical insights and case studies from Chinese enterprises on how DataOps addresses common data engineering challenges and drives digital transformation.

DataOpsbig datadata governance
0 likes · 12 min read
Understanding DataOps: Concepts, Standards, and Enterprise Practices
DataFunTalk
DataFunTalk
Oct 26, 2022 · Big Data

Metadata Management and Governance Practices at Wing Payment: Architecture, Techniques, and Future Outlook

This article explains how metadata serves as the foundation of enterprise data governance, outlines common data governance challenges, describes Wing Payment's metadata governance framework and platform architecture, and presents future directions such as multi‑source management, cross‑cluster disaster recovery, and intelligent recommendation.

big datadata governancedata lineage
0 likes · 18 min read
Metadata Management and Governance Practices at Wing Payment: Architecture, Techniques, and Future Outlook
Kuaishou Big Data
Kuaishou Big Data
Oct 25, 2022 · Big Data

How Kuaishou Built a Scalable Big Data Platform with Unified Data Quality and Metric Services

This article details Kuaishou's end‑to‑end big data platform, describing its organizational model, unified data governance framework, comprehensive data‑quality solution, the design of a headless metric platform, key technologies such as automatic modeling and code generation, and future directions toward a decentralized, smart data fabric.

Data ModelingData QualityMetric Platform
0 likes · 21 min read
How Kuaishou Built a Scalable Big Data Platform with Unified Data Quality and Metric Services
DataFunSummit
DataFunSummit
Oct 22, 2022 · Big Data

Tencent Music's Data Asset Management and Governance Practices

The article details Tencent Music's data governance journey, describing the background of rapid resource growth, challenges in cost management, a multi‑layered governance methodology—including metadata, tiered storage, and a Lego metadata platform—and the resulting improvements in resource utilization and data quality.

Resource OptimizationTencent Musicbig data
0 likes · 14 min read
Tencent Music's Data Asset Management and Governance Practices
Past Memory Big Data
Past Memory Big Data
Oct 9, 2022 · Operations

How Cloud Music Scaled Data Governance: Practices, Metrics, and Lessons Learned

The article details Cloud Music’s data‑governance journey, covering early modeling standards, self‑service data tools, quality and metadata management, asset‑reuse improvements, and cost‑saving Spark optimizations, while sharing concrete metrics, processes, and the team’s systematic methodology.

Cost OptimizationQuality Managementcloud music
0 likes · 18 min read
How Cloud Music Scaled Data Governance: Practices, Metrics, and Lessons Learned
Youzan Coder
Youzan Coder
Sep 29, 2022 · Big Data

Implementing Spark Data Lineage with Spline: A Step‑by‑Step Guide

This article explains the growing importance of data lineage in large data warehouses, evaluates three Spark lineage extraction approaches, and provides a detailed, step‑by‑step guide to integrating the open‑source Spline agent—including codeless and programmatic initialization, configuration, dispatcher setup, post‑processing, and known limitations.

Apache SparkSparkSpline
0 likes · 16 min read
Implementing Spark Data Lineage with Spline: A Step‑by‑Step Guide
Meituan Technology Team
Meituan Technology Team
Sep 22, 2022 · Information Security

Tokenization for Data Security: Design, Implementation, and Engineering Practices

The article explains how tokenization transforms data security into a built‑in attribute that automatically scales with data growth, detailing its design principles, generation methods, architectural layers, security safeguards, and practical engineering experiences to address exposure risks in modern digital businesses.

PIISecurity Architecturedata governance
0 likes · 24 min read
Tokenization for Data Security: Design, Implementation, and Engineering Practices
ShiZhen AI
ShiZhen AI
Sep 7, 2022 · Big Data

Getting Started with DataHub: A One‑Stop Guide to Metadata Governance

This article walks you through the fundamentals of data governance, explains metadata management concepts, compares traditional tools with DataHub, and provides a step‑by‑step tutorial for installing Docker, Python, and DataHub 0.8.20 on CentOS 7, ingesting MySQL metadata, and exploring the UI.

DataHubDockerPython
0 likes · 19 min read
Getting Started with DataHub: A One‑Stop Guide to Metadata Governance
Past Memory Big Data
Past Memory Big Data
Aug 23, 2022 · Big Data

JD Tech’s Event‑Tracking Data Governance and One‑Stop Platform: Practices and Innovations

The article explains why event‑tracking data needs governance, outlines a full‑link governance methodology, describes the organizational setup, and details the features of JD Tech’s one‑stop tracking management platform, including metadata unification, one‑click validation, real‑time dashboards, visualization tools, and H5‑native data integration.

H5-native integrationReal-time Dashboarddata governance
0 likes · 16 min read
JD Tech’s Event‑Tracking Data Governance and One‑Stop Platform: Practices and Innovations
DataFunSummit
DataFunSummit
Aug 19, 2022 · Big Data

Taobao Data Model Governance: Challenges, Analysis, and Solutions

This article presents a comprehensive overview of Taobao's data model governance, detailing the background and problems of the current data architecture, analyzing root causes, proposing a structured governance framework with DataWorks automation, and outlining future plans to improve efficiency, standardization, and product tooling.

AlibabaData ModelingDataWorks
0 likes · 13 min read
Taobao Data Model Governance: Challenges, Analysis, and Solutions
DataFunSummit
DataFunSummit
Aug 17, 2022 · Big Data

Data Governance Practices and Frameworks: Insights from Alibaba

This article presents an overview of data governance concepts, common enterprise challenges, and Alibaba's comprehensive data governance framework, covering theory, demand layers, practical solutions for stability, quality, standards, security, cost control, and the supporting platforms and operational practices.

Alibababig datadata governance
0 likes · 13 min read
Data Governance Practices and Frameworks: Insights from Alibaba
High Availability Architecture
High Availability Architecture
Aug 15, 2022 · Big Data

Comprehensive Guide to Event Tracking Governance and the One‑Stop Tracking Management Platform

This article explains why event‑tracking (埋点) governance is essential, outlines the methodology and practice of full‑link tracking management, and introduces the one‑stop tracking platform with its innovative features such as standardized processes, verification tools, real‑time dashboards, cross‑platform data unification, and future roadmap.

AnalyticsPlatformbig data
0 likes · 15 min read
Comprehensive Guide to Event Tracking Governance and the One‑Stop Tracking Management Platform
DataFunTalk
DataFunTalk
Aug 13, 2022 · Big Data

Data Governance Practices and Logical Closed‑Loop at KuaiKan

The talk outlines KuaiKan's data governance journey, describing the rapid business growth challenges, the three‑step logical closed‑loop framework, practical experiences in business scope management, data asset governance, collaboration techniques, and future outlook, highlighting evaluation metrics and ongoing improvements.

Data Qualitybig datadata governance
0 likes · 16 min read
Data Governance Practices and Logical Closed‑Loop at KuaiKan
Python Crawling & Data Mining
Python Crawling & Data Mining
Aug 6, 2022 · Operations

Why Operations Data Quality Is the Key to Successful Digital Transformation

In the era of big data, poor operations data quality undermines analytics, decision‑making and digital transformation, so organizations must adopt a three‑dimensional governance approach—covering organization, processes and technology—to ensure completeness, consistency, accuracy, uniqueness, relevance and timeliness of their operational data.

AnalyticsData QualityIT management
0 likes · 17 min read
Why Operations Data Quality Is the Key to Successful Digital Transformation