BestHub
Sign in
Tagged articles
548 articles
Page 2 of 6
DataFunSummit
DataFunSummit
Dec 5, 2024 · Big Data

Ping An Financial Services' Big Data Platform Construction and Data Governance Practices

This article details Ping An Financial Services' journey in building a comprehensive big‑data platform, addressing fragmentation, low data timeliness, processing limits, and governance challenges through a four‑stage technical evolution, modular tool development, and a systematic data‑governance framework to support its digital transformation.

Data GovernanceFinancial Servicesdata engineering
0 likes · 16 min read
Ping An Financial Services' Big Data Platform Construction and Data Governance Practices
DataFunSummit
DataFunSummit
Nov 27, 2024 · Artificial Intelligence

Applying Large Language Models in Data Management and Risk Control at Ping An One Wallet

This presentation details how Ping An One Wallet leverages large language models across five key areas—current application status, data management, risk control, technical architecture, and a Q&A session—highlighting strategies such as vectorized rule storage, prompt engineering, RAG enhancements, and workflow agents to improve efficiency and accuracy in data governance and fraud detection.

AI ArchitectureData Governancerisk control
0 likes · 16 min read
Applying Large Language Models in Data Management and Risk Control at Ping An One Wallet
ByteDance Data Platform
ByteDance Data Platform
Nov 27, 2024 · Big Data

Inside Douyin’s Data Asset Platform: Transforming Data Lineage and Governance

Douyin Group’s data asset management platform introduces a systematic "manage, find, use" approach that unifies metadata collection, full‑coverage data lineage, and a suite of applications across development, governance, asset utilization, and security, while outlining its architecture, modeling, quality metrics, and future roadmap.

Data GovernanceData Lineagemetadata management
0 likes · 14 min read
Inside Douyin’s Data Asset Platform: Transforming Data Lineage and Governance
Data Thinking Notes
Data Thinking Notes
Nov 19, 2024 · Big Data

Unlocking Data Value: The Four Stages of Enterprise Data Asset Realization

This article explains how enterprises transform raw data into valuable assets through four development stages, a triple‑entry accounting theory, and a detailed end‑to‑end process that covers data collection, resource building, product development, trading, evaluation, and financialization.

Big DataData AssetData Governance
0 likes · 14 min read
Unlocking Data Value: The Four Stages of Enterprise Data Asset Realization
JD Retail Technology
JD Retail Technology
Nov 19, 2024 · Big Data

Building an Intelligent Data Governance System with Active Metadata: JD Retail Experience

This article details JD Retail's experience building an intelligent data governance system using proactive metadata, covering challenges in data management, the design of a comprehensive governance framework, lifecycle evaluation models, and automated data backfill solutions to improve efficiency, cost control, and operational safety.

Data FabricData Governanceactive metadata
0 likes · 20 min read
Building an Intelligent Data Governance System with Active Metadata: JD Retail Experience
DataFunTalk
DataFunTalk
Nov 10, 2024 · Big Data

Douyin Group Data Asset Management Platform and Data Lineage Architecture Overview

This article provides a comprehensive overview of Douyin Group's data asset management platform, detailing the evolution, architecture, and applications of its large‑scale data lineage system, and discusses future directions for enhancing data quality, cost efficiency, and security across the organization.

Data GovernanceData Lineagemetadata management
0 likes · 15 min read
Douyin Group Data Asset Management Platform and Data Lineage Architecture Overview
Data Thinking Notes
Data Thinking Notes
Nov 7, 2024 · Fundamentals

What’s Inside China’s New National Data Standard System Guide?

The Chinese government has issued a comprehensive ‘National Data Standard System Construction Guide’ that outlines a roadmap to build a unified data standards framework by 2026, detailing design principles, system architecture, core standard categories, and providing a downloadable full guide.

Big DataData GovernanceInformation Management
0 likes · 6 min read
What’s Inside China’s New National Data Standard System Guide?
Data Thinking Notes
Data Thinking Notes
Nov 5, 2024 · Big Data

How a Next‑Gen Data Management Platform Boosts Efficiency and Innovation

This article outlines the motivations, objectives, and architectural design of a next‑generation data management platform, detailing its four‑layer “four‑ization” approach, core services such as data integration, modeling, API provisioning, componentization, as well as governance, security, and operational best practices.

Big DataData GovernanceData Integration
0 likes · 20 min read
How a Next‑Gen Data Management Platform Boosts Efficiency and Innovation
58 Tech
58 Tech
Oct 28, 2024 · Databases

Design and Practices of Multi‑Tenant Database Management in the QiaoFang SaaS System

This article examines the QiaoFang SaaS platform’s multi‑tenant database architecture, tenant data governance, multi‑partition service design, and operational practices such as database operations, cleanup, and monitoring, highlighting the challenges and solutions for large‑scale real‑estate brokerage services.

Data GovernanceDatabase ArchitectureSaaS
0 likes · 17 min read
Design and Practices of Multi‑Tenant Database Management in the QiaoFang SaaS System
Data Thinking Notes
Data Thinking Notes
Oct 24, 2024 · Big Data

Why Data Metrics Matter: Building Effective Indicator Systems

Understanding what data metrics are, how to construct comprehensive indicator systems, and why they are essential for data‑driven decision‑making, operational efficiency, and unified statistical standards is crucial for businesses seeking to leverage big‑data technologies and improve strategic outcomes.

Big DataBusiness AnalyticsData Governance
0 likes · 12 min read
Why Data Metrics Matter: Building Effective Indicator Systems
DataFunSummit
DataFunSummit
Oct 20, 2024 · Operations

Data Metrics and Their Role in Business Operations: Current Challenges, Applications, and Future Outlook

This article examines the relationship between data metrics and business applications, outlines the current state and challenges of data metric usage, explains how metrics drive data‑driven operations, describes a step‑by‑step approach to building an application‑oriented metric system, and looks ahead to future trends in metric governance and automation.

Data Governancebusiness operationsdata metrics
0 likes · 25 min read
Data Metrics and Their Role in Business Operations: Current Challenges, Applications, and Future Outlook
Data Thinking Notes
Data Thinking Notes
Oct 15, 2024 · Fundamentals

Why Data Modeling Matters: Unlock Business Value and Governance

This article explains how data modeling drives business value by sparking conversations about data meaning, enabling the creation of useful data objects, and guiding smart decisions on data capture, storage, usage, and integration, while also outlining a governance framework for managing enterprise data models.

Data GovernanceData ManagementEnterprise Data
0 likes · 4 min read
Why Data Modeling Matters: Unlock Business Value and Governance
DataFunTalk
DataFunTalk
Oct 11, 2024 · Artificial Intelligence

E‑commerce Innovation and Data Governance: Summaries of Recent Research Topics

This article compiles concise overviews of recent e‑commerce research, covering real‑time online learning re‑ranking models, causal inference for user growth, full‑link data lineage, TikTok's data governance and attribution solutions, Volcano Engine's metric management, AI Agent applications on 1688, and XinXuan Group's live‑stream data architecture.

AIData GovernanceData Lineage
0 likes · 5 min read
E‑commerce Innovation and Data Governance: Summaries of Recent Research Topics
Data Thinking Notes
Data Thinking Notes
Sep 29, 2024 · Operations

Why State-Owned Enterprises Struggle with Digital Transformation: Key Challenges and Insights

State-owned enterprises face unclear digital transformation goals, weak strategic positioning, fragmented data governance, talent shortages, and an underdeveloped technology ecosystem, which together hinder the realization of value benefits and impede effective digital innovation across the organization.

Data GovernanceDigital TransformationState-owned Enterprises
0 likes · 17 min read
Why State-Owned Enterprises Struggle with Digital Transformation: Key Challenges and Insights
Data Thinking Notes
Data Thinking Notes
Sep 24, 2024 · Artificial Intelligence

Leveraging Large Models to Transform Data Governance: Quality, Cost, Efficiency

This article explains how large language models enhance data governance by improving data quality, reducing implementation costs, and increasing operational efficiency through knowledge bases and interactive prompt libraries, and it also outlines practical empowerment pathways for organizations seeking to leverage AI-driven analytics.

AICost reductionData Governance
0 likes · 3 min read
Leveraging Large Models to Transform Data Governance: Quality, Cost, Efficiency
Data Thinking Notes
Data Thinking Notes
Sep 23, 2024 · Big Data

Why Data Asset Rights Matter: Unlocking Value in the Digital Economy

This article examines the definition, policy background, and significance of data asset rights in China, outlining how clear ownership structures can incentivize data production, promote circulation, resolve data silos, and support the rapid growth of the digital economy.

Big DataData AssetData Governance
0 likes · 15 min read
Why Data Asset Rights Matter: Unlocking Value in the Digital Economy
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 13, 2024 · Big Data

How Qimao Scales 20PB Data with StarRocks, Flink, and Real‑Time Analytics

Qimao, a Shanghai‑based cultural entertainment internet firm, details its 20 PB big‑data architecture built on StarRocks, Flink, Hive, and Redis, covering data ingestion, real‑time processing, audience selection, metric anomaly drill‑down, 730‑day aggregation, and future plans for metric acceleration and full‑link data governance.

Big DataData GovernanceData Warehouse
0 likes · 13 min read
How Qimao Scales 20PB Data with StarRocks, Flink, and Real‑Time Analytics
Data Thinking Notes
Data Thinking Notes
Sep 9, 2024 · Fundamentals

Master the 6‑Step Blueprint for Building an Enterprise Data Middle Platform

This guide outlines a practical six‑step methodology—covering overall planning, data integration, model construction, data development, asset management, and data services—to help enterprises build a robust data middle platform that unlocks business value and supports agile digital transformation.

Data GovernanceData IntegrationData Platform
0 likes · 10 min read
Master the 6‑Step Blueprint for Building an Enterprise Data Middle Platform
Baidu Geek Talk
Baidu Geek Talk
Sep 9, 2024 · Big Data

TDS Platform Overview: Architecture, Modules, and Features of Baidu MEG's Turing 3.0 Data Ecosystem

The TDS platform, central to Baidu MEG’s Turing 3.0 ecosystem, unifies data development, warehouse management, monitoring, and resource control through Spark‑based TDE, a visual studio, and AI‑enhanced tools like Smart Diagnosis and Text2SQL, enabling standardized workflows, scalable scheduling, and handling over 30 k daily tasks.

AIBig DataData Development
0 likes · 21 min read
TDS Platform Overview: Architecture, Modules, and Features of Baidu MEG's Turing 3.0 Data Ecosystem
DataFunSummit
DataFunSummit
Aug 28, 2024 · Big Data

Building Data Lineage Foundations and Applications for E‑commerce Scenarios

This article explains how to construct a full‑link data lineage platform for e‑commerce, detailing its architecture, quality metrics, and practical uses such as table migration, field‑level tracing, and automated metric decomposition to improve data governance and efficiency.

Data GovernanceData Lineagee‑commerce
0 likes · 14 min read
Building Data Lineage Foundations and Applications for E‑commerce Scenarios
Data Thinking Notes
Data Thinking Notes
Aug 27, 2024 · Information Security

Understanding Data Security Regulations and Classification Standards

This article presents an overview of data security related regulations, outlines the standards for data classification and grading, and showcases industry-specific classification schemes through illustrative diagrams, providing a concise visual guide for implementing data security measures.

Data GovernanceRegulationsdata classification
0 likes · 2 min read
Understanding Data Security Regulations and Classification Standards
Data Thinking Notes
Data Thinking Notes
Aug 20, 2024 · Artificial Intelligence

How Large AI Models Transform Data Governance: Strategies and Challenges

This article explores how the rise of massive AI models reshapes data governance, detailing model fundamentals, architectural types, emerging challenges, a five‑domain governance framework, and practical AI‑driven applications for data standards, metadata, quality, and security, while also looking ahead to future trends.

AIData GovernanceData Quality
0 likes · 14 min read
How Large AI Models Transform Data Governance: Strategies and Challenges
Eric Tech Circle
Eric Tech Circle
Aug 18, 2024 · Industry Insights

How Huawei Tackles Data Silos: Lessons from “Huawei Data Way”

Drawing from the book “Huawei Data Way”, this article explains why Huawei must digitize, describes the resulting data‑island problem, and outlines the four‑part framework of data governance—including data asset catalogs, standards, models, and distribution—while showing how business‑object‑centric information architecture is built and implemented.

Data GovernanceDigital TransformationHuawei
0 likes · 6 min read
How Huawei Tackles Data Silos: Lessons from “Huawei Data Way”
Data Thinking Notes
Data Thinking Notes
Aug 15, 2024 · Big Data

How to Build a Scalable Data Warehouse: Theory, Architecture, and Best Practices

This article outlines practical approaches to data warehouse construction, covering dimensional modeling, layered architecture, capability development, real‑time and batch processing with technologies like Hive, Spark, Flink, Iceberg, and discusses governance, security, and future trends toward data value and real‑time metrics.

Data GovernanceData WarehouseIceberg
0 likes · 13 min read
How to Build a Scalable Data Warehouse: Theory, Architecture, and Best Practices
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 14, 2024 · Big Data

Understanding Data Middle Platform: Value, Architecture, and Real‑World Cases

This article explains the concept, value, three‑layer architecture, and practical implementations of a data middle platform, illustrating how it standardizes data, forms a middle‑office organization, and drives cost‑effective business empowerment through examples from Alibaba, NetEase, and other enterprises.

Big DataCase StudyData Governance
0 likes · 9 min read
Understanding Data Middle Platform: Value, Architecture, and Real‑World Cases
Data Thinking Notes
Data Thinking Notes
Aug 13, 2024 · Fundamentals

How to Define, Classify, and Catalog Your Enterprise Data Assets

This article explains what data assets are, how to categorize them by structure and source, outlines a six‑step inventory process, describes a hierarchical catalog architecture, and highlights the four key benefits of a unified data asset directory for modern enterprises.

Data AssetsData CatalogData Governance
0 likes · 11 min read
How to Define, Classify, and Catalog Your Enterprise Data Assets
Data Thinking Notes
Data Thinking Notes
Aug 12, 2024 · Information Security

Understanding Data Governance vs Data Security Governance: Key Frameworks Explained

This article explains how data has become a strategic resource, outlines the economic and industrial value of data, differentiates data governance from data security governance, and reviews major data security frameworks and a data‑centric security architecture to guide organizations in protecting their data assets.

Data GovernanceData Lifecycledata security
0 likes · 12 min read
Understanding Data Governance vs Data Security Governance: Key Frameworks Explained
Continuous Delivery 2.0
Continuous Delivery 2.0
Aug 1, 2024 · Fundamentals

The Essence of Data Governance: Managing Data and People

This article reflects on the challenges of data governance, emphasizing that effective governance involves not only technical data handling but also managing people, aligning responsibilities, fostering cooperation between leadership and business units, and establishing clear ownership and incentive mechanisms.

Data GovernanceData Managementorganizational culture
0 likes · 4 min read
The Essence of Data Governance: Managing Data and People
Data Thinking Notes
Data Thinking Notes
Jul 30, 2024 · Information Security

Mastering Data Classification: A Practical Guide to Secure Data Grading

This article outlines the evolution of data security in China, explains why data classification and grading are central to governance, and provides a step‑by‑step framework, principles, implementation details, adjustment triggers, and practical reflections for building effective data protection strategies.

Data Governancecompliancedata classification
0 likes · 11 min read
Mastering Data Classification: A Practical Guide to Secure Data Grading
Data Thinking Notes
Data Thinking Notes
Jul 29, 2024 · Big Data

What Is a Data Middle Platform and How Does It Transform Enterprise Data Management?

This article explains the concept, design principles, and core components of a data middle platform, detailing its overall, functional, layered, logical, and data architectures, as well as the specific platforms for data collection, processing, organization, governance, quality, sharing, and visualization, illustrated with diagrams.

Big DataData ArchitectureData Governance
0 likes · 27 min read
What Is a Data Middle Platform and How Does It Transform Enterprise Data Management?
DataFunSummit
DataFunSummit
Jul 28, 2024 · Product Management

From 1 to N: Building and Maintaining a Tag System – Common Issues and Solutions

This article outlines the three essential steps for scaling a tag system from initial deployment to full maturity, highlights typical challenges such as incomplete functionality, business system integration, and permission management, and provides practical solutions and best‑practice recommendations for each stage.

Data GovernanceOperationsfeature planning
0 likes · 6 min read
From 1 to N: Building and Maintaining a Tag System – Common Issues and Solutions
Data Thinking Notes
Data Thinking Notes
Jul 25, 2024 · Information Security

How Large Language Models Transform Data Security Compliance Management

This article explains how a leading insurance technology group leverages large language models to streamline data security compliance, detailing the evolution of data management, key governance challenges, multimodal AI architecture, and practical workflows for policy enforcement, risk monitoring, and asset management.

AIData Governancecompliance
0 likes · 10 min read
How Large Language Models Transform Data Security Compliance Management
Data Thinking Notes
Data Thinking Notes
Jul 22, 2024 · Fundamentals

Why Data Architecture Governance Is the Key to Successful Digital Transformation

Data architecture governance, encompassing standards, security, modeling, quality, and lifecycle management, is essential for digital transformation in fast‑growing industries like express delivery, and this article outlines current challenges, traditional approaches, and a practical, phased methodology with platform support to implement effective governance.

Data ArchitectureData GovernanceDigital Transformation
0 likes · 12 min read
Why Data Architecture Governance Is the Key to Successful Digital Transformation
Data Thinking Notes
Data Thinking Notes
Jul 11, 2024 · Big Data

How to Build a Robust Data Lineage Foundation for Scalable Business Insights

This article explains how to construct a full‑chain data lineage system, covering its overall architecture, quality measurement framework, and application layer, and demonstrates practical use cases such as handling data growth, monitoring warehouse changes, accelerating development, ensuring consistency, and automating metric decomposition in real‑world business scenarios.

Big DataData GovernanceData Lineage
0 likes · 14 min read
How to Build a Robust Data Lineage Foundation for Scalable Business Insights
Data Thinking Notes
Data Thinking Notes
Jul 9, 2024 · Big Data

How to Build a Robust Enterprise Data Asset Catalog for Better Governance

This article explains why a comprehensive data asset catalog is essential for modern enterprises, outlines its core components such as inventory, metadata, data lineage, standards and access control, details step‑by‑step construction methods, and highlights key applications in governance, quality, compliance, architecture and valuation.

Big DataData CatalogData Governance
0 likes · 13 min read
How to Build a Robust Enterprise Data Asset Catalog for Better Governance
DataFunSummit
DataFunSummit
Jul 8, 2024 · Big Data

Metric Management and Intelligent Insight Practices at MuTong Technology

This article shares MuTong Technology's comprehensive experience in metric management, covering pain points, governance, naming standards, production‑consumption workflows, cost‑ROI optimization, and the implementation of intelligent insight modules to improve data quality, efficiency, and business decision‑making.

Cost OptimizationData Governanceintelligent insight
0 likes · 22 min read
Metric Management and Intelligent Insight Practices at MuTong Technology
DataFunSummit
DataFunSummit
Jul 6, 2024 · Big Data

JD Tech Data Warehouse Journey, Model Management, and Tag Value Evaluation

This article shares JD Tech's experience in data warehouse evolution, model management practices, and tag value assessment, covering the company's data journey from 2013, layered warehouse architecture, modeling standards, governance, and a quantitative framework for evaluating tag effectiveness.

Data GovernanceModel Managementtag value evaluation
0 likes · 14 min read
JD Tech Data Warehouse Journey, Model Management, and Tag Value Evaluation
Data Thinking Notes
Data Thinking Notes
Jul 4, 2024 · Big Data

How Active Metadata Revolutionizes Data Governance and Cuts Costs

This article examines the growing challenges of data management—such as asset discoverability, architectural rigidity, development quality, and rising resource costs—and presents a comprehensive data‑governance framework that leverages standards, agile architecture, development isolation, and active‑metadata‑driven lifecycle evaluation to improve efficiency, reduce expenses, and enable intelligent, automated data back‑filling.

Big DataData GovernanceStorage Optimization
0 likes · 17 min read
How Active Metadata Revolutionizes Data Governance and Cuts Costs
Data Thinking Notes
Data Thinking Notes
Jun 27, 2024 · Fundamentals

How to Build Effective Data Standards for Enterprise Governance

This article explains the concept of data standards, outlines the three main categories of data standards, describes a four‑stage implementation process, and provides a real‑world bank case study to illustrate how enterprises can establish and apply data standards for better data quality and value.

Data GovernanceData QualityEnterprise Data
0 likes · 11 min read
How to Build Effective Data Standards for Enterprise Governance
DataFunTalk
DataFunTalk
Jun 27, 2024 · Big Data

Data Warehouse Construction and Data Governance Practices at Wing Payment

This presentation by senior data warehouse engineer Huang Luo details Wing Payment’s end‑to‑end data warehouse build, covering background challenges, governance framework, platform architecture, layered modeling, naming standards, asset management, monitoring, and future plans, illustrating how systematic data governance drives cost reduction, efficiency, and security.

AnalyticsBig DataData Governance
0 likes · 14 min read
Data Warehouse Construction and Data Governance Practices at Wing Payment
DataFunTalk
DataFunTalk
Jun 19, 2024 · Big Data

Evolution and Practices of E‑commerce Data Warehouse Governance

This article analyzes the current state, development stages, and comprehensive solutions of e‑commerce data‑warehouse governance, covering data quality, cost, security, and efficiency requirements, and presents a roadmap from early‑stage standardization to mature tool‑driven governance with future outlooks.

Big DataCost ManagementData Governance
0 likes · 13 min read
Evolution and Practices of E‑commerce Data Warehouse Governance
DataFunSummit
DataFunSummit
Jun 15, 2024 · Artificial Intelligence

Large‑Model‑Driven Data Governance: Technical Outlook and Research Highlights

This article reviews the rising importance of data quality for large models, explores data‑centric AI, large‑model pre‑training data engineering, and presents recent Fudan University research on using large models to improve data governance across multiple domains such as attribute normalization, geographic cleaning, compliance checking, and multimodal retrieval.

AIData GovernanceKnowledge Graphs
0 likes · 19 min read
Large‑Model‑Driven Data Governance: Technical Outlook and Research Highlights
DataFunTalk
DataFunTalk
Jun 12, 2024 · Big Data

Technical Maturity Curve of Indicator Systems: Framework, Requirements, and the Role of Large Models

This article explores the technical maturity curve of indicator systems, covering data collection, modeling, production, management, governance, and application, while analyzing the security, stability, and usability requirements and discussing how large language models can enhance certain clear and complicated scenarios.

AI integrationBig DataData Governance
0 likes · 10 min read
Technical Maturity Curve of Indicator Systems: Framework, Requirements, and the Role of Large Models
DataFunSummit
DataFunSummit
Jun 3, 2024 · Big Data

Data Governance and Active Metadata Practices at JD Retail

The article outlines JD Retail's data management challenges—including asset awareness, architectural agility, development quality, and rising resource costs—and presents a comprehensive data governance framework that leverages data standards, agile architecture, development isolation, resource optimization, and active metadata to achieve intelligent lifecycle evaluation, automated back‑fill, and future‑oriented data fabric improvements.

Data GovernanceData LifecycleStorage Optimization
0 likes · 18 min read
Data Governance and Active Metadata Practices at JD Retail
Data Thinking Notes
Data Thinking Notes
Jun 2, 2024 · Big Data

How JD Retail’s Data Platform Boosts Efficiency with Unified Modeling and AI‑Driven Insights

This article details JD Retail’s end‑to‑end data platform, covering data asset certification, 5W2H modeling, unified query DSL, intelligent acceleration, robust governance, visualization components, low‑code orchestration, and large‑model AI applications that together reduce query latency, cut development costs, and empower analysts across the retail business.

AIBig DataData Governance
0 likes · 39 min read
How JD Retail’s Data Platform Boosts Efficiency with Unified Modeling and AI‑Driven Insights
DataFunTalk
DataFunTalk
May 28, 2024 · Big Data

Building and Managing a Metric System in Data Warehouse: Practices from Dongchedi

This article details how the Dongchedi business team designs, implements, and monitors a comprehensive metric system within its data warehouse, covering metric standards, model construction, metadata management, quality monitoring, application scenarios, and future directions using the DataLeap platform.

Big DataData GovernanceData Warehouse
0 likes · 18 min read
Building and Managing a Metric System in Data Warehouse: Practices from Dongchedi
Data Thinking Notes
Data Thinking Notes
May 21, 2024 · Fundamentals

Master Data Management: Building a Unified, High‑Quality Data Backbone for Enterprises

Enterprises facing fragmented systems like OA, HR, CRM, and ERP must adopt a unified master data management framework that defines standards, governance, organizational structures, and integrated platforms to ensure data consistency, accuracy, and real‑time availability, thereby reducing maintenance costs and supporting digital transformation.

Data GovernanceData QualityDigital Transformation
0 likes · 16 min read
Master Data Management: Building a Unified, High‑Quality Data Backbone for Enterprises
DataFunSummit
DataFunSummit
May 13, 2024 · Big Data

Metadata‑Driven Data Governance: Concepts, Architectures, and Practices

This article explains how metadata‑driven data governance addresses the challenges of the digital economy by detailing the era background, limitations of traditional methods, the roles of Data Fabric, Data Mesh and DataOps, and presenting real‑world case studies and future directions.

AIData FabricData Governance
0 likes · 14 min read
Metadata‑Driven Data Governance: Concepts, Architectures, and Practices
Goodme Frontend Team
Goodme Frontend Team
May 8, 2024 · Frontend Development

2024 Frontend & Tech Highlights: Node.js 22, React 19, Blockchain, AIGC Low‑Code

This curated newsletter presents the latest releases of Node.js, React, and React Native, highlights a blockchain career transition story, summarizes AIGC‑powered low‑code development, systematic data‑governance modeling, import‑statement optimization, techniques for showcasing technical depth, and design proposal guidance for the VUCA era.

AIBlockchainData Governance
0 likes · 6 min read
2024 Frontend & Tech Highlights: Node.js 22, React 19, Blockchain, AIGC Low‑Code
DataFunSummit
DataFunSummit
May 3, 2024 · Big Data

Comprehensive Guide to Enterprise Data Governance: Vision, Framework, Organization, Standards, Quality, and Security

This article presents a detailed overview of enterprise data governance, covering its vision and goals, three‑layer framework, organizational structure, institutional policies, data standards, quality management, metadata handling, security controls, lifecycle protection, and practical implementation cases.

Data GovernanceEnterprise Data
0 likes · 14 min read
Comprehensive Guide to Enterprise Data Governance: Vision, Framework, Organization, Standards, Quality, and Security
Data Thinking Notes
Data Thinking Notes
Apr 25, 2024 · Fundamentals

Mastering Data Governance: Build High‑Quality, Secure, Traceable Business Data

This article explains how a comprehensive data governance framework—covering data quality, metadata, master data, asset management, security, and standards—can ensure high‑quality, safe, and traceable business data while outlining implementation steps, organizational roles, platform features, and assessment methods.

Data GovernanceData QualityMaster Data
0 likes · 12 min read
Mastering Data Governance: Build High‑Quality, Secure, Traceable Business Data
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 21, 2024 · Big Data

Design Insights of Bilibili's Big Data Development Governance Platform

This article outlines Bilibili's five‑year journey building a comprehensive big‑data development and governance platform, detailing its user segmentation, product positioning, data map and governance product design, abstract configuration approach, operational mechanisms, value assessment, and measurable impact on data efficiency and business outcomes.

Data Governancedata operationsplatform design
0 likes · 11 min read
Design Insights of Bilibili's Big Data Development Governance Platform
DataFunTalk
DataFunTalk
Apr 20, 2024 · Big Data

Tencent Video Metrics Middle Platform and Lakehouse Integration: Architecture, Governance, and Practices

This article details Tencent Video’s data business, describing the design and implementation of its metrics middle platform and lake‑warehouse integration, covering architecture, governance, consistency, timeliness, usability, cost optimization, and future plans, with insights into technology choices such as Iceberg, StarRocks, and MQL.

Big DataData GovernanceLakehouse
0 likes · 18 min read
Tencent Video Metrics Middle Platform and Lakehouse Integration: Architecture, Governance, and Practices
Data Thinking Notes
Data Thinking Notes
Apr 18, 2024 · Information Security

How to Implement Effective Data Classification and Grading for Secure Data Management

Data classification and grading, essential components of data security governance, involve defining data categories, assigning sensitivity levels, adhering to national standards, and establishing organizational processes to ensure compliant, secure, and value‑driven data handling across enterprises.

Data GovernanceData Managementdata classification
0 likes · 20 min read
How to Implement Effective Data Classification and Grading for Secure Data Management
DataFunSummit
DataFunSummit
Apr 17, 2024 · Big Data

White‑Box Cost Governance in Big Data: Engine, Data Warehouse, and Tool Optimizations

This article presents a year‑long, white‑box cost‑governance practice for big‑data platforms, detailing the data‑governance framework, engine auto‑tuning (HBO), compression algorithm replacement, operator analysis, data‑warehouse white‑boxing, duplicate‑computation reduction, link‑depth minimisation, automation of routine governance, benefit analysis, and future plans.

Cost OptimizationData Governanceengine tuning
0 likes · 17 min read
White‑Box Cost Governance in Big Data: Engine, Data Warehouse, and Tool Optimizations
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Apr 16, 2024 · Big Data

MaxCompute’s Integrated Offline & Near‑Real‑Time Architecture: Transaction Table 2.0 Explained

This article explains MaxCompute’s new integrated offline‑and‑near‑real‑time architecture, Transaction Table 2.0, detailing its unified storage and compute design, automatic data governance, schema evolution, upsert and time‑travel capabilities, and how it simplifies complex big‑data pipelines while delivering minute‑level latency and lower costs.

Big DataData GovernanceMaxCompute
0 likes · 27 min read
MaxCompute’s Integrated Offline & Near‑Real‑Time Architecture: Transaction Table 2.0 Explained
DataFunTalk
DataFunTalk
Apr 12, 2024 · Big Data

Building and Managing an Indicator System in a Data Warehouse: Practices from the Dongchedi Business

This article explains how the Dongchedi team designed, implemented, and monitored a comprehensive indicator system within a petabyte‑scale data warehouse, covering standards, metadata management, model construction, quality monitoring, and diverse application scenarios to improve data reliability and business insight.

Big DataData GovernanceData Warehouse
0 likes · 18 min read
Building and Managing an Indicator System in a Data Warehouse: Practices from the Dongchedi Business
Data Thinking Notes
Data Thinking Notes
Apr 9, 2024 · Big Data

What Is a Data Middle Platform and Why It’s Essential for Modern Enterprises

Data middle platforms transform raw enterprise data into reusable assets by integrating collection, storage, processing, governance, and service layers, enabling faster deployment, consistent metrics, improved data quality, and business value across digital transformation, while addressing challenges like siloed data, low efficiency, and inconsistent standards.

Big DataData GovernanceData Integration
0 likes · 23 min read
What Is a Data Middle Platform and Why It’s Essential for Modern Enterprises
DataFunTalk
DataFunTalk
Apr 3, 2024 · Artificial Intelligence

DataFunCon 2024 Shanghai: AI, Big Data, Cloud and Industry Forum Program

DataFunCon 2024 Shanghai brings together leading experts from AI, big data, cloud computing, and industry sectors to discuss cutting‑edge technologies, large‑model applications, intelligent operations, and digital transformation across automotive, healthcare, finance, retail, and entertainment.

Big DataData GovernanceDigital Transformation
0 likes · 69 min read
DataFunCon 2024 Shanghai: AI, Big Data, Cloud and Industry Forum Program
DataFunTalk
DataFunTalk
Mar 29, 2024 · Big Data

Best Practices for Building an International Ride‑Hailing Data Metric System at Didi

This article outlines Didi’s best‑practice approach to constructing a global ride‑hailing data metric system, covering business scenarios, metric categories, pain points such as definition and technical challenges, and a comprehensive solution involving organizational structure, processes, model design, tooling, timezone handling, and governance.

Data ArchitectureData GovernanceDidi
0 likes · 13 min read
Best Practices for Building an International Ride‑Hailing Data Metric System at Didi
DataFunTalk
DataFunTalk
Mar 27, 2024 · Big Data

Data Collection Quality Review: From Compliance to Reasonableness and Toolchain Overview

This article explores data collection governance by distinguishing data quality compliance from reasonableness, introduces a comprehensive quality review tool suite—including visual inspection, intelligent judgment, and self‑diagnosis—detailing its architecture, key techniques, and practical case studies for ensuring reliable data metrics.

Big DataData GovernanceIntelligent Judgment
0 likes · 19 min read
Data Collection Quality Review: From Compliance to Reasonableness and Toolchain Overview
DataFunTalk
DataFunTalk
Mar 24, 2024 · Big Data

Didi's Big Data Asset Governance Practices: Hadoop and Elasticsearch Governance

This article details Didi's comprehensive big‑data asset governance platform, covering its architectural layers, Hadoop and Elasticsearch governance practices, health‑score models, lifecycle recommendations, and future plans for automated and intelligent data governance to reduce cost and manual effort.

Big DataData GovernanceElasticsearch
0 likes · 17 min read
Didi's Big Data Asset Governance Practices: Hadoop and Elasticsearch Governance
DataFunSummit
DataFunSummit
Mar 15, 2024 · Product Management

How to Build a Good Data Platform: Insights from Tencent’s Senior Product Manager

This presentation shares the speaker’s experience and practical methods for creating an effective data platform, covering the transition from technical roles to product management, deep understanding of data workers' needs, Tencent Oura asset‑factory practices, a product‑management methodology, and a Q&A session that addresses governance, performance, and engineering challenges.

Data Governancedata engineeringproduct-management
0 likes · 15 min read
How to Build a Good Data Platform: Insights from Tencent’s Senior Product Manager
JD Tech
JD Tech
Mar 5, 2024 · Big Data

JD Retail Data Asset Management: Upgrading Practices and Technical Innovations

This article examines JD Retail's comprehensive upgrade of data asset management, detailing innovations in data governance, multi‑level acceleration engines, intelligent materialization, unified DSL, visualization tools, low‑code orchestration, and large‑model AI applications that boost efficiency, reliability, and business decision‑making.

Data Asset ManagementData Governancelow-code
0 likes · 43 min read
JD Retail Data Asset Management: Upgrading Practices and Technical Innovations
JD Retail Technology
JD Retail Technology
Feb 22, 2024 · Big Data

JD Retail Data Platform: Data Asset Governance, Metric Middle Platform, Visualization Tools, and AI‑Driven Applications

This technical article details JD Retail’s 2023 data platform advancements, covering data‑asset certification and governance, a metric middle‑platform for unified indicator management, sophisticated visualization components, low‑code orchestration, and large‑model AI applications that together improve data retrieval efficiency, reduce storage‑compute costs, and support rapid business decision‑making.

AIData GovernanceData Platform
0 likes · 39 min read
JD Retail Data Platform: Data Asset Governance, Metric Middle Platform, Visualization Tools, and AI‑Driven Applications
ByteDance Data Platform
ByteDance Data Platform
Feb 21, 2024 · Big Data

How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance

ByteDance’s DataLeap suite tackles the complexities of large‑scale data platform governance by identifying manual tuning pain points, deploying automated rule‑engine recommendations, and optimizing resource allocation, ultimately improving stability, reducing costs, and enhancing overall system health across thousands of Spark, Flink and other tasks.

Data GovernanceResource Optimizationreal-time monitoring
0 likes · 14 min read
How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance
DataFunTalk
DataFunTalk
Feb 17, 2024 · Big Data

JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization

This article presents JD Logistics' one‑stop agile BI platform, detailing the complex data sources, rapid requirement changes, and Chinese‑style reporting challenges it addresses, while outlining the UData solution, product methodology, performance enhancements, and real‑world case studies that demonstrate significant efficiency gains.

Agile AnalyticsBIBig Data
0 likes · 26 min read
JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization
DataFunTalk
DataFunTalk
Feb 15, 2024 · Big Data

Data Quality Review: From Compliance to Reasonableness and Toolchain Overview

This article explores data collection governance by distinguishing compliance from reasonableness, introduces a comprehensive quality review tool system—including visual inspection, intelligent judgement, and self‑diagnosis—details key techniques such as comparison operators and sampling, and outlines a three‑layer architecture and future directions for data quality assurance.

Big DataData Governancedata sampling
0 likes · 18 min read
Data Quality Review: From Compliance to Reasonableness and Toolchain Overview
Data Thinking Notes
Data Thinking Notes
Jan 30, 2024 · Operations

How Banks Can Build an Effective Data Governance Framework

This article outlines a two‑step approach for banks to design a data governance system—clarifying organizational responsibilities and constructing a layered institutional framework—while detailing cross‑department collaboration, head‑office and branch coordination, and practical policy, procedure, and work‑detail levels to sustain continuous improvement and support digital transformation.

BankingData GovernanceData Management
0 likes · 10 min read
How Banks Can Build an Effective Data Governance Framework
DataFunSummit
DataFunSummit
Jan 29, 2024 · Big Data

Building Bilibili's Data Service Middle Platform: Architecture, Practices, and Future Plans

This article presents Bilibili's data service middle platform, detailing its background, pain points of traditional data acquisition, the one‑stop service architecture, core processes, model and API construction, query mechanisms, practical solutions for full‑link control, cost reduction, efficiency gains, high‑availability design, and future roadmap.

APIData Governancedata services
0 likes · 19 min read
Building Bilibili's Data Service Middle Platform: Architecture, Practices, and Future Plans
政采云技术
政采云技术
Jan 24, 2024 · Big Data

A Business Analyst’s End‑to‑End Journey Using a Data Middle Platform: From Issue Identification to Data‑Driven Solutions

The article walks through a detailed, real‑world scenario where a business analyst leverages a data middle platform—covering metric analysis, exploratory queries, data development, visualization, and productization—to diagnose a 30% sales decline and implement data‑driven remediation, illustrating core concepts such as OneData and OneService.

AnalyticsData DevelopmentData Governance
0 likes · 12 min read
A Business Analyst’s End‑to‑End Journey Using a Data Middle Platform: From Issue Identification to Data‑Driven Solutions
DataFunTalk
DataFunTalk
Jan 22, 2024 · Big Data

Design and Implementation of Bilibili's Big Data Development Governance Platform

This article details Bilibili's five‑year development of a comprehensive big‑data governance platform, covering its usage scenarios, product positioning, data map and governance solutions, abstract configuration approach, operational mechanisms, and future plans, highlighting significant improvements in data efficiency and value assessment.

BilibiliData GovernanceData Value
0 likes · 10 min read
Design and Implementation of Bilibili's Big Data Development Governance Platform
DataFunTalk
DataFunTalk
Jan 20, 2024 · Big Data

How ByteDance Leverages the Data Flywheel in Large‑Scale Projects

This article explains how ByteDance (Douyin) transforms its data infrastructure from isolated workshops to a unified middle platform and finally to a data flywheel, detailing the three development stages, the Data BP organizational model, real‑time analytics, A/B testing, and the resulting business benefits for large‑scale event projects.

Big DataData FlywheelData Governance
0 likes · 13 min read
How ByteDance Leverages the Data Flywheel in Large‑Scale Projects
DevOps
DevOps
Jan 17, 2024 · Operations

Agile Data Management: Principles, Practices, and Implementation Guide

This article explains how agile methodologies can be applied to data management, covering the need for agile data practices, core principles, iterative modeling, governance, CI/CD pipelines, tooling, metrics, security, case studies, challenges, and future outlooks in a comprehensive, step‑by‑step guide.

Data GovernanceData ManagementDataOps
0 likes · 13 min read
Agile Data Management: Principles, Practices, and Implementation Guide
DataFunTalk
DataFunTalk
Jan 12, 2024 · Big Data

Building a Unified Data Empowerment Layer with Apache Kyuubi at GF Securities

The article describes how GF Securities designed and implemented a unified big‑data empowerment layer based on Apache Kyuubi to address data‑centric challenges, improve efficiency, ensure controllable governance, and support agile data scenarios across ingestion, processing, storage, and security.

Apache KyuubiBig DataData Empowerment
0 likes · 33 min read
Building a Unified Data Empowerment Layer with Apache Kyuubi at GF Securities
Data Thinking Notes
Data Thinking Notes
Jan 9, 2024 · Fundamentals

How to Build an Effective Enterprise Data Governance Framework

Designing a data governance system involves defining data architecture, standards, and master data, documenting mechanisms, aligning them with actual business and analytical data processes, forming joint teams for specialized governance activities, and institutionalizing these practices through formal processes to sustain continuous data capability across the enterprise.

Data ArchitectureData GovernanceEnterprise Data
0 likes · 3 min read
How to Build an Effective Enterprise Data Governance Framework
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 5, 2024 · Big Data

Tencent PCG Data Governance System Overview

This article presents a comprehensive overview of Tencent PCG's data governance system, describing its challenges, four‑stage solution architecture—including data governance overview, meta‑warehouse construction, asset‑scoring framework, and a one‑stop governance workbench—along with detailed mechanisms such as lineage analysis, rule‑engine driven governance items, and cost‑aware asset scoring.

Asset ScoringData GovernanceLineage
0 likes · 13 min read
Tencent PCG Data Governance System Overview
Data Thinking Notes
Data Thinking Notes
Jan 2, 2024 · Big Data

How a Three-Dimensional Data Governance Model Breaks Silos and Boosts Efficiency

Enterprise data governance faces challenges like information silos, departmental walls, and unclear responsibilities; adopting a three‑dimensional “business‑technology‑organization” framework—setting standards, optimizing processes, and innovating structures—helps eliminate these obstacles, enhance collaboration, improve data quality, and drive cost‑saving, efficiency, and innovation.

Big DataData GovernanceData Quality
0 likes · 10 min read
How a Three-Dimensional Data Governance Model Breaks Silos and Boosts Efficiency
DataFunSummit
DataFunSummit
Jan 2, 2024 · Big Data

Data Quality Governance: From Compliance to Reasonableness – Tools, Techniques, and Key Technologies

This article explores how data collection quality can be elevated from mere compliance to true reasonableness by introducing a comprehensive quality‑review toolchain, visual comparison methods, intelligent rule‑based detection, and self‑diagnosis utilities, while also detailing the underlying sample‑library and three‑layer architecture that power these capabilities.

Data Governancequality inspectionvisual analytics
0 likes · 21 min read
Data Quality Governance: From Compliance to Reasonableness – Tools, Techniques, and Key Technologies
Data Thinking Notes
Data Thinking Notes
Dec 28, 2023 · Big Data

How Xiaomi Built a Scalable Metric System: Best Practices and Methodology

This article explains Xiaomi's end‑to‑end metric system construction, covering the definition of metrics, business pain points, the OSM (Object‑Strategy‑Measure) model, MECE principle, model design guidelines, data‑warehouse implementation, metric management, and the resulting data‑driven workflow across the company.

Big DataData GovernanceData Warehouse
0 likes · 10 min read
How Xiaomi Built a Scalable Metric System: Best Practices and Methodology
DataFunTalk
DataFunTalk
Dec 28, 2023 · Product Management

Building an Effective Data Platform: Insights and Practices from Tencent's Senior Product Manager

Senior Tencent product manager He Zhichao shares his experience and methodology for creating a high‑quality data platform, covering the transition from technical roles to product, understanding data users’ needs, the Euler asset‑factory implementation, product‑manager best practices, and solutions to common data‑engineering challenges.

Data GovernanceData PlatformDataOps
0 likes · 16 min read
Building an Effective Data Platform: Insights and Practices from Tencent's Senior Product Manager
DataFunTalk
DataFunTalk
Dec 26, 2023 · Artificial Intelligence

The Evolution of AI and Its Challenges in the Data Industry

This article reviews the historical development of artificial intelligence, explains how AI technologies such as large language models are reshaping data processing and analysis, and discusses the practical challenges, trust issues, and governance requirements when applying AI to the data industry.

Data GovernanceData IndustryGPT
0 likes · 10 min read
The Evolution of AI and Its Challenges in the Data Industry
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Dec 26, 2023 · Big Data

How Panasonic Overcame Data Silos: A Big Data Governance Journey

Panasonic's digital transformation case study details the challenges of fragmented data across 64 subsidiaries, the strategic adoption of a serverless big‑data platform, governance milestones from 2021 to 2023, tool comparisons, standardization efforts, talent development, and future outlook driven by five core values.

Big DataData GovernanceData Platform
0 likes · 15 min read
How Panasonic Overcame Data Silos: A Big Data Governance Journey
DataFunSummit
DataFunSummit
Dec 16, 2023 · Artificial Intelligence

Enterprise Large Model Deployment: Data Governance, Fine‑Tuning Strategies, and Cost Economics

The article examines how enterprises can adopt domain‑specific large models by addressing talent and cost challenges, outlining self‑supervised pre‑training, instruction fine‑tuning, data governance for unstructured data, dataset balance, model‑type selection, and integrated product solutions to achieve efficient, high‑performance AI deployments.

AI deploymentData GovernanceEnterprise AI
0 likes · 13 min read
Enterprise Large Model Deployment: Data Governance, Fine‑Tuning Strategies, and Cost Economics