Tagged articles

data catalog

19 articles · Page 1 of 1
Data Integration and Governance
Data Integration and Governance
Jul 14, 2026 · Big Data

Why Every Data Asset Needs Catalog, Standards, Quality, and Lineage

Enterprises often build many systems and reports, but without a systematic data‑asset management framework—comprising a data catalog, unified standards, quality controls, and lineage tracing—issues like inconsistent metrics, unknown data sources, and hard‑to‑diagnose report errors persist, undermining reliable decision‑making.

data asset managementdata catalogdata lineage
0 likes · 12 min read
Why Every Data Asset Needs Catalog, Standards, Quality, and Lineage
Smart Sea Tide
Smart Sea Tide
Jun 11, 2026 · Fundamentals

Understanding Metadata: Definitions, Types, and Key Functions

The article defines metadata as data about data, illustrates it with everyday examples, classifies it into technical, business, and management categories, and outlines eight core functions—including data asset mapping, fast search, flexible views, tagging, insight, lineage, impact analysis, and mapping—to improve data understanding, efficiency, quality, and cross‑system integration.

Data GovernanceData ManagementMetadata
0 likes · 9 min read
Understanding Metadata: Definitions, Types, and Key Functions
Data Integration and Governance
Data Integration and Governance
Apr 16, 2026 · Big Data

Why Is Metadata Management So Hard? A Practical Guide to Overcoming the Challenges

The article analyzes why metadata management often stalls in enterprises—due to scattered, inactive, and business‑misaligned metadata—and outlines a step‑by‑step approach to define core asset, relationship, and semantic information, automate collection from data flows, and build a queryable metadata network.

Data GovernanceData IntegrationMetadata
0 likes · 11 min read
Why Is Metadata Management So Hard? A Practical Guide to Overcoming the Challenges
Data Integration and Governance
Data Integration and Governance
Jan 8, 2026 · Big Data

How to Design Data Architecture That Keeps Up With Rapid Business Changes

When business requirements change every few days, traditional data architectures become rigid, tightly coupled, and slow, causing endless cycles of overtime; this article analyzes the root causes and presents a layered, configurable, and API‑driven approach—including moderate redundancy, data catalogs, and decoupled layers—to enable data systems to adapt quickly and reliably.

APIData Modelingconfigurable processing
0 likes · 9 min read
How to Design Data Architecture That Keeps Up With Rapid Business Changes
Data Integration and Governance
Data Integration and Governance
Dec 2, 2025 · Operations

How to Manage Data Assets? The Four Key Steps

The article explains why treating data as an asset matters, distinguishes data asset management from traditional data governance, and outlines four practical steps—inventory, standardization, quality & security, and value realization—to turn raw data into a strategic business resource.

Data GovernanceMetadatadata asset management
0 likes · 10 min read
How to Manage Data Assets? The Four Key Steps
Data Thinking Notes
Data Thinking Notes
Aug 13, 2024 · Fundamentals

How to Define, Classify, and Catalog Your Enterprise Data Assets

This article explains what data assets are, how to categorize them by structure and source, outlines a six‑step inventory process, describes a hierarchical catalog architecture, and highlights the four key benefits of a unified data asset directory for modern enterprises.

Data GovernanceData Managementdata assets
0 likes · 11 min read
How to Define, Classify, and Catalog Your Enterprise Data Assets
Data Thinking Notes
Data Thinking Notes
Jul 9, 2024 · Big Data

How to Build a Robust Enterprise Data Asset Catalog for Better Governance

This article explains why a comprehensive data asset catalog is essential for modern enterprises, outlines its core components such as inventory, metadata, data lineage, standards and access control, details step‑by‑step construction methods, and highlights key applications in governance, quality, compliance, architecture and valuation.

Big DataData Governancedata catalog
0 likes · 13 min read
How to Build a Robust Enterprise Data Asset Catalog for Better Governance
Data Thinking Notes
Data Thinking Notes
Nov 19, 2023 · Fundamentals

How to Build an Effective Data Asset Management Framework for Enterprises

This article explains why enterprises need a data asset framework, outlines its key components such as catalog management, policy support, and development trends, and provides a step‑by‑step guide with visual diagrams for constructing and operating a comprehensive data asset management system.

Data Governancedata catalogdata quality
0 likes · 5 min read
How to Build an Effective Data Asset Management Framework for Enterprises
Architects Research Society
Architects Research Society
Aug 2, 2023 · Fundamentals

Data Fabric Architecture: Three Patterns, Core Technical Components, and Inherent Limitations

The article explains data fabric architecture as a promising approach for enabling data exchange across distributed systems, outlines its three design patterns, describes key technical components such as data virtualization, data catalog, and knowledge graphs, and discusses the trade‑offs, costs, and limitations that organizations must consider.

Data FabricData IntegrationKnowledge Graph
0 likes · 17 min read
Data Fabric Architecture: Three Patterns, Core Technical Components, and Inherent Limitations
Data Thinking Notes
Data Thinking Notes
Jul 26, 2023 · Big Data

How to Build an Effective Data Asset Catalog for Enterprise Data Governance

This article explains what data assets are, why a data asset catalog is essential for data governance, and provides a step‑by‑step framework—including identification criteria, value dimensions, construction phases, tool support, and core functional modules—to help enterprises systematically create, manage, and leverage a data asset catalog.

Data AssetData Governancedata catalog
0 likes · 16 min read
How to Build an Effective Data Asset Catalog for Enterprise Data Governance
DataFunSummit
DataFunSummit
Apr 23, 2023 · Fundamentals

Data Governance Practices and Implementation Path at Dipu Technology

This article presents Dipu Technology's comprehensive data governance methodology, covering construction paths, a typical enterprise digital platform framework, core governance components, practical case studies, and a Q&A session that together illustrate how businesses can design, implement, and sustain effective data governance across the organization.

Data GovernanceData ManagementEnterprise Architecture
0 likes · 19 min read
Data Governance Practices and Implementation Path at Dipu Technology
Volcano Engine Developer Services
Volcano Engine Developer Services
Apr 19, 2023 · Databases

Why MySQL Can Power JanusGraph: Design, Challenges, and Performance Insights

This article explores how MySQL can serve as a JanusGraph storage backend, detailing the design choices, multi‑tenant architecture, key‑column‑value model implementation, encountered issues such as connection timeouts and deadlocks, and performance testing results that demonstrate its suitability for medium‑scale Data Catalog services.

JanusGraphMySQLStorage Backend
0 likes · 17 min read
Why MySQL Can Power JanusGraph: Design, Challenges, and Performance Insights
ByteDance Data Platform
ByteDance Data Platform
Jun 8, 2022 · Backend Development

How ByteDance Optimized Data Catalog Performance with Apache Atlas and JanusGraph

This article details ByteDance's 2021 overhaul of its Data Catalog system, the performance regressions encountered after switching to Apache Atlas, and the step‑by‑step backend optimizations—including JanusGraph tuning, Gremlin query refactoring, parallel processing, and write‑path improvements—that reduced latency from minutes to seconds.

Apache AtlasJanusGraphdata catalog
0 likes · 12 min read
How ByteDance Optimized Data Catalog Performance with Apache Atlas and JanusGraph
Architect
Architect
May 25, 2022 · Big Data

Metadata Infrastructure and Governance in Bilibili's Data Platform

The article details how Bilibili built a unified metadata infrastructure—including a URN‑based model, collection pipelines, quality assurance, storage in TiDB/ES/HugeGraph, and query services—to support data discovery, lineage, impact analysis, and governance across its growing data platform.

Big DataData GovernanceETL
0 likes · 21 min read
Metadata Infrastructure and Governance in Bilibili's Data Platform
ByteDance Data Platform
ByteDance Data Platform
Apr 27, 2022 · Big Data

How ByteDance Built a Scalable Data Catalog: Key Technologies and Future Plans

ByteDance’s Data Catalog article details the system’s unified metadata model, standardized ingestion connectors, search optimization techniques, lineage capabilities, and storage layer enhancements, highlighting key technical designs, performance improvements, and future work to advance data governance and asset utilization.

Search Optimizationdata catalogdata lineage
0 likes · 12 min read
How ByteDance Built a Scalable Data Catalog: Key Technologies and Future Plans
Snowball Engineer Team
Snowball Engineer Team
Sep 24, 2019 · Big Data

Snowball Data Middle Platform (AIBO): Architecture, Capabilities, and Future Outlook

The article introduces Snowball's AIBO data middle platform, detailing its storage‑compute separation architecture, core capabilities such as data integration, catalog, tagging, analysis tools, micro‑service data APIs, and outlines future enhancements for security, lineage, and continuous business‑driven iteration.

Big DataData AnalysisData Integration
0 likes · 12 min read
Snowball Data Middle Platform (AIBO): Architecture, Capabilities, and Future Outlook