Tagged articles
4 articles
Page 1 of 1
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 5, 2024 · Big Data

Tencent PCG Data Governance System Overview

This article presents a comprehensive overview of Tencent PCG's data governance system, describing its challenges, four‑stage solution architecture—including data governance overview, meta‑warehouse construction, asset‑scoring framework, and a one‑stop governance workbench—along with detailed mechanisms such as lineage analysis, rule‑engine driven governance items, and cost‑aware asset scoring.

Asset ScoringData GovernanceLineage
0 likes · 13 min read
Tencent PCG Data Governance System Overview
Ctrip Technology
Ctrip Technology
Nov 23, 2023 · Big Data

Optimizing Data Warehouse Timeliness Using Metadata Lineage

This article presents a metadata‑driven approach to improve data warehouse timeliness by extracting upstream lineage, identifying over‑layered, duplicate, and critical‑path tasks, and applying targeted scheduling and code‑level optimizations, demonstrated with a hotel order wide‑table case study.

DAGData WarehouseLineage
0 likes · 7 min read
Optimizing Data Warehouse Timeliness Using Metadata Lineage
Youzan Coder
Youzan Coder
Aug 3, 2018 · Big Data

Youzan Data Warehouse Metadata System: From Manual Tables to Metadata‑Driven Architecture

Youzan’s data‑warehouse metadata system evolved from manually maintained tables to an automated data dictionary and finally to a metadata‑driven architecture that automatically captures technical, business, and process metadata, visualizes lineage, tracks resource usage, manages synchronization rules and permissions, and now aims to improve novice usability with visual models and impact‑analysis tools.

Big DataData WarehouseHive
0 likes · 11 min read
Youzan Data Warehouse Metadata System: From Manual Tables to Metadata‑Driven Architecture