Beijing SF i-TECH City Technology Team
May 30, 2024 · Big Data
Data Lineage System Design and Implementation for Big Data Platforms
This article presents a comprehensive data lineage system (Data-Lineage) for big data platforms, addressing challenges in heterogeneous data sources, multiple execution engines, and complex dependencies through hook-based architecture and modular design.
SQL parsingbig data architecturedata lineage
0 likes · 12 min read