Author

Big Data Tech Team

Focuses on big data, data analysis, data warehousing, data middle platform, data science, Flink, AI and interview experience, side‑hustle earning and career planning.

Articles

Likes

Views

Comments

Latest from Big Data Tech Team

96 recent articles

Big Data Tech Team

Nov 2, 2025 · Big Data

Data Governance Blueprint: Naming Rules, Lifecycle Levels, and Layered Architecture

Explore a comprehensive data governance guide covering naming conventions, data lifecycle classifications, layered architecture standards, inter-layer calling rules, and model design principles, providing practical standards and best practices for building robust, maintainable data warehouses and analytics platforms.

Data LifecycleData WarehouseNaming Conventions

0 likes · 9 min read

Data Governance Blueprint: Naming Rules, Lifecycle Levels, and Layered Architecture

Big Data Tech Team

Oct 30, 2025 · Big Data

Mastering the ADS Layer: Design Principles, Modeling, and Real‑Time Data Services

This article provides a comprehensive analysis of the ADS (Application Data Service) layer in a data‑warehouse architecture, covering its core positioning, design goals, modeling strategies, dimension‑optimization techniques, API services, typical challenges, and practical best‑practice recommendations for high‑performance, flexible, and secure data delivery.

ADS layerETLSQL

0 likes · 8 min read

Mastering the ADS Layer: Design Principles, Modeling, and Real‑Time Data Services

Big Data Tech Team

Oct 29, 2025 · Fundamentals

Why Unified Data Modeling Matters: From Conceptual Design to Physical Implementation

The article explains how inconsistent "customer ID" fields across systems stem from a lack of unified data models, defines the difference between data modeling and data models, outlines three modeling stages, and compares three major modeling approaches—normative, dimensional, and entity—highlighting their purposes, processes, and trade‑offs.

conceptual modelingdata governancedatabase design

0 likes · 12 min read

Why Unified Data Modeling Matters: From Conceptual Design to Physical Implementation

Big Data Tech Team

Oct 28, 2025 · Big Data

From Data Chaos to Decision Engine: A Step‑by‑Step Guide to Offline Data Warehouse Governance

This article walks you through why unmanaged data warehouses fail, outlines three golden governance principles, details five practical implementation steps—from building a data lineage map to creating business‑driven quality dashboards—and shares real‑world case studies and common pitfalls to help turn your data warehouse into a trusted decision‑making engine.

Data WarehouseData qualitybusiness intelligence

0 likes · 11 min read

From Data Chaos to Decision Engine: A Step‑by‑Step Guide to Offline Data Warehouse Governance

Big Data Tech Team

Oct 26, 2025 · Big Data

Data Domain vs Subject Area: Clear Differences and Practical Guide

This article explains the distinct concepts of data domain and subject area, uses a library‑vs‑bookstore analogy, presents a real e‑commerce case, compares them in a concise table, and offers best‑practice steps and common pitfalls to help data teams design efficient data architectures.

Data DomainData ModelingData Warehouse

0 likes · 8 min read

Data Domain vs Subject Area: Clear Differences and Practical Guide

Big Data Tech Team

Oct 23, 2025 · Industry Insights

How to Build a Reusable, Well‑Designed Data Warehouse Model

This article analyzes why analysts and data engineers clash over non‑reusable data models, presents metrics such as cross‑layer reference rate and model reuse coefficient, and outlines a step‑by‑step framework—including ODS takeover, subject‑domain mapping, dimension consistency, fact‑table integration, development best practices, and tool support—to transform siloed warehouses into a shared data‑platform.

best practicesbig datadata governance

0 likes · 15 min read

How to Build a Reusable, Well‑Designed Data Warehouse Model

Big Data Tech Team

Oct 20, 2025 · Product Management

How to Build a Closed‑Loop Growth Metric System for Video Apps

This guide explains how to build a closed‑loop growth metric system and applies it to a video app, detailing metric design, data collection, analysis, hypothesis testing, validation, and deployment of optimization strategies to improve content submission rates.

Video Appdata analyticsgrowth analysis

0 likes · 5 min read

How to Build a Closed‑Loop Growth Metric System for Video Apps

Big Data Tech Team

Oct 12, 2025 · Databases

Why ClickHouse Dominates OLAP: Features, Configurations, Table Engines and Real‑World Use Cases

This article provides an in‑depth technical overview of ClickHouse, covering its OLAP‑focused architecture, key performance features, detailed configuration files, a comprehensive comparison of its many table engines, common troubleshooting tips, and real‑world deployment patterns for recommendation and advertising systems.

ClickHouseDatabase ConfigurationKafka engine

0 likes · 68 min read

Why ClickHouse Dominates OLAP: Features, Configurations, Table Engines and Real‑World Use Cases

Big Data Tech Team

Oct 10, 2025 · Big Data

12 Essential Hive SQL Optimization Tricks to Boost Query Performance

This article presents twelve practical Hive SQL tuning techniques—ranging from avoiding COUNT(DISTINCT) to configuring parallel execution, reducer settings, and strict mode—to help data engineers reduce data skew, eliminate small files, improve resource utilization, and significantly accelerate query execution in large‑scale data warehouse environments.

Data WarehouseHiveQuery Performance

0 likes · 11 min read

12 Essential Hive SQL Optimization Tricks to Boost Query Performance

Big Data Tech Team

Sep 17, 2025 · Big Data

How to Build a Scalable Tag System for Recommendation Engines

This article explains why a robust tag system is essential for recommendation and mining strategies, outlines the hierarchy of entity, concept, and theme tags, and provides practical principles, architecture, and step‑by‑step methods for constructing and managing tags in large‑scale data platforms.

big datadata architecturedata labeling

0 likes · 14 min read

How to Build a Scalable Tag System for Recommendation Engines