Tagged articles
data warehousing
25 articles · Page 1 of 1
This article outlines the eight core modules of enterprise data architecture—data source, integration, storage, processing, modeling, governance, service, and operations—explaining how each layer ensures data flows reliably from source systems to business consumption while maintaining quality, consistency, and operational stability.
Data ModelingData PipelineFineDataLink
0 likes · 21 min read

The article recounts how a data‑warehouse team built the Harness framework to turn AI‑generated SQL assistance into a fully engineered, end‑to‑end pipeline, addressing four key pain points—semantic drift, precision, rollback cost, and SLA constraints—through a seven‑layer architecture, skill registry, state persistence, and evidence‑based human‑in‑the‑loop checks.
AILLMautomation
0 likes · 36 min read

This article details how a data‑warehouse team built a seven‑layer Harness framework to overcome AI‑coding challenges—semantic drift, strict constraints, and cross‑session context—enabling reliable, end‑to‑end production‑grade wide‑table delivery with up to 25× speedup and near‑zero side‑effects.
AILLM Engineeringautomation
0 likes · 32 min read

This article explains what materialized views are, outlines their advantages such as query acceleration, lightweight ETL, and lake‑warehouse integration, classifies them by sync mode, table count, and refresh strategy, and highlights their limitations and best‑practice recommendations for production use.
Database PerformanceETLQuery Optimization
0 likes · 6 min read

The article explains ETL fundamentals, common pitfalls like data quality gaps and tool mismatch, optimization strategies such as layered modeling and hybrid architectures, and compares open-source, commercial, and cloud-native ETL tools for enterprise visualization needs.
AWS GlueCDCETL
0 likes · 14 min read

The article presents a cloud‑native distributed Data Warebase that unifies relational, NoSQL, search and analytical capabilities into a single horizontally‑scalable system, reducing data‑access barriers and improving developer productivity while addressing consistency, latency, cost and operational complexity.
NoSQLSQLcloud-native
0 likes · 33 min read

The article describes how a real‑time data warehouse supporting ad‑delivery metrics adopts both technical and business‑side chaos‑engineering, using red‑blue team drills to inject faults, monitor indicator anomalies, and refine response procedures, thereby enhancing early risk detection, system resilience, and overall data stability for the advertising platform.
backend developmentchaos engineeringdata quality
0 likes · 16 min read

Discover how GaussDB(DWS) HStore tables combine columnar storage with Delta capabilities to support high‑concurrency real‑time data ingestion, upsert operations, and ultra‑fast analytical queries, while offering full ACID consistency, strong compression, and practical configuration tips for developers.
ColumnarDatabase StorageGaussDB
0 likes · 8 min read

The DataFun Summit 2023 Real‑Time Computing Forum showcases a series of expert talks on Apache Flink, stream‑batch integration, cloud‑native streaming databases, and large‑scale real‑time data warehousing, featuring speakers from Alibaba Cloud, Taobao, Didi, Ant Group and RisingWave.
Cloud NativeFlinkReal-time Computing
0 likes · 8 min read

The article explains the fundamental differences between OLTP (online transaction processing) and OLAP (online analytical processing), describes how ETL bridges the two, and provides a detailed side‑by‑side comparison of their characteristics, purposes, and design considerations.
ETLOLAPOLTP
0 likes · 9 min read


21CTOJun 20, 2023 · Fundamentals
ETL extracts, transforms, then loads data, while ELT extracts, loads, and transforms later, each offering distinct advantages; the article compares their processes, key differences, and factors such as data volume, complexity, latency, and cost to help businesses choose the optimal integration approach.
ELTdata integrationdata warehousing
0 likes · 12 min read

OLAP (Online Analytical Processing) and OLTP (Online Transaction Processing) are two distinct data processing systems—OLAP optimized for complex, multidimensional analysis and business intelligence, while OLTP handles high‑volume, real‑time transactional workloads—each serving different purposes, and often used together to drive data‑driven decision making.
OLAPOLTPdata warehousing
0 likes · 10 min read

The article presents a technical Q&A covering the challenges of wide tables and historical data retrieval, the recommendation to separate public and private tracking parameters, methods for validating tracking data using automated rules and manual checks, and announces DataFun's 5‑year anniversary series on big data and AI.
data validationdata warehousingtracking parameters
0 likes · 3 min read

The talk explains how NetEase Cloud Music leverages multi‑dimensional analysis across its social innovation apps, detailing business background, use‑case scenarios, technology choices, data‑platform architecture, and future plans to enable self‑service analytics and improve data efficiency.
Multi-dimensional Analysiscloud musicdata warehousing
0 likes · 12 min read

Huolala’s data‑engineer Yang Qiuji shares how the company’s OLAP platform progressed from Druid (OLAP 1.0) to ClickHouse (OLAP 2.0) and finally to Apache Doris (OLAP 3.0), detailing business drivers, technical evaluations, POC results, stability measures, and future roadmap.
Apache DorisOLAPbig data
0 likes · 19 min read

This article explains how to construct a real‑time data warehouse by combining Flink CDC for end‑to‑end change data capture with StarRocks' high‑performance OLAP engine, detailing the architectural challenges, optimization techniques, and a practical e‑commerce case study.
Flink CDCOLAPStarRocks
0 likes · 16 min read

This article explains OLAP as a core data‑warehouse component that enables fast, multidimensional analysis for business intelligence, describes the structure of OLAP cubes, outlines basic operations such as drill‑down, roll‑up, slice‑and‑dice and pivot, compares MOLAP, ROLAP and HOLAP, and discusses OLAP’s relationship with OLTP and cloud architectures.
HOLAPMOLAPOLAP
0 likes · 12 min read

This article explains how data-driven decision making evolves from simple Excel and Python analysis to robust data warehouses, introduces star‑schema dimension modeling, and demonstrates practical integration of Alibaba Cloud MaxCompute with Tableau for interactive OLAP‑style analytics.
MaxComputeOLAPSQL
0 likes · 7 min read

This article shares a non‑CS graduate's interview experience, study methods, and a detailed list of common interview questions covering Java fundamentals, data‑warehouse concepts, Spark, Kafka, Zookeeper, HBase, and Elasticsearch, along with personal reflections on advanced interview expectations.
Sparkdata warehousing
0 likes · 6 min read

TiDB, an open‑source distributed relational database, separates compute and storage, offers MySQL compatibility, supports both OLTP and OLAP workloads, and provides HTAP capabilities, with real‑world use cases ranging from MySQL sharding to full replacement, data warehousing, and serving as a modular component.
HTAPMySQL CompatibilityTiDB
0 likes · 8 min read

The article explains the two main types of data processing—OLTP for real‑time transactional workloads and OLAP for analytical data‑warehousing tasks—detailing their distinct characteristics, resource demands, typical features, major vendor products, and a five‑point comparison of their design and usage.
OLAPOLTPdata warehousing
0 likes · 6 min read

This article explains why raw OLAP Cubes consume exponential storage, then details six practical dimensionality‑reduction methods—Aggregation Group, Mandatory Dimension, Joint Dimension, Derived Dimension, Hierarchy Dimension, and Partial Cube—showing how each can dramatically shrink materialized tables while preserving query performance.
Cube OptimizationOLAPRubik
0 likes · 10 min read

This article explains the fundamentals of OLAP cubes, describes how Transwarp Rubik enables visual cube design and materialization, and walks through key concepts such as dimension models, hierarchies, and the tool's management features to accelerate multidimensional analytics.
Cube DesignOLAPTranswarp Rubik
0 likes · 9 min read

Greenplum is an open‑source, massively parallel processing (MPP) database built on PostgreSQL, offering ANSI‑SQL compliance, distributed ACID transactions, linear scalability, polymorphic storage, advanced optimizers, and extensive ecosystem integrations, making it suitable for large‑scale data warehousing, analytics, and big‑data workloads.
GreenplumMPPPolymorphic Storage
0 likes · 15 min read


ITPUBAug 18, 2016 · Databases
An experienced DBA shares a real-world case of optimizing a nightly Oracle reporting pipeline, detailing how partitioned tables, truncate operations, table compression, disabling logging, and parallel execution reduced a 20‑hour data extraction to under one hour, and compiles community‑sourced tuning tips for large‑scale data warehouses.
OraclePerformance TuningSQL Optimization
0 likes · 14 min read
