Tagged articles

102 articles

Page 1 of 2

May 16, 2026 · Industry Insights

How SelectDB Powers a Next‑Gen Real‑Time Data Warehouse for Banks

The article analyses the structural mismatch between banks' demand for instant data‑driven decisions and their legacy, component‑heavy architectures, then details how SelectDB’s high‑performance, unified MPP engine, schema‑change agility, and financial‑grade security enable a real‑time data‑warehouse platform that supports diverse banking scenarios from dashboards to fraud detection.

AI integrationDataMindMPP engine

0 likes · 19 min read

How SelectDB Powers a Next‑Gen Real‑Time Data Warehouse for Banks

DataFunSummit

Apr 4, 2026 · Databases

How Hologres 4.0 Unifies Real‑Time Data Warehousing and AI‑Native Analytics

This article analyzes the architectural evolution of Alibaba Cloud Hologres from a fragmented multi‑engine data stack to the All‑in‑One design of Hologres 4.0, detailing its multimodal search, AI‑native functions, performance benchmarks, resource governance, lake integration, and real‑world deployment scenarios.

AI-native analyticsHologrescloud database

0 likes · 12 min read

How Hologres 4.0 Unifies Real‑Time Data Warehousing and AI‑Native Analytics

Alibaba Cloud Big Data AI Platform

Dec 18, 2025 · Databases

Why Hologres Dynamic Table Beats Traditional Full Refresh for Real‑Time Data Warehousing

The article explains how Hologres Dynamic Table uses a stateful incremental refresh model to efficiently handle massive historical data with tiny daily updates, dramatically reducing latency and resource consumption compared with conventional full‑refresh pipelines across several real‑world join and aggregation scenarios.

Dynamic TableHologresIncremental Refresh

0 likes · 18 min read

Why Hologres Dynamic Table Beats Traditional Full Refresh for Real‑Time Data Warehousing

Baidu Geek Talk

Sep 24, 2025 · Big Data

How Feed Real‑Time Data Warehouse Was Re‑Engineered for Speed and Cost Savings

This article explains how Baidu’s Feed real‑time data warehouse was rebuilt using a pure streaming architecture, detailing the limitations of the previous stream‑batch design, the technical solutions—including core/non‑core data separation, metric calculation in streaming, and Parquet storage with Apache Arrow—and the resulting cost reductions, latency improvements, and future roadmap.

Apache ArrowBatch ProcessingParquet

0 likes · 17 min read

How Feed Real‑Time Data Warehouse Was Re‑Engineered for Speed and Cost Savings

Alibaba Cloud Big Data AI Platform

Sep 15, 2025 · Big Data

How a FinTech Firm Boosted Real‑Time Decision Making with StarRocks Data Warehouse

This case study details how Shuhe Technology, a leading fintech company, overcame data redundancy, low resource utilization, and slow reporting by adopting Alibaba Cloud EMR Serverless StarRocks for a unified, real‑time data warehouse, achieving standardized data pipelines, cost savings, and minute‑level decision latency.

Big DataFinTechStarRocks

0 likes · 8 min read

How a FinTech Firm Boosted Real‑Time Decision Making with StarRocks Data Warehouse

Ctrip Technology

Sep 2, 2025 · Big Data

How Ctrip Built a Near‑Real‑Time Lakehouse with Flink & Paimon

This article details Ctrip Business Travel’s implementation of a near‑real‑time data warehouse and lakehouse using Flink CDC and Apache Paimon, covering order wide‑table construction, automated ticket reminders, ad attribution, batch‑stream integration, and lessons on Partial Update, Aggregation, and Tag‑based incremental processing.

Batch-Stream IntegrationFlinkLakehouse

0 likes · 17 min read

How Ctrip Built a Near‑Real‑Time Lakehouse with Flink & Paimon

StarRocks

Jul 9, 2025 · Big Data

How Shopee Built a Near‑Real‑Time Data Warehouse with Paimon and StarRocks

Shopee combined the Paimon data lake with StarRocks and Flink to create a quasi‑real‑time warehouse, enabling fast task diagnostics and a high‑performance financial reconciliation system while dramatically reducing storage costs and latency through innovative ODS, snapshot, and branch table techniques.

FlinkPaimonStarRocks

0 likes · 13 min read

How Shopee Built a Near‑Real‑Time Data Warehouse with Paimon and StarRocks

DataFunSummit

Jun 19, 2025 · Big Data

How Shopee Leverages Paimon for Real‑Time Data Warehousing and Task Diagnosis

This article details Shopee's Data Infra team's use of the Paimon data lake to build near‑real‑time warehouses, accelerate ODS layers, implement a task‑diagnosis system, and create a reconciliation platform, while sharing future plans and a Q&A session.

Data LakeFlinkPaimon

0 likes · 12 min read

How Shopee Leverages Paimon for Real‑Time Data Warehousing and Task Diagnosis

Huolala Tech

May 14, 2025 · Big Data

How Lalamove Scaled Real‑Time Data Warehousing with Flink and Paimon

Lalamove’s international logistics platform transformed its real‑time data warehouse by leveraging Apache Flink and the Paimon lakehouse, addressing challenges of multi‑region data centers, time‑zone diversity, frequent upstream changes, and high costs, while improving scalability, latency, and operational efficiency across global markets.

Big DataFlinkPaimon

0 likes · 13 min read

How Lalamove Scaled Real‑Time Data Warehousing with Flink and Paimon

Bilibili Tech

Apr 8, 2025 · Big Data

Building a Real-Time Data Warehouse for B站 Game Business

To meet Bilibili’s rapidly expanding game business, the team built a unified real-time data warehouse using Hologres and Flink that replaces the traditional Lambda stack, delivering high-throughput writes, low-latency processing, seamless offline-online integration, global deployment, and real-time support for operations, advertising, and risk analytics.

Big Data ArchitectureData architecture case studyFlink

0 likes · 17 min read

Building a Real-Time Data Warehouse for B站 Game Business

iQIYI Technical Product Team

Mar 27, 2025 · Big Data

Cost‑Effective Real‑Time Data Warehouse 2.0: Migrating from Kafka to Iceberg

iQIYI transformed its real‑time data warehouse by replacing a costly Kafka‑based Lambda stack with a unified stream‑batch Iceberg lake, cutting storage expenses by 90%, halving compute costs, extending data retention, and delivering minute‑level freshness for 90% of use cases while preserving second‑level processing where needed.

Cost OptimizationFlinkIceberg

0 likes · 11 min read

Cost‑Effective Real‑Time Data Warehouse 2.0: Migrating from Kafka to Iceberg

Big Data Tech Team

Mar 25, 2025 · Big Data

How Apache Paimon Transforms Real‑Time Lakehouse Architecture

This article analyzes the limitations of a traditional Flink + Talos + Iceberg real‑time lakehouse, introduces Apache Paimon's lakehouse table format and LSM storage, and demonstrates three practical use cases—partial‑update widening, streaming upsert, and lookup join—showing cost, stability, and performance improvements while outlining future roadmap.

Apache PaimonFlinkLakehouse

0 likes · 16 min read

How Apache Paimon Transforms Real‑Time Lakehouse Architecture

Alibaba Cloud Big Data AI Platform

Mar 20, 2025 · Databases

Unlock Real‑Time Analytics with Hologres Dynamic Table: A Quick‑Start Guide

This article introduces Hologres Dynamic Table, explains its typical real‑time data‑warehouse scenarios, outlines the underlying architecture and its challenges, details the incremental and full‑refresh modes, provides usage steps, best‑practice recommendations, demo scenarios, and compares it with competing solutions.

Dynamic TableHologresIncremental Refresh

0 likes · 17 min read

Unlock Real‑Time Analytics with Hologres Dynamic Table: A Quick‑Start Guide

Alimama Tech

Mar 12, 2025 · Big Data

Design and Evolution of Alibaba Advertising Real-Time Data Warehouse

Alibaba Mama’s advertising platform migrated from a monolithic Flink‑Kafka pipeline to a layered Paimon lakehouse, adding DWS upsert support and multi‑layer storage, which delivers minute‑level data freshness, cuts latency by 2.5 hours, reduces resource use over 40 %, halves development effort and achieves ≥99.9 % availability.

AdvertisingAlibabaData Lake

0 likes · 18 min read

Design and Evolution of Alibaba Advertising Real-Time Data Warehouse

Alibaba Cloud Big Data AI Platform

Mar 11, 2025 · Databases

Mastering Hologres Compute Groups: Isolation, Elasticity, and Serverless Strategies

This guide explains Hologres compute group instances, covering the four core challenges of real‑time data warehouses, the architecture and benefits of elastic compute groups, time‑based elasticity, serverless computing, query queue, and step‑by‑step practices for management, authorization, connection, monitoring, and migration.

Compute GroupsHologresLoad Isolation

0 likes · 20 min read

Mastering Hologres Compute Groups: Isolation, Elasticity, and Serverless Strategies

Alibaba Cloud Big Data AI Platform

Feb 13, 2025 · Big Data

From Lambda to Lakehouse: Evolution of Real‑Time Data Warehouses with Hologres & Flink

This article traces the three‑generation evolution of real‑time data warehouses—from the Lambda architecture to a lakehouse approach—detailing how Hologres, Flink, and Dynamic Table technologies enable unified storage, multi‑mode computing, serverless execution, and high‑performance analytics in modern big‑data environments.

Dynamic TableFlinkHologres

0 likes · 15 min read

From Lambda to Lakehouse: Evolution of Real‑Time Data Warehouses with Hologres & Flink

DataFunSummit

Sep 20, 2024 · Databases

Key Topics and Abstracts from DataFun Summit: Graph DB, Vector DB, Real-Time Data Warehouses, and Cloud‑Native Solutions

The article presents a collection of technical abstracts from the DataFun Summit, covering XiaoHongShu's REDgraph distributed graph database, DingoDB's multimodal vector database, Tencent's Tianqiong autonomous data platform, real‑time data warehouse architectures at Douyin and Ant Group, and Alibaba Cloud's serverless ClickHouse offering, all aimed at advancing large‑scale data processing and analytics.

Big Datareal-time data warehouse

0 likes · 5 min read

Key Topics and Abstracts from DataFun Summit: Graph DB, Vector DB, Real-Time Data Warehouses, and Cloud‑Native Solutions

DataFunTalk

Sep 19, 2024 · Databases

Technical Topics Overview from DataFun Summit: Graph Database, Vector Database, Real-time Data Warehouse, and Cloud‑Native Solutions

The article presents a collection of technical overviews—including a graph database for distributed queries, a next‑generation vector database, real‑time data warehouse architectures at Douyin and Ant Group, a cloud‑native ClickHouse service, and best practices for financial data warehousing—while also explaining how to obtain the related e‑book.

Big DataCloud NativeGraph Database

0 likes · 4 min read

DataFunSummit

Sep 18, 2024 · Big Data

Data Summit Abstracts: Graph Database, Vector Database, Real-time Data Warehouse, and Cloud‑Native Analytics

The article presents a series of technical abstracts covering Xiaohongshu's distributed graph database, DingoDB's multimodal vector store, Tianqiong's autonomous data‑warehouse innovations, Douyin's storage‑based real‑time warehouse, financial‑grade real‑time warehousing, Alibaba Cloud ClickHouse Serverless, best practices in financial data governance, and 58.com’s user‑profile warehouse construction.

Big Datareal-time data warehouse

0 likes · 5 min read

Data Summit Abstracts: Graph Database, Vector Database, Real-time Data Warehouse, and Cloud‑Native Analytics

Data Thinking Notes

Aug 29, 2024 · Big Data

How ICBC Evolved Its Data Intelligence Architecture for Real‑Time Insights

At the 2024 Data Intelligence Conference, ICBC's Big Data and AI Lab detailed the evolution of its data intelligence platform, covering architectural redesign, real‑time data warehouse technology, unified intelligent data tools, and future development directions to boost efficiency and innovation.

Big DataData Platformarchitecture evolution

0 likes · 3 min read

How ICBC Evolved Its Data Intelligence Architecture for Real‑Time Insights

Alibaba Cloud Big Data AI Platform

Jul 26, 2024 · Databases

How Hologres Achieves Record‑Breaking Real‑Time Data Warehouse Performance

This article introduces Alibaba Cloud's Hologres real‑time data warehouse, explains its architecture, table and index types, and provides a step‑by‑step guide for setting up instances, importing data, and running OLAP and KV performance tests using TPC‑H benchmarks.

HologresOLAPPerformance Testing

0 likes · 12 min read

How Hologres Achieves Record‑Breaking Real‑Time Data Warehouse Performance

DataFunTalk

Jun 18, 2024 · Big Data

Real-time Data Warehouse Evolution with Data Lake: Architecture, Challenges, and Solutions

This article presents a comprehensive overview of the evolution from traditional Lambda‑based real‑time data warehouse solutions to a data‑lake‑integrated architecture, detailing the shortcomings of legacy designs, the iterative improvements made at JD Technology, and the technical and operational challenges encountered during implementation.

Data LakeLambda architectureStreaming

0 likes · 24 min read

Real-time Data Warehouse Evolution with Data Lake: Architecture, Challenges, and Solutions

DataFunSummit

Apr 18, 2024 · Big Data

Real‑time Data Warehouse Evolution with Data Lake: Architecture, Challenges, and Solutions

This article presents a comprehensive overview of JD Tech's real‑time data warehouse evolution, detailing the legacy Lambda‑based design, its shortcomings, the transition to a data‑lake‑integrated architecture, iterative improvements, encountered technical and non‑technical issues, and future outlooks.

Data LakeFlinkHudi

0 likes · 24 min read

Alibaba Cloud Big Data AI Platform

Jan 10, 2024 · Big Data

CaoCao Mobility's Real‑Time Data Warehouse: Hologres + Flink

This article details how CaoCao Mobility transformed its ride‑hailing platform by replacing a traditional Lambda architecture with an enterprise‑grade real‑time data warehouse built on Hologres and Flink, covering business motivations, architectural design, component capabilities, performance optimizations, operational safeguards, and future roadmap.

Data ArchitectureFlinkHologres

0 likes · 19 min read

CaoCao Mobility's Real‑Time Data Warehouse: Hologres + Flink

DataFunTalk

Aug 21, 2023 · Databases

Case Study: Building a Real‑Time Log Data Analysis Platform with Apache Doris at China Unicom

This article describes how China Unicom’s Western Innovation Research Institute designed and deployed a centralized, real‑time log analytics platform using Apache Doris, detailing the migration from Hive and ClickHouse, performance optimizations, storage cost reductions, and the resulting improvements in data ingestion, query speed, and operational efficiency.

Apache DorisBig DataCold‑Hot Data Management

0 likes · 18 min read

Case Study: Building a Real‑Time Log Data Analysis Platform with Apache Doris at China Unicom

WeiLi Technology Team

Aug 2, 2023 · Big Data

How to Build a Real-Time Data Warehouse: Architectures, Challenges, and Industry Practices

This article examines the growing demand for real‑time data warehouses, compares mature streaming frameworks, evaluates Lambda, Kappa and hybrid architectures, reviews industry implementations from Didi and OPPO, and proposes a standard‑layer + stream + data‑lake solution with Apache Paimon, Hudi, and Iceberg.

Apache FlinkKappa architectureLambda architecture

0 likes · 27 min read

How to Build a Real-Time Data Warehouse: Architectures, Challenges, and Industry Practices

Big Data Technology & Architecture

Jul 24, 2023 · Big Data

Real-time Data Warehouse Governance: Optimization Practices and Technical Enhancements

This article presents a comprehensive overview of the current challenges, platform architecture, governance planning, and technical optimizations—including Flink SQL, Kafka batch processing, and partitioned stream tables—used to improve resource efficiency, stability, and scalability of a large‑scale real‑time data warehouse.

Flink optimizationKafka batchResource Efficiency

0 likes · 25 min read

Real-time Data Warehouse Governance: Optimization Practices and Technical Enhancements

DataFunSummit

May 24, 2023 · Big Data

NetEase Cloud Music Real-Time Data Warehouse Architecture and Low‑Code Platform Practices

This article presents a comprehensive overview of NetEase Cloud Music's real‑time data warehouse architecture, its stream‑batch consistency model, the low‑code FastX platform implementation, and future plans for expanding lake‑house capabilities and high‑availability solutions.

FlinkKafkaLow‑code platform

0 likes · 18 min read

NetEase Cloud Music Real-Time Data Warehouse Architecture and Low‑Code Platform Practices

DataFunTalk

May 17, 2023 · Databases

Evolution of 360 Commercial Real-Time Data Warehouse and Apache Doris Deployment

This article details the three‑stage evolution of 360's real‑time data warehouse—from Storm + Druid + MySQL to Flink + Druid + TiDB and finally to Flink + Apache Doris—explaining architectural pain points, the reasons for choosing Doris, and how the new system delivers sub‑second query latency, strong consistency, and simplified operations across advertising scenarios.

Apache DorisBig DataData Consistency

0 likes · 17 min read

Evolution of 360 Commercial Real-Time Data Warehouse and Apache Doris Deployment

ByteDance Data Platform

Feb 15, 2023 · Databases

How ByteHouse Powers Real‑Time Data Warehousing at Scale

ByteHouse, a cloud‑native data warehouse built on ClickHouse, delivers ultra‑fast real‑time and massive offline analytics with elastic scaling, addressing business needs in ByteDance and the financial sector through optimized architecture, ROI‑driven monitoring, and comprehensive operational tools.

Big DataByteHouseclickhouse

0 likes · 16 min read

How ByteHouse Powers Real‑Time Data Warehousing at Scale

dbaplus Community

Jan 31, 2023 · Big Data

Building ByteDance’s Real‑Time Data Warehouse with Hudi: Architecture & Solutions

This article explains how ByteDance designed and deployed a real‑time data warehouse on a data lake using Hudi, detailing three business scenarios, the challenges of latency, consistency and resource usage, and the engineering solutions—including upserts, compaction services, indexing, and future unified storage plans.

Data LakeFlinkHudi

0 likes · 14 min read

Building ByteDance’s Real‑Time Data Warehouse with Hudi: Architecture & Solutions

DataFunSummit

Jan 24, 2023 · Databases

Practical Experience of Using Apache Doris for Real‑Time Data Warehouse at Tongcheng Data Science

This article details how Tongcheng Data Science built a real‑time analytical data warehouse using Apache Doris, covering business scenarios, the evolution from a legacy 1.0 architecture to a Doris‑based 2.0 design, deployment topology, development workflow, operational benefits, and future roadmap.

Apache DorisBig DataData Architecture

0 likes · 10 min read

Practical Experience of Using Apache Doris for Real‑Time Data Warehouse at Tongcheng Data Science

ITPUB

Jan 22, 2023 · Big Data

How Flink Table Store Powers Real‑Time Financial Data Warehousing

This article details a banking‑focused real‑time data‑warehouse solution that leverages Flink Table Store to handle both incremental fact‑table updates and full‑table dimension calculations, compares three traditional approaches, and explains data ingestion, query modes, export options, and future streaming‑warehouse directions.

BankingELTFlink

0 likes · 20 min read

How Flink Table Store Powers Real‑Time Financial Data Warehousing

Aikesheng Open Source Community

Jan 18, 2023 · Databases

Real-Time Data Warehouse Evaluation: ClickHouse vs StarRocks and Synchronization Strategies

This article shares practical experience comparing ClickHouse and StarRocks as real‑time data warehouses, outlines the project requirements, evaluates each system's suitability for log‑type and business‑type data, and describes CDC‑based synchronization methods from MySQL to both platforms.

CDCStarRocksclickhouse

0 likes · 8 min read

Real-Time Data Warehouse Evaluation: ClickHouse vs StarRocks and Synchronization Strategies

Ctrip Technology

Jan 12, 2023 · Big Data

Real-Time Data Warehouse Architecture and Practice at Ctrip Hotel

The article explains why enterprises need real-time data warehouses, compares Lambda and Kappa architectures, describes Ctrip Hotel's Lambda‑plus‑OLAP variant built with Flink and StarRocks, and details practical solutions for ordering, wide‑table generation, and data validation that enable billion‑row, low‑latency analytics.

CtripFlinkLambda architecture

0 likes · 10 min read

Real-Time Data Warehouse Architecture and Practice at Ctrip Hotel

Data Thinking Notes

Dec 23, 2022 · Big Data

How Real-Time Data Warehouses Power Modern Business: Architecture, Cases, and Best Practices

This article explains why real‑time data warehouses are becoming essential, outlines their goals, compares them with traditional offline warehouses, and presents detailed design patterns, naming conventions, and case studies from Didi, Kuaishou, Tencent, Youzan and other enterprises, highlighting challenges and solutions for streaming, storage, and query layers.

Big Data ArchitectureData LakeETL

0 likes · 49 min read

How Real-Time Data Warehouses Power Modern Business: Architecture, Cases, and Best Practices

DataFunTalk

Nov 28, 2022 · Databases

Optimizing Real‑Time Data Warehouse with Apache Doris at 360 DataTech

Facing stricter security, accuracy, and latency demands, 360 DataTech rebuilt its real‑time data warehouse by selecting Apache Doris for its high‑performance writes, SQL compatibility, low operational complexity, and active community, then detailed the architecture, ingestion, query acceleration, monitoring, troubleshooting, and future plans.

Apache DorisData Import OptimizationSQL acceleration

0 likes · 19 min read

Optimizing Real‑Time Data Warehouse with Apache Doris at 360 DataTech

DataFunTalk

Nov 17, 2022 · Big Data

Building a Unified High‑Speed Analytics Platform with StarRocks at Cross‑Express

Cross‑Express consolidated multiple big‑data engines into a unified, high‑performance analytics platform using StarRocks, achieving millisecond‑level query latency, real‑time data warehousing, significant cost savings, and improved multi‑scenario business applications; the initiative also simplified BI development, reduced hardware requirements, and set a roadmap for future engine enhancements.

OLAPStarRocksreal-time data warehouse

0 likes · 10 min read

Building a Unified High‑Speed Analytics Platform with StarRocks at Cross‑Express

Liulishuo Tech Team

Nov 17, 2022 · Big Data

Real‑time Data Warehouse Architecture and Technical Solution at Liulishuo

This article describes Liulishuo's migration to a Flink‑based real‑time data warehouse, covering background, benefits, technology selection (storage, Flink platform, dimension table connectors), overall architecture, concrete Hudi and Elasticsearch ingestion examples, processing SQL, and future outlook for unified batch‑streaming storage.

ElasticsearchFlinkHudi

0 likes · 15 min read

Real‑time Data Warehouse Architecture and Technical Solution at Liulishuo

DataFunTalk

Sep 17, 2022 · Big Data

Real-Time Data Warehouse Practices with Hudi at ByteDance

This presentation details ByteDance's real‑time data‑warehouse implementations using Apache Hudi, covering scenario classifications, challenges of traditional offline warehouses, practical solutions for ingestion, upsert, validation, indexing, query optimization, and future plans for extensible indexing and unified batch‑stream processing.

Data LakeHudiStreaming

0 likes · 16 min read

Real-Time Data Warehouse Practices with Hudi at ByteDance

DataFunSummit

Sep 15, 2022 · Big Data

Amazon Real-Time Data Warehouse Architecture and Services Overview

This article reviews the evolution of data warehouse architectures, explains Amazon's serverless real-time data lake design and its key services, and details Amazon Redshift's cloud-native real-time data warehouse features, streaming ingestion, and integrated machine learning capabilities.

AWSAmazon RedshiftBig Data

0 likes · 10 min read

Amazon Real-Time Data Warehouse Architecture and Services Overview

Alibaba Cloud Big Data AI Platform

Aug 25, 2022 · Big Data

How Alibaba Cloud Flink + Hologres Power Real‑Time Data Warehouses

This article explains how Alibaba Cloud Flink and Hologres combine to deliver a one‑stop, cloud‑native real‑time data‑warehouse solution that supports low‑latency ingestion, full‑incremental CDC, automatic schema evolution, high‑performance OLAP and online serving, and simplifies ETL/ELT pipelines for enterprise analytics.

FlinkHologrescloud computing

0 likes · 25 min read

How Alibaba Cloud Flink + Hologres Power Real‑Time Data Warehouses

Zhuanzhuan Tech

Aug 24, 2022 · Big Data

Real-Time Data Warehouse Architecture Using Flink: Design, Implementation, and Challenges

This article details the design and implementation of a real‑time data warehouse for an advertising platform, covering business background, challenges, a Lambda‑based architecture, Flink stream processing setup, ETL logic, sink handling, and performance results, concluding with future improvement directions.

ETLFlinkLambda architecture

0 likes · 11 min read

Real-Time Data Warehouse Architecture Using Flink: Design, Implementation, and Challenges

Alibaba Cloud Big Data AI Platform

Aug 18, 2022 · Big Data

How Hologres Achieves Ultra‑High‑Throughput Real‑Time Writes in Big Data Warehouses

This article explores the challenges of real‑time data ingestion at massive scale, explains Hologres' innovative upsert model, performance optimizations, and compares its capabilities with other data‑warehouse solutions, demonstrating how it delivers low‑latency, high‑throughput writes for big‑data analytics.

High ThroughputHologresUpsert

0 likes · 24 min read

How Hologres Achieves Ultra‑High‑Throughput Real‑Time Writes in Big Data Warehouses

Alibaba Cloud Big Data AI Platform

Aug 12, 2022 · Big Data

How Hologres Transformed a Real‑Time Data Warehouse: Cutting Costs & Boosting Performance

This case study details how an online education platform migrated its real‑time data warehouse from Kudu to Alibaba Cloud Hologres, overcoming technical bottlenecks, reducing operational costs by nearly a million dollars annually, and achieving higher throughput, lower latency, and easier maintenance across multiple business scenarios.

Cost reductionHologresKudu

0 likes · 16 min read

How Hologres Transformed a Real‑Time Data Warehouse: Cutting Costs & Boosting Performance

Baidu Geek Talk

Aug 9, 2022 · Big Data

How to Build a Real-Time Data Warehouse with Unified Stream‑Batch Architecture

This article examines the evolution of big‑data architectures, identifies the latency and maintenance issues of classic Lambda designs, and presents a hybrid Lambda‑Kappa solution that unifies streaming and batch processing to achieve minute‑level data freshness and second‑level query latency while reducing development cost.

Big DataKappa architectureLambda architecture

0 likes · 13 min read

How to Build a Real-Time Data Warehouse with Unified Stream‑Batch Architecture

DataFunSummit

Aug 2, 2022 · Big Data

Tencent PCG Real‑Time Data Warehouse and Operations Architecture Overview

This article presents Tencent's PCG data platform evolution, detailing the challenges of integrating multiple business groups, the design of a unified big‑data architecture, real‑time and batch processing pipelines, MQ and ATTA systems, and comprehensive operational practices for reliability and scalability.

ATTABig DataMQ

0 likes · 17 min read

Tencent PCG Real‑Time Data Warehouse and Operations Architecture Overview

JavaEdge

Jul 25, 2022 · Big Data

Choosing Between Lambda and Kappa: Real‑Time Data Warehouse Strategies

The article uses an acorn‑moving analogy to highlight latency and traceability challenges in enterprise data warehouses, then explains offline versus real‑time approaches, compares Lambda and Kappa architectures, discusses Iceberg integration, and shares a detailed e‑commerce real‑time warehouse case study with optimization tips.

Big DataFlinkIceberg

0 likes · 15 min read

Choosing Between Lambda and Kappa: Real‑Time Data Warehouse Strategies

HomeTech

Jul 20, 2022 · Big Data

Design and Implementation of a Real-Time Advertising Data Warehouse Using Flink and StarRocks

This article presents a comprehensive case study of building a real‑time advertising data warehouse at Auto Home, detailing the evaluation of streaming engines and storage solutions, the layered architecture design, implementation steps with Flink and StarRocks, monitoring practices, encountered issues, and future roadmap, demonstrating how second‑level data freshness and high accuracy were achieved.

FlinkStarRocksStreaming

0 likes · 10 min read

Design and Implementation of a Real-Time Advertising Data Warehouse Using Flink and StarRocks

ITPUB

Jun 27, 2022 · Big Data

How Kuaishou Guarantees Real‑Time Data Warehouse Performance at Billion‑Scale Events

This article details Kuaishou's real‑time data warehouse architecture, the business challenges of massive traffic and diverse requirements, and the forward‑ and reverse‑assurance strategies—including lifecycle standards, monitoring, fault‑injection testing, and a Spring Festival case study—that together ensure high stability, low latency, and sub‑0.5% accuracy for billion‑scale streaming workloads.

Fault InjectionFlink streamingKuaishou

0 likes · 22 min read

How Kuaishou Guarantees Real‑Time Data Warehouse Performance at Billion‑Scale Events

Big Data Technology Architecture

Jun 9, 2022 · Databases

Building a Real‑Time Data Warehouse with Apache Doris: Architecture, Benefits, and Lessons Learned

This article details how a fast‑growing supply‑chain platform migrated from MySQL and Hive to Apache Doris for real‑time analytics, describing the architectural evolution, the advantages of the new design, practical implementation steps, encountered challenges, and the performance and cost benefits achieved.

Apache DorisData IntegrationFlink CDC

0 likes · 12 min read

Building a Real‑Time Data Warehouse with Apache Doris: Architecture, Benefits, and Lessons Learned

Zuoyebang Tech Team

Jun 7, 2022 · Big Data

How Doris Powered Zuoyebang’s Real‑Time Data Warehouse for Faster Insights

Zuoyebang’s data team replaced fragmented, slow query solutions with Apache Doris, building a unified real‑time data warehouse that dramatically cut query latency from hours to seconds, streamlined data modeling, and improved reliability across diverse business scenarios, while integrating with Flink, Kafka, and ES via a unified API.

Apache DorisElasticsearchFlink

0 likes · 20 min read

How Doris Powered Zuoyebang’s Real‑Time Data Warehouse for Faster Insights

58 Tech

May 5, 2022 · Big Data

Low-Code Real-Time Data Warehouse Construction System Using Flink

This article describes a low‑code, Flink‑based real‑time data‑warehouse construction system that abstracts the warehouse building process into ODS, DWD, DWS, and ADS layers, leverages a domain‑specific language and plugin engine to reduce development effort, and details its architecture, DSL design, plugin extensibility, dimension‑table completion, stream merging, aggregation, and storage strategies.

Big DataDSLFlink

0 likes · 11 min read

Low-Code Real-Time Data Warehouse Construction System Using Flink

Shopee Tech Team

Apr 28, 2022 · Big Data

Building Real-Time Data Warehouse with Flink + Hudi at Shopee

Shopee replaced its hourly Hive pipeline with a hybrid Flink‑Hudi real‑time data warehouse that groups Kafka topics, applies lightweight stream ETL, uses partial‑update MOR tables for multi‑stream joins and COW tables for versioned batches, cutting latency from about 90 minutes to 2–30 minutes and halving resource usage.

Apache FlinkApache HudiBatch Processing

0 likes · 20 min read

Building Real-Time Data Warehouse with Flink + Hudi at Shopee

ITPUB

Apr 19, 2022 · Big Data

Which Real-Time Data Warehouse Architecture Fits Your Needs? A Deep Dive

This article explains why modern enterprises need real‑time data‑warehouse architectures, breaks down traditional layered warehouse concepts, compares Lambda and Kappa models, evaluates five practical real‑time solutions—including Iceberg‑based lakehouse and MPP databases—provides code snippets, and offers selection guidance with real‑world company examples.

Big DataFlinkIceberg

0 likes · 19 min read

Which Real-Time Data Warehouse Architecture Fits Your Needs? A Deep Dive

dbaplus Community

Mar 15, 2022 · Big Data

How to Build a Real‑Time Data Warehouse with Flink SQL: Architecture, Implementation, and Governance

This article explains the challenges of early real‑time data pipelines, introduces a layered real‑time warehouse architecture, provides step‑by‑step Flink SQL code for building a demo warehouse, and covers comprehensive data governance, quality metrics, lifecycle management, and naming conventions for production‑grade big‑data systems.

Data GovernanceData QualityFlink SQL

0 likes · 60 min read

How to Build a Real‑Time Data Warehouse with Flink SQL: Architecture, Implementation, and Governance

dbaplus Community

Mar 2, 2022 · Big Data

How Real‑Time Data Warehouses Power Modern Business: Architecture, Cases, and Best Practices

This article explores the growing demand for real‑time data warehouses, compares them with traditional offline warehouses, and presents detailed architectures, layer designs, naming conventions, and case studies from companies like Didi, Kuaishou, Tencent, and Youzan, highlighting challenges, solutions, and performance optimizations.

Big Data ArchitectureFlinkIceberg

0 likes · 47 min read

vivo Internet Technology

Feb 23, 2022 · Big Data

Kafka-based Real-Time Data Warehouse: Architecture and Practice for Search

The article explains how Kafka serves as the core of a real‑time data warehouse for search, detailing its advantages over traditional databases, integration with Flink for low‑latency stream processing, architectural patterns such as Lambda/Kappa, scaling challenges, and comprehensive monitoring using Kafka Eagle.

Apache KafkaData IntegrationFlink

0 likes · 15 min read

Kafka-based Real-Time Data Warehouse: Architecture and Practice for Search

Alibaba Cloud Developer

Feb 9, 2022 · Cloud Native

How Alibaba Cloud Hologres Scales to 8,192 Nodes with Cloud‑Native Architecture

Alibaba Cloud's real‑time data warehouse Hologres passed a large‑scale performance test of up to 8,192 nodes, demonstrating how cloud‑native design, automated operations, and intelligent monitoring enable ultra‑large‑scale deployment and high‑availability for enterprise data platforms.

Alibaba CloudKubernetesLarge‑Scale Deployment

0 likes · 15 min read

How Alibaba Cloud Hologres Scales to 8,192 Nodes with Cloud‑Native Architecture

Youzan Coder

Jan 31, 2022 · Big Data

Youzan Coder's 2021 Top 10 Technical Articles by Read Count

In a festive New‑Year message, Youzan Coder’s WeChat account celebrates the Tiger Year by presenting its six‑year journey and unveiling the 2021 top‑10 most‑read technical articles—ranging from ClickHouse implementation to UI automation, TCP networking, low‑code testing, thread‑pool optimization, elite testing practices, mobile permission systems, search quality assurance, and proactive mobile monitoring—each with thousands of views, and encourages readers to keep learning in 2022.

Low‑code platformTCP networkingUI automation

0 likes · 7 min read

Youzan Coder's 2021 Top 10 Technical Articles by Read Count

Architecture Digest

Jan 21, 2022 · Big Data

Building a Real-Time Data Warehouse with Flink: Architecture, Core Concepts, and Practical Implementation

This article explains how to build a unified stream‑batch real‑time data warehouse using FlinkSQL, covering prerequisite knowledge, five core concepts, two implementation approaches, a comparison of traditional versus real‑time architectures, and a comprehensive hands‑on example, illustrated with diagrams.

Batch ProcessingData ArchitectureFlink

0 likes · 6 min read

Building a Real-Time Data Warehouse with Flink: Architecture, Core Concepts, and Practical Implementation

StarRocks

Jan 12, 2022 · Big Data

How Flink + StarRocks Deliver Lightning‑Fast Real‑Time Data Warehousing

This article explains the evolution, challenges, and technical solutions for building an end‑to‑end real‑time data warehouse by combining Apache Flink's stream processing with StarRocks' ultra‑fast OLAP engine, covering architecture, data models, integration methods, best‑practice cases, and future roadmap.

Big DataFlinkOLAP

0 likes · 21 min read

How Flink + StarRocks Deliver Lightning‑Fast Real‑Time Data Warehousing

Tencent Cloud Developer

Dec 28, 2021 · Industry Insights

How Flink and ClickHouse Combine to Build High‑Performance Real‑Time Data Warehouses

This article analyzes the challenges of massive data query efficiency, explains how Flink's stream processing and ClickHouse's OLAP engine complement each other, and presents a layered real‑time data‑warehouse architecture with practical guidance on data ingestion, write strategies, quality assurance, and evolving batch‑stream integration patterns.

Big DataFlinkOLAP

0 likes · 19 min read

How Flink and ClickHouse Combine to Build High‑Performance Real‑Time Data Warehouses

DataFunSummit

Dec 4, 2021 · Big Data

Building a Real-Time Data Warehouse with Flink: Hive Integration, Upsert‑Kafka, and CDC Connectors

This tutorial explains how to use Apache Flink 1.12 to construct a unified streaming‑batch data warehouse by integrating Hive via HiveCatalog and HiveDialect, performing read/write operations, configuring upsert‑Kafka sinks, and leveraging Flink CDC connectors for change data capture from MySQL and other sources.

CDCFlinkStreaming

0 likes · 46 min read

Building a Real-Time Data Warehouse with Flink: Hive Integration, Upsert‑Kafka, and CDC Connectors

Alibaba Cloud Developer

Nov 30, 2021 · Big Data

Scaling Real‑Time Data Warehousing for Double‑11: Flink + Hologres in Action

During the 2021 Double‑11 shopping festival, logistics provider DiSiFang upgraded its real‑time data warehouse with Flink and Hologres, enabling multi‑billion‑row joins, cutting costs by 50%, and delivering stable, low‑latency analytics that powered high‑frequency dashboards and improved overall delivery speed.

Big DataFlinkHologres

0 likes · 13 min read

Scaling Real‑Time Data Warehousing for Double‑11: Flink + Hologres in Action

Tongcheng Travel Technology Center

Nov 19, 2021 · Big Data

Real‑Time Data Warehouse Practices with Apache Kudu: Architecture, Partitioning, and Platformization

This article reviews the challenges of building a real‑time data warehouse, compares Lambda and Kappa architectures, introduces Apache Kudu’s master‑tablet design, storage model and partition strategies, and shares practical experiences and future directions for a Kudu‑based streaming analytics platform.

Apache KuduBig DataKappa architecture

0 likes · 8 min read

Real‑Time Data Warehouse Practices with Apache Kudu: Architecture, Partitioning, and Platformization

Meituan Technology Team

Aug 26, 2021 · Big Data

How Meituan Built a Scalable Real‑Time Data Warehouse: Architecture & Lessons

Meituan Waimai’s data intelligence team outlines a universal real‑time data‑warehouse methodology that combines a production platform with an interactive analytics engine, detailing scenarios, technology choices, architectural designs, platformization, SLA management, and a practical Lambda‑style case study.

FlinkKappa architectureLambda architecture

0 likes · 18 min read

How Meituan Built a Scalable Real‑Time Data Warehouse: Architecture & Lessons

Big Data Technology Architecture

Aug 10, 2021 · Big Data

Building a Real‑Time Data Warehouse with Apache Flink and Apache Iceberg: Architecture, Challenges, and Best Practices

This article presents Tencent's practical experience of constructing a real‑time data warehouse by integrating Apache Flink with Apache Iceberg, covering background pain points of traditional Lambda architectures, Iceberg's table format and capabilities, Flink‑Iceberg sink design, small‑file handling, and future roadmap for a unified streaming‑batch data lake.

Apache FlinkApache IcebergBatch Processing

0 likes · 20 min read

Building a Real‑Time Data Warehouse with Apache Flink and Apache Iceberg: Architecture, Challenges, and Best Practices

Xianyu Technology

Jul 13, 2021 · Big Data

Design and Implementation of Xianyu Real-Time Data Warehouse

To meet Xianyu’s billion‑event‑per‑day real‑time analysis needs, the team built a petabyte‑scale warehouse using Hologres for storage and Alibaba‑enhanced Flink (Blink) for streaming, organized into ODS, DWD, DWS, ADS and DIM layers, enabling minute‑level aggregations, rapid anomaly detection, and instant product‑team insights.

Big DataHologresblink

0 likes · 12 min read

Design and Implementation of Xianyu Real-Time Data Warehouse

360 Tech Engineering

Jun 25, 2021 · Big Data

Introducing ULTRON: A Real‑Time Data Warehouse Platform Powered by FlinkSQL

ULTRON is a one‑stop real‑time data‑warehouse development platform built on FlinkSQL that unifies data integration, asset management, cluster deployment, modeling, ETL, OLAP analysis and governance, addressing the limitations of traditional batch‑oriented warehouses and simplifying streaming data workflows for developers.

Data GovernanceFlinkSQLStreaming

0 likes · 13 min read

Introducing ULTRON: A Real‑Time Data Warehouse Platform Powered by FlinkSQL

Youzan Coder

Jun 23, 2021 · Industry Insights

How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases

This article details Youzan's end‑to‑end experience building a real‑time data warehouse, covering background, application scenarios, layered architecture, streaming ETL techniques, data validation, recovery processes, and three production projects that illustrate the solution in action.

DruidFlinkSQLclickhouse

0 likes · 18 min read

How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases

Architecture Digest

Jun 10, 2021 · Big Data

NetEase Game Streaming ETL Architecture and Practices Based on Flink

This article presents NetEase Game's streaming ETL solution built on Flink, covering business background, log characteristics, specialized and generic ETL services, architectural evolution, Python UDF integration, runtime optimizations, fault‑tolerance mechanisms, and future roadmap for unified real‑time and offline data warehouses.

Big DataFlinkLog Processing

0 likes · 19 min read

Architect

Apr 30, 2021 · Backend Development

Designing a Scalable Real‑Time Data Warehouse with Redis: Challenges and Solutions

The article analyzes the massive storage and performance challenges of a real‑time DMP cache built on Redis, outlines data characteristics and technical obstacles, and proposes eviction policies, bucket‑based hashing, and fragmentation‑reduction techniques with Java code examples to achieve billion‑scale in‑memory key‑value storage.

Memory Optimizationjavakey-value store

0 likes · 10 min read

Designing a Scalable Real‑Time Data Warehouse with Redis: Challenges and Solutions

iQIYI Technical Product Team

Apr 9, 2021 · Big Data

Real-Time Data Warehouse at iQIYI Video Production Using Spark and ClickHouse

To meet iQIYI video production’s thousands‑QPS, petabyte‑scale, frequently‑updated data and large‑table join requirements, the team built a Spark‑plus‑ClickHouse real‑time warehouse that streams Kafka changes, joins HBase dimensions, and writes to ClickHouse, reducing reporting development time from days to hours while supporting both offline and real‑time analytics.

HBaseKafkaSpark

0 likes · 12 min read

Real-Time Data Warehouse at iQIYI Video Production Using Spark and ClickHouse

DataFunTalk

Feb 1, 2021 · Big Data

Building a Real-Time Data Warehouse with Apache Flink and Apache Iceberg: Architecture, Challenges, and Best Practices

This article presents Tencent's experience of constructing a real‑time data warehouse by integrating Apache Flink with Apache Iceberg, covering background pain points, Iceberg's table format and capabilities, Flink‑Iceberg streaming and batch processing, practical implementations, and future roadmap for data‑lake acceleration.

Apache FlinkApache IcebergBig Data

0 likes · 21 min read

Big Data Technology & Architecture

Jan 11, 2021 · Big Data

Evolution of a Real‑Time Data Warehouse Architecture and Practical Lessons

This article recounts the author’s journey building a real‑time data warehouse using Flink, Kafka, Redis, and ClickHouse, describing the initial batch‑oriented setup, successive architectural evolutions, challenges with wide tables and dimension data, and the final OLAP‑centric solution with secondary caching.

Big DataFlinkOLAP

0 likes · 9 min read

Evolution of a Real‑Time Data Warehouse Architecture and Practical Lessons

58 Tech

Jan 4, 2021 · Big Data

Building a Real‑Time Data Warehouse with Flink: Architecture, Implementation and Lessons Learned

This article describes how a fast‑growing company built a layered real‑time data warehouse on Flink, detailing the evolution from a simple 1.0 pipeline to a 2.0 architecture with ODS, DWD and ADS layers, dimension joins, exactly‑once sinks, HDFS partitioning, monitoring, and future improvements.

Big DataETLFlink

0 likes · 14 min read

Building a Real‑Time Data Warehouse with Flink: Architecture, Implementation and Lessons Learned

DataFunTalk

Dec 15, 2020 · Big Data

Exploring JD's Real‑Time Data Lake with Delta Lake: Architecture, Challenges, and Practical Insights

This article introduces JD's real‑time data warehouse evolution, outlines the limitations of traditional Lambda‑based warehouses, compares open‑source lake formats (Delta, Hudi, Iceberg), explains Delta Lake's transaction‑log architecture and read flow, and demonstrates how a unified batch‑stream development model simplifies data processing and improves reliability.

ACIDData LakeDelta Lake

0 likes · 12 min read

Exploring JD's Real‑Time Data Lake with Delta Lake: Architecture, Challenges, and Practical Insights

Alibaba Cloud Developer

Nov 23, 2020 · Big Data

How Alibaba’s CCO Built a Cloud‑Native Real‑Time Data Warehouse with Hologres

Alibaba’s Customer Experience (CCO) team transformed its real‑time data platform by evolving from a Lambda‑style database architecture to a cloud‑native real‑time data warehouse powered by Hologres and Flink, achieving higher throughput, lower latency, reduced costs, and self‑service analytics for massive Double‑11 traffic.

AlibabaBig DataFlink

0 likes · 15 min read

How Alibaba’s CCO Built a Cloud‑Native Real‑Time Data Warehouse with Hologres

dbaplus Community

Oct 29, 2020 · Big Data

Inside Didi’s Real-Time Data Warehouse for Ride-Sharing: Architecture & Lessons

This article details Didi’s end‑to‑end construction of a real‑time data warehouse for the Ride‑Sharing (顺风车) business, covering motivations, layer‑by‑layer architecture, naming conventions, StreamSQL capabilities, operational tooling, achieved results, challenges, and future batch‑stream integration plans.

DidiFlinkreal-time data warehouse

0 likes · 21 min read

Inside Didi’s Real-Time Data Warehouse for Ride-Sharing: Architecture & Lessons

ITPUB

Oct 16, 2020 · Big Data

How NetEase Cloud Music Built a Real‑Time Data Warehouse with Flink & Calcite

This article details NetEase Cloud Music's evolution of a real‑time data warehouse built on Flink 1.9 and Calcite, covering platform scale, architectural design, metadata management, SDK simplifications, monitoring improvements, and concrete use cases such as AB‑testing, live reporting, and feature serving.

Big DataCalciteFlink

0 likes · 8 min read

How NetEase Cloud Music Built a Real‑Time Data Warehouse with Flink & Calcite

dbaplus Community

Oct 13, 2020 · Big Data

How to Build a Real‑Time Data Warehouse with Flink: Principles, Architecture, and Best Practices

This article explains why real‑time data warehouses are needed, outlines their core principles, compares them with offline warehouses, describes typical use cases such as real‑time OLAP, dashboards, feature generation and monitoring, and provides a step‑by‑step guide to designing, implementing, and operating a Flink‑based streaming warehouse with Kafka, HBase, and metadata management.

FlinkKafkaOLAP

0 likes · 29 min read

How to Build a Real‑Time Data Warehouse with Flink: Principles, Architecture, and Best Practices

DataFunTalk

Sep 6, 2020 · Big Data

OPPO's Real-Time Data Warehouse Architecture and Practices Based on Apache Flink

OPPO's data platform engineer Zhang Jun shares the design and implementation of OPPO's real‑time data warehouse built on Apache Flink, covering background, top‑level architecture, practical deployment, and future directions such as enhanced SQL development, resource scheduling, and automated configuration.

Data PlatformFlinkStreaming

0 likes · 15 min read

OPPO's Real-Time Data Warehouse Architecture and Practices Based on Apache Flink

Didi Tech

Aug 26, 2020 · Big Data

Real-time Data Warehouse Construction at Didi: Architecture, Practices, and Lessons

To support Didi’s fast‑growing car‑pool service, a real‑time data warehouse was built using a streamlined layered architecture—ODS, DWD, DIM, DWM, and APP—leveraging Flink‑based StreamSQL, Kafka, Druid and ClickHouse to deliver minute‑level analytics, dashboards, monitoring, and cross‑business interfaces while planning unified meta‑store integration.

Big Data ArchitectureData PlatformFlink

0 likes · 20 min read

Real-time Data Warehouse Construction at Didi: Architecture, Practices, and Lessons

DataFunTalk

Aug 2, 2020 · Big Data

Building Real-Time Data Warehouses with Apache Flink: Goals, Architecture, and Best Practices

This article presents a comprehensive guide to constructing real-time data warehouses using Apache Flink, covering the motivations, design principles, application scenarios, layer-by-layer architecture, metadata and lineage management, quality assurance, and the supporting toolchain for reliable streaming analytics.

Data ArchitectureETLFlink

0 likes · 24 min read

Building Real-Time Data Warehouses with Apache Flink: Goals, Architecture, and Best Practices

Big Data Technology Architecture

Jun 29, 2020 · Big Data

Real‑time Data Warehouse Construction: Goals, Architecture, and Best Practices with Apache Flink

This article summarizes the objectives, design principles, application scenarios, layer‑by‑layer construction methods, quality assurance mechanisms, and supporting tools for building a real‑time data warehouse using Apache Flink, providing practical guidance for data engineers and architects.

Apache FlinkData QualityFlink

0 likes · 24 min read

Real‑time Data Warehouse Construction: Goals, Architecture, and Best Practices with Apache Flink

58 Tech

Jun 10, 2020 · Big Data

Real‑time Data Warehouse Practices at 58 Tongcheng Bao: From Spark Streaming 1.0 to Flink‑based 2.0

This article details the evolution of 58 Tongcheng Bao's real‑time data warehouse, describing the initial Spark‑Streaming architecture, its limitations, and the redesign using Flink with a layered ODS‑DWD‑DWS‑APP model, data‑quality monitoring, join techniques, and the resulting improvements in latency and accuracy.

Big DataData QualityFlink

0 likes · 9 min read

Real‑time Data Warehouse Practices at 58 Tongcheng Bao: From Spark Streaming 1.0 to Flink‑based 2.0

DataFunTalk

May 14, 2020 · Big Data

Building a Real-Time Data Warehouse at Cainiao: Architecture, Model Upgrades, Engine Enhancements, and Service Innovations

This article shares Cainiao's practical experience in constructing a real-time data warehouse, covering the shortcomings of the previous architecture, the evolution of data models, the migration to Flink with advanced features like retraction and timer services, and the modernization of data services and tooling to support high‑throughput logistics scenarios.

Big DataData ServiceFlink

0 likes · 16 min read

Building a Real-Time Data Warehouse at Cainiao: Architecture, Model Upgrades, Engine Enhancements, and Service Innovations

Big Data Technology Architecture

Feb 13, 2020 · Big Data

Evolution of Cainiao's Real-Time Data Warehouse Architecture: Model, Compute Engine, and Data Service Upgrades

The talk details Cainiao’s evolution of its real‑time data warehouse architecture, covering the original 2016 model, compute and service challenges, the 2017 multi‑layer data model redesign, migration to Flink, practical cases of state retraction, timeout statistics, smart optimizations, and the unified data service platform.

Data ServiceFlinkStreaming

0 likes · 16 min read

Evolution of Cainiao's Real-Time Data Warehouse Architecture: Model, Compute Engine, and Data Service Upgrades

Big Data Technology Architecture

Feb 8, 2020 · Big Data

Meituan-Dianping Real-Time Data Warehouse Platform Built on Apache Flink: Architecture, Practices, and Future Directions

Meituan-Dianping’s senior technical expert shares the evolution, architecture, and implementation of their Apache Flink‑based real‑time data warehouse platform, covering platform evolution, layered design, job and resource management, business warehouse use cases, and future development considerations.

FlinkMeituan-DianpingStreaming

0 likes · 16 min read

Meituan-Dianping Real-Time Data Warehouse Platform Built on Apache Flink: Architecture, Practices, and Future Directions

dbaplus Community

Jan 14, 2020 · Big Data

How OPPO Built a Real‑Time Data Warehouse with Flink SQL

This article details{32-64 words} OPPO's evolution from an offline data warehouse to a real‑time platform, describing the business scale, data‑mid platform architecture, migration strategy using Flink SQL, extensions like AthenaX, and practical use cases such as real‑time ETL, CTR calculation, and tag import.

ETLFlinkStreaming

0 likes · 18 min read

How OPPO Built a Real‑Time Data Warehouse with Flink SQL

dbaplus Community

Oct 30, 2019 · Databases

How TiDB Transformed Real‑Time Data Warehousing at Yiguo Group

This article details how Yiguo Group migrated from a single‑server SQL Server setup to a distributed TiDB + TiSpark architecture, highlighting performance gains, HTAP capabilities with TiFlash, ETL differences, and future data‑platform considerations.

HTAPTiDBTiFlash

0 likes · 9 min read

How TiDB Transformed Real‑Time Data Warehousing at Yiguo Group

Big Data Technology & Architecture

Sep 14, 2019 · Big Data

Real‑Time Data Warehouse Architecture: Industry Practices and OLAP Engine Selection

This article surveys the recent surge in real‑time data warehouse construction, explains why low‑latency analytics are needed, and compares the architectures and technology stacks of Alibaba, Zhihu, Meituan, and NetEase, highlighting the role of open‑source OLAP engines such as Druid and ADB.

ADBDruidOLAP

0 likes · 11 min read

Real‑Time Data Warehouse Architecture: Industry Practices and OLAP Engine Selection

Big Data Technology & Architecture

Sep 11, 2019 · Big Data

Evolution of Zhihu's Real-Time Data Warehouse: From Spark Streaming 1.0 to Flink‑Based 2.0

This article details Zhihu's real‑time data warehouse evolution, describing the 1.0 Spark Streaming architecture, its limitations, and the 2.0 redesign that introduces Flink, layered data models, streaming and batch ETL, metric storage choices, and future roadmap for scalable, low‑latency analytics.

FlinkLambda architectureSpark Streaming

0 likes · 19 min read

Evolution of Zhihu's Real-Time Data Warehouse: From Spark Streaming 1.0 to Flink‑Based 2.0

HomeTech

Aug 15, 2019 · Big Data

Real‑Time Data Warehouse Development with Flink: Architecture, Implementation, and Lessons Learned

This article describes the motivation, technology selection, implementation details, and practical challenges of building a real‑time data warehouse using Flink, covering stream ingestion, data cleaning, dimension‑table joins, state backend choices, and operational lessons for large‑scale streaming pipelines.

FlinkKafkaState Backend

0 likes · 8 min read

Real‑Time Data Warehouse Development with Flink: Architecture, Implementation, and Lessons Learned

HomeTech

Aug 14, 2019 · Big Data

Real-Time Data Warehouse Development with Flink: Architecture, Implementation, and Lessons Learned

This article describes the motivation, technology selection, implementation details, and encountered challenges of building a real‑time data warehouse using Flink, covering streaming computation, code examples, dimension‑table caching, state backend choices, and best practices for production deployment.

FlinkKafkaState Backend

0 likes · 8 min read

dbaplus Community

Feb 28, 2019 · Big Data

How Zhihu Built a Real-Time Data Warehouse: From Spark Streaming to Flink

This article details Zhihu's evolution of its real-time data warehouse, covering the 1.0 version built on Spark Streaming, the 2.0 upgrade using Flink Streaming SQL, architectural layers, ETL processes, and future directions such as streaming SQL platformization and automated result validation.

ETLFlinkLambda architecture

0 likes · 19 min read

How Zhihu Built a Real-Time Data Warehouse: From Spark Streaming to Flink

Alibaba Cloud Developer

Dec 18, 2018 · Databases

Inside Alibaba AnalyticDB: Architecture, Core Technologies, and Real‑Time Data Warehouse Innovations

This article provides an in‑depth technical overview of Alibaba's AnalyticDB, covering the challenges of massive real‑time analytics, the cloud‑native multi‑tenant architecture, data model, import/export capabilities, high‑performance SQL parser, the Xuanwu storage engine, Xihe compute engine, optimizer, GPU acceleration, and elastic scaling features.

AnalyticDBGPU AccelerationSQL Parser

0 likes · 38 min read

Inside Alibaba AnalyticDB: Architecture, Core Technologies, and Real‑Time Data Warehouse Innovations

DataFunTalk

Dec 18, 2018 · Big Data

Flink-based Real-time Data Warehouse Practice at Yanxuan

This talk presents Yanxuan’s real‑time data warehouse built on Flink, covering background challenges, overall architecture and implementation, data quality measures, monitoring, and practical application scenarios, while highlighting design goals of flexibility, high development efficiency, and stringent data quality requirements.

FlinkStreamingreal-time data warehouse

0 likes · 14 min read

Flink-based Real-time Data Warehouse Practice at Yanxuan

ITPUB

Oct 23, 2018 · Big Data

How Meituan Built a Scalable Real‑Time Data Warehouse with Flink

This article explains how Meituan tackled growing real‑time data demands by redesigning its streaming platform, adopting a layered real‑time data warehouse architecture, selecting storage and compute technologies such as Cellar, Elasticsearch, Druid and Flink, and sharing practical tips on dimension expansion, joins, and aggregation to achieve higher throughput and lower latency.

Data ArchitectureFlinkMeituan

0 likes · 15 min read

How Meituan Built a Scalable Real‑Time Data Warehouse with Flink