Tagged articles
Kappa architecture
30 articles · Page 1 of 1
This article explains why online transaction databases (OLTP) should not be used for multi‑year analytics, outlines the four core characteristics of a data warehouse, details the ETL process, compares star and snowflake schemas, contrasts data warehouses with data lakes, and guides you through selecting Lambda or Kappa architectures using a concrete retail‑store scenario.
ETLKappa architectureLambda architecture
0 likes · 36 min read

The article explains the fundamental differences between offline and real‑time data warehouses, covering their core logic, layered designs, dimensional modeling, typical architectures such as Lambda, Kappa and stream‑batch hybrid, and provides guidance on selecting the appropriate solution based on latency, team expertise, cost and workload characteristics.
Kappa architectureLambda architectureLayered Architecture
0 likes · 13 min read

The article explains that real‑time data processing requires not only speed but also accuracy, stability, and long‑term maintainability, compares Lambda, Kappa, and unified batch‑stream architectures, discusses lakehouse storage, and provides practical guidance on selecting the most suitable approach for different project needs.
FlinkKappa architectureLambda architecture
0 likes · 9 min read

This interview with Yunqi Technology CTO Guan Tao explains how the traditional Lambda architecture’s triple‑system complexity drives costs and operational pain, and why the company’s General Incremental Computing (GIC) approach offers a unified, cost‑effective Kappa‑style solution for real‑time, batch, and interactive analytics.
Data EngineeringKappa architectureLambda architecture
0 likes · 13 min read

This article provides a comprehensive guide to designing and implementing a data middle platform, covering its core essence as a business-data fusion mechanism, six architectural modules from ingestion to performance optimization, three implementation phases from requirements to applications, and key pitfalls like business-technology misalignment and over-engineering.
Data ModelingFineDataLinkFineVis
0 likes · 15 min read


21CTOJul 15, 2024 · Big Data
Twitter migrated from a Lambda-based dual‑pipeline system to a Kappa architecture that relies on a single real‑time stream using Kafka, Google Pub/Sub, Dataflow, and BigTable, dramatically reducing latency, increasing throughput, and improving data accuracy for processing billions of daily events.
DataflowKappa architectureTwitter
0 likes · 9 min read

This article details the challenges of maintaining separate real‑time and batch risk‑control features, evaluates Lambda and Kappa architectures, explores storage‑unified and compute‑unified alternatives, compares Hologres, StarRocks and ClickHouse, and presents a validated StarRocks‑based solution that dramatically reduces feature delivery latency and improves accuracy.
Kappa architectureLambda architecturefeature engineering
0 likes · 19 min read

This article outlines the rapid growth of data in the smart automotive sector and details Changan's big data platform challenges—high cost, data accessibility, and operational complexity—and the practical migration from a Lambda to a unified Kappa architecture that delivers significant storage, compute, and maintenance efficiencies.
Connected VehiclesCost OptimizationKappa architecture
0 likes · 14 min read

The article explains the rise, challenges, and practical approaches of the stream‑batch integration concept—originally popularized by the Flink community—highlighting why it struggles at large scale, how companies adopt Kappa‑style real‑time pipelines or unified storage‑compute engines, and its relevance in technical interviews.
FlinkKappa architecture
0 likes · 6 min read

This article examines the growing demand for real‑time data warehouses, compares mature streaming frameworks, evaluates Lambda, Kappa and hybrid architectures, reviews industry implementations from Didi and OPPO, and proposes a standard‑layer + stream + data‑lake solution with Apache Paimon, Hudi, and Iceberg.
Apache FlinkKappa architectureLambda architecture
0 likes · 27 min read

This article traces the evolution of data architecture from early BI systems through traditional big‑data stacks, streaming, Lambda and Kappa designs, and explains how a unified stream‑batch model simplifies development while keeping logic consistent across data‑analysis and pipeline applications.
BI systemsKappa architectureLambda architecture
0 likes · 16 min read

This article explains the evolution of data warehouses, the need for real‑time processing, the classic ODS‑DW‑APP layering, compares offline, Lambda, Kappa, and the newer Omega architectures, and discusses how cloud‑native databases enable a unified real‑time lake‑warehouse solution.
Kappa architectureLambda architectureOmega architecture
0 likes · 13 min read

This article presents a comprehensive overview of evolving big‑data architectures—from classic offline warehouses to Lambda and Kappa models—and details a streaming‑batch integrated solution that addresses latency, data freshness, and multi‑table join challenges to achieve minute‑level real‑time multi‑dimensional analytics.
Kappa architectureLambda architecturebatch processing
0 likes · 18 min read

This article analyzes why telecom operators need a real‑time data middle platform, outlines its layered architecture and model design, examines the shift from Lambda to Kappa and lakehouse approaches, and highlights how these innovations enable faster, scenario‑driven insights and competitive advantage.
FlinkKappa architecturebig data architecture
0 likes · 15 min read

This article examines the evolution of big‑data architectures, identifies the latency and maintenance issues of classic Lambda designs, and presents a hybrid Lambda‑Kappa solution that unifies streaming and batch processing to achieve minute‑level data freshness and second‑level query latency while reducing development cost.
Data ModelingKappa architectureLambda architecture
0 likes · 13 min read

The article uses an acorn‑moving analogy to highlight latency and traceability challenges in enterprise data warehouses, then explains offline versus real‑time approaches, compares Lambda and Kappa architectures, discusses Iceberg integration, and shares a detailed e‑commerce real‑time warehouse case study with optimization tips.
FlinkKappa architectureLambda architecture
0 likes · 15 min read


ITPUBApr 19, 2022 · Big Data
This article explains why modern enterprises need real‑time data‑warehouse architectures, breaks down traditional layered warehouse concepts, compares Lambda and Kappa models, evaluates five practical real‑time solutions—including Iceberg‑based lakehouse and MPP databases—provides code snippets, and offers selection guidance with real‑world company examples.
FlinkKappa architectureLambda architecture
0 likes · 19 min read

At Baidu Aifanfan, the data team built a unified real‑time and offline big‑data platform—leveraging Watt, Bigpipe, Fengge, AFS and Palo within Lambda/Kappa patterns and a fast‑slow parallel rollout—that cut OLAP query latency from 18 minutes to under 15 seconds, enabled self‑service analytics, and standardized metrics across 15 agile teams.
Apache DorisKappa architectureKimball methodology
0 likes · 23 min read

This article reviews the challenges of building a real‑time data warehouse, compares Lambda and Kappa architectures, introduces Apache Kudu’s master‑tablet design, storage model and partition strategies, and shares practical experiences and future directions for a Kudu‑based streaming analytics platform.
Apache KuduKappa architectureLambda architecture
0 likes · 8 min read

This article analyzes the limitations of traditional Lambda and Kappa big‑data architectures for online‑school behavior‑feature pipelines and presents a Flink + Hologres solution that provides unified real‑time OLAP and high‑concurrency point‑query services, including design choices, implementation details, and performance results.
FlinkHologresKappa architecture
0 likes · 12 min read

Meituan Waimai’s data intelligence team outlines a universal real‑time data‑warehouse methodology that combines a production platform with an interactive analytics engine, detailing scenarios, technology choices, architectural designs, platformization, SLA management, and a practical Lambda‑style case study.
DorisFlinkKappa architecture
0 likes · 18 min read

This article introduces a universal method for building a real-time data warehouse at Meituan Waimai, covering streaming technologies, architecture choices such as Lambda and Kappa, component design, feature production, SLA management, and practical OLAP solutions using Flink, Storm, and Doris.
DorisFlinkKappa architecture
0 likes · 15 min read

This article introduces Meituan Waimai's approach to constructing a universal real‑time data warehouse, covering streaming technology choices, Lambda/Kappa architectures, layered design, platformization, SLA management, and a practical Lambda‑style use case for real‑time analytics.
Doris OLAPFlinkKappa architecture
0 likes · 16 min read

The article surveys modern big‑data architecture, contrasting Lambda and Kappa models, highlights common governance and integration pain points, and proposes an end‑to‑end platform featuring unified metadata, stream‑batch processing, one‑click ingestion, standardized modeling, intelligent query abstraction, and a comprehensive development IDE.
Data ModelingETLKappa architecture
0 likes · 13 min read

This article provides a thorough introduction to data warehouses, traces their evolution, explains construction methodologies, compares offline, Lambda, and Kappa architectures, and presents real‑time warehouse case studies from Alibaba, Meituan, Xiaomi, Netflix, and OPPO, highlighting practical implementation details and challenges.
ETLFlinkKappa architecture
0 likes · 14 min read

This article explains the technical challenges of large‑scale data processing, compares the classic Lambda and Kappa architectures, and introduces the cloud‑native Lambda Plus solution built on TableStore and Blink that simplifies batch‑stream integration for TB‑scale workloads.
Kappa architectureLambda architecturebatch processing
0 likes · 13 min read

This article examines the technical challenges of large‑scale data processing, compares the classic Lambda and Kappa architectures, introduces the unified stream‑batch Lambda+ design built on Tablestore and Blink, and outlines suitable scenarios and practical solutions for modern big‑data systems.
Kappa architectureLambda architecturebig data
0 likes · 16 min read


21CTOJun 7, 2019 · Big Data
This article explores the design of a large‑scale, real‑time sentiment analysis system, detailing the data ingestion, processing, and storage requirements, comparing Lambda and Kappa architectures, and presenting an Alibaba Cloud solution that combines Tablestore and Blink for unified batch‑and‑stream processing.
Kappa architectureLambda architecturebig data
0 likes · 18 min read


21CTOFeb 20, 2018 · Big Data
This article explains how real-time streaming has evolved from batch Hadoop systems through Lambda architecture to modern Kappa-style pipelines, highlighting its growing importance for developers, enterprises, and the integration of streaming with microservices, AI, and cloud-native technologies.
AI integrationKappa architectureLambda architecture
0 likes · 8 min read

This article compares Lambda and Kappa architectures, explains their three‑layer models, highlights the drawbacks of maintaining separate batch and speed layers in Lambda, introduces Kappa’s unified approach with StreamSQL, provides a smart‑traffic case study, and offers guidance on choosing the right architecture based on data volume, development complexity, and operational costs.
Kappa architectureLambda architectureStreamSQL
0 likes · 15 min read
