Kappa architecture

DataFunTalk

Mar 5, 2024 · Big Data

Changan Automotive Big Data Platform: Challenges and Practices in Connected Vehicle Scenarios

This article outlines the rapid growth of data in the smart automotive sector and details Changan's big data platform challenges—high cost, data accessibility, and operational complexity—and the practical migration from a Lambda to a unified Kappa architecture that delivers significant storage, compute, and maintenance efficiencies.

Big DataConnected VehiclesCost Optimization

0 likes · 14 min read

Changan Automotive Big Data Platform: Challenges and Practices in Connected Vehicle Scenarios

WeiLi Technology Team

Aug 2, 2023 · Big Data

How to Build a Real-Time Data Warehouse: Architectures, Challenges, and Industry Practices

This article examines the growing demand for real‑time data warehouses, compares mature streaming frameworks, evaluates Lambda, Kappa and hybrid architectures, reviews industry implementations from Didi and OPPO, and proposes a standard‑layer + stream + data‑lake solution with Apache Paimon, Hudi, and Iceberg.

Apache FlinkBig DataKappa architecture

0 likes · 27 min read

How to Build a Real-Time Data Warehouse: Architectures, Challenges, and Industry Practices

DataFunTalk

Jan 29, 2023 · Big Data

Real-Time Data Warehouse Architectures: Lambda, Kappa, and Omega Solutions

This article explains the evolution of data warehouses, the need for real‑time processing, the classic ODS‑DW‑APP layering, compares offline, Lambda, Kappa, and the newer Omega architectures, and discusses how cloud‑native databases enable a unified real‑time lake‑warehouse solution.

Big DataData WarehouseKappa architecture

0 likes · 13 min read

Real-Time Data Warehouse Architectures: Lambda, Kappa, and Omega Solutions

DataFunSummit

Jan 8, 2023 · Big Data

Streaming‑Batch Integrated Real‑time Multi‑dimensional Analysis

This article presents a comprehensive overview of evolving big‑data architectures—from classic offline warehouses to Lambda and Kappa models—and details a streaming‑batch integrated solution that addresses latency, data freshness, and multi‑table join challenges to achieve minute‑level real‑time multi‑dimensional analytics.

Big DataData WarehouseKappa architecture

0 likes · 18 min read

Streaming‑Batch Integrated Real‑time Multi‑dimensional Analysis

Baidu Geek Talk

Nov 24, 2021 · Big Data

Building Big Data Infrastructure at Baidu Aifanfan: Architecture Practices and Lessons Learned

At Baidu Aifanfan, the data team built a unified real‑time and offline big‑data platform—leveraging Watt, Bigpipe, Fengge, AFS and Palo within Lambda/Kappa patterns and a fast‑slow parallel rollout—that cut OLAP query latency from 18 minutes to under 15 seconds, enabled self‑service analytics, and standardized metrics across 15 agile teams.

Apache DorisData WarehouseKappa architecture

0 likes · 23 min read

Building Big Data Infrastructure at Baidu Aifanfan: Architecture Practices and Lessons Learned

Tongcheng Travel Technology Center

Nov 19, 2021 · Big Data

Real‑Time Data Warehouse Practices with Apache Kudu: Architecture, Partitioning, and Platformization

This article reviews the challenges of building a real‑time data warehouse, compares Lambda and Kappa architectures, introduces Apache Kudu’s master‑tablet design, storage model and partition strategies, and shares practical experiences and future directions for a Kudu‑based streaming analytics platform.

Apache KuduBig DataKappa architecture

0 likes · 8 min read

Real‑Time Data Warehouse Practices with Apache Kudu: Architecture, Partitioning, and Platformization

Xueersi Online School Tech Team

Sep 10, 2021 · Big Data

Real‑time OLAP with Flink and Hologres: Replacing Lambda/Kappa Architectures

This article analyzes the limitations of traditional Lambda and Kappa big‑data architectures for online‑school behavior‑feature pipelines and presents a Flink + Hologres solution that provides unified real‑time OLAP and high‑concurrency point‑query services, including design choices, implementation details, and performance results.

FlinkHologresKappa architecture

0 likes · 12 min read

Real‑time OLAP with Flink and Hologres: Replacing Lambda/Kappa Architectures

DataFunSummit

Aug 15, 2021 · Big Data

Building a General Real-Time Data Warehouse: Methods and Practices at Meituan Waimai

This article introduces a universal method for building a real-time data warehouse at Meituan Waimai, covering streaming technologies, architecture choices such as Lambda and Kappa, component design, feature production, SLA management, and practical OLAP solutions using Flink, Storm, and Doris.

DorisFlinkKappa architecture

0 likes · 15 min read

Building a General Real-Time Data Warehouse: Methods and Practices at Meituan Waimai

DataFunTalk

Oct 12, 2020 · Big Data

Building a General Real‑Time Data Warehouse: Methods and Practices at Meituan Waimai

This article introduces Meituan Waimai's approach to constructing a universal real‑time data warehouse, covering streaming technology choices, Lambda/Kappa architectures, layered design, platformization, SLA management, and a practical Lambda‑style use case for real‑time analytics.

Big DataDoris OLAPFlink

0 likes · 16 min read

vivo Internet Technology

Dec 18, 2019 · Big Data

Comprehensive Overview of Big Data Architecture, Lambda/Kappa Models, and End-to-End Data Platform Design

The article surveys modern big‑data architecture, contrasting Lambda and Kappa models, highlights common governance and integration pain points, and proposes an end‑to‑end platform featuring unified metadata, stream‑batch processing, one‑click ingestion, standardized modeling, intelligent query abstraction, and a comprehensive development IDE.

Big DataData ModelingETL

0 likes · 13 min read

Comprehensive Overview of Big Data Architecture, Lambda/Kappa Models, and End-to-End Data Platform Design

DataFunTalk

Nov 19, 2019 · Big Data

Comprehensive Overview of Data Warehouses: Concepts, Evolution, Architecture, and Real‑time vs Offline Practices

This article provides a thorough introduction to data warehouses, traces their evolution, explains construction methodologies, compares offline, Lambda, and Kappa architectures, and presents real‑time warehouse case studies from Alibaba, Meituan, Xiaomi, Netflix, and OPPO, highlighting practical implementation details and challenges.

Big DataData WarehouseETL

0 likes · 14 min read

Comprehensive Overview of Data Warehouses: Concepts, Evolution, Architecture, and Real‑time vs Offline Practices

Qunar Tech Salon

Jul 5, 2019 · Big Data

Understanding Big Data Processing Architectures: Lambda, Kappa, and Lambda Plus

This article explains the technical challenges of large‑scale data processing, compares the classic Lambda and Kappa architectures, and introduces the cloud‑native Lambda Plus solution built on TableStore and Blink that simplifies batch‑stream integration for TB‑scale workloads.

Big DataCloud ServicesKappa architecture

0 likes · 13 min read

Understanding Big Data Processing Architectures: Lambda, Kappa, and Lambda Plus