Skip to content
Tagged articles

lakehouse

268 articles · Page 1 of 3
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Nov 4, 2026 · Big Data

EMR Serverless StarRocks Supports Paimon 2.0 for Multimodal Analytics & Retrieval

Alibaba Cloud's EMR Serverless StarRocks now fully supports Apache Paimon 2.0, enabling unified multimodal analytics and retrieval by integrating vector search, full-text search, scalar filtering, and BLOB handling within a single lakehouse architecture, with best practices for data management and query optimization.

Data EvolutionEMR ServerlessGlobal Index
0 likes · 29 min read
EMR Serverless StarRocks Supports Paimon 2.0 for Multimodal Analytics & Retrieval
Lakehouse Research Base
Lakehouse Research Base
Oct 27, 2026 · Databases

Unified Lakehouse Retrieval: One SQL for Hybrid Keyword, Filter, and Vector Search

The article explains how Alibaba Cloud EMR Serverless StarRocks converges full-text, scalar, and vector search into a single engine using RRF for score fusion, In-Filter for predicate pushdown into vector search, and Partial Update for column-level annotation writes, reducing data movement and operational complexity.

In-FilterMultimodal RetrievalPaimon
0 likes · 11 min read
Unified Lakehouse Retrieval: One SQL for Hybrid Keyword, Filter, and Vector Search
Lakehouse Research Base
Lakehouse Research Base
Oct 19, 2026 · Big Data

Lakehouse: Mandatory Path or Over-Engineering? A Decision Framework for SMEs

The article provides a decision framework for enterprises evaluating Lakehouse adoption, arguing architecture should evolve with business complexity rather than follow trends. It defines six evaluation dimensions, contrasts Lakehouse with traditional OLAP, outlines phased evolution from basic analytics to streaming Lakehouse and AI data infrastructure, and warns against five common over-engineering pitfalls.

Apache FlussApache IcebergApache Paimon
0 likes · 34 min read
Lakehouse: Mandatory Path or Over-Engineering? A Decision Framework for SMEs
Lakehouse Research Base
Lakehouse Research Base
Oct 15, 2026 · Databases

StarRocks Integrates Paimon C++ for Native Lake Query Execution

StarRocks integrates Paimon C++ (paimon-cpp) to enable native C++ execution paths for querying Apache Paimon tables, eliminating JNI overhead, supporting primary key merges and delete handling, and achieving 1.4-3.4x speedups in benchmarks while reusing StarRocks' caching, memory management, and query profiling.

JNINative ExecutionPaimon
0 likes · 14 min read
StarRocks Integrates Paimon C++ for Native Lake Query Execution
StarRocks
StarRocks
Oct 14, 2026 · Databases

StarRocks Integrates Paimon C++ for 1.4–3.4x Faster Lake Queries via Native Execution

StarRocks adopts Apache Paimon's C++ implementation (paimon-cpp) to replace JNI calls for primary-key merges and delete-vector handling, cutting cross-language overhead and reusing StarRocks' cache, memory management, and Query Profile; benchmarks show 1.4–3.4× speedups on primary-key counts and wide-table aggregations.

Apache PaimonJNINative Execution
0 likes · 14 min read
StarRocks Integrates Paimon C++ for 1.4–3.4x Faster Lake Queries via Native Execution
Lakehouse Research Base
Lakehouse Research Base
Oct 12, 2026 · Big Data

Why Message Queues Can't Do Real-Time Aggregation: Alibaba Mama's Flink + Paimon Lakehouse

Alibaba Mama evolved its advertising real-time data warehouse from a message queue-based architecture to a Flink + Paimon streaming lakehouse, solving structural defects like lack of deduplication, aggregation layer support, and schema enforcement by leveraging Paimon's primary key upsert and changelog capabilities, while sharing production optimization practices and comparing storage choices for advertising vs. risk control scenarios.

Alibaba MamaClickHouseFlink
0 likes · 22 min read
Why Message Queues Can't Do Real-Time Aggregation: Alibaba Mama's Flink + Paimon Lakehouse
Lakehouse Research Base
Lakehouse Research Base
Oct 5, 2026 · Artificial Intelligence

Lakehouse + AI: Vector Database as Derived Index, Not New System

This article explains how to implement RAG within a lakehouse architecture by treating the vector database as a derived retrieval index rather than a separate system, covering embedding pipelines, Milvus index trade-offs, hybrid search, real-time updates via Flink, consistency governance, and troubleshooting common production issues.

ConsistencyData GovernanceEmbedding
0 likes · 22 min read
Lakehouse + AI: Vector Database as Derived Index, Not New System
Lakehouse Research Base
Lakehouse Research Base
Oct 3, 2026 · Big Data

Lakehouse Capacity Planning: Stress Testing, Bottleneck Detection & Scaling Decisions

This article presents a complete methodology for lakehouse performance stress testing and capacity planning, covering TPC-DS benchmark adaptation, end-to-end bottleneck identification across CPU, memory, disk, and network, a quantitative capacity derivation framework, and vertical versus horizontal scaling decision criteria for components like Kafka, Flink, Paimon, and StarRocks.

FlinkHorizontal ScalingKafka
0 likes · 27 min read
Lakehouse Capacity Planning: Stress Testing, Bottleneck Detection & Scaling Decisions
Lakehouse Research Base
Lakehouse Research Base
Sep 28, 2026 · Big Data

Apache Paimon Internals: LSM Write Path, Compaction Scheduling & Changelog Production

This article deep-dives into Apache Paimon's kernel source code, explaining the LSM write path from memory buffer to Sorted Runs, compaction scheduling trade-offs, four changelog production modes, and two-phase commit with Flink checkpoints, providing troubleshooting guidance for compaction backlog, changelog latency, and snapshot bloat.

Apache PaimonFlinkLSM-tree
0 likes · 33 min read
Apache Paimon Internals: LSM Write Path, Compaction Scheduling & Changelog Production
Lakehouse Research Base
Lakehouse Research Base
Sep 6, 2026 · Big Data

StarRocks Query Acceleration on Paimon: Production Tuning & Best Practices

This article details production practices for accelerating StarRocks queries on Paimon external tables, covering architecture, table design (partitioning, bucketing, compaction), dirty data handling, catalog configuration, predicate pushdown verification, SQL optimization with partition/bucket pruning, query method selection (direct, async materialized views, hot/cold tiering), and BE-level tuning.

Bucket PruningMaterialized ViewPaimon
0 likes · 22 min read
StarRocks Query Acceleration on Paimon: Production Tuning & Best Practices
StarRocks
StarRocks
Sep 3, 2026 · Databases

Querying Paimon Semi-Structured Data with StarRocks: Variant, Shredding & SQL Practices

This article explains how StarRocks queries Paimon Variant data, covering the differences between regular Parquet JSON and Variant, the three-phase read architecture, Shredding optimization for hot paths, practical SQL examples using get_variant_* functions, and a decision framework for choosing between JSON, Plain Variant, Shredded Variant, and formal typed columns.

PaimonParquetSQL
0 likes · 21 min read
Querying Paimon Semi-Structured Data with StarRocks: Variant, Shredding & SQL Practices
Lakehouse Research Base
Lakehouse Research Base
Aug 25, 2026 · Big Data

StarRocks on Paimon: Morning Fast, Daytime Slow - Root Cause & Layered Optimization

This article analyzes why identical StarRocks queries on Paimon external tables run fast in early morning but slow dramatically during daytime peaks, identifying five layered root causes from file fragmentation to storage pressure, and provides a systematic troubleshooting methodology plus a four-layer optimization framework covering source governance, compute caching, storage scaling, and business scheduling.

Delete VectorPaimonQuery Performance
0 likes · 21 min read
StarRocks on Paimon: Morning Fast, Daytime Slow - Root Cause & Layered Optimization
Niu Liu
Niu Liu
Aug 23, 2026 · Big Data

Paimon: Unifying Storage for Real-Time Data Warehouses

Apache Paimon combines a lakehouse table format with an LSM-tree update engine to handle continuous updates, historical snapshots, and multi-engine access in real-time data warehouses, reducing the need for separate Kafka, Hive, and OLAP systems.

Apache PaimonCDCFlink
0 likes · 23 min read
Paimon: Unifying Storage for Real-Time Data Warehouses
Lakehouse Research Base
Lakehouse Research Base
Aug 23, 2026 · Big Data

Apache Fluss Dual-Table Model: LogTable and PrimaryKeyTable Explained

This article details Apache Fluss's dual-table model where LogTable handles high-throughput append-only streaming with columnar storage while PrimaryKeyTable supports real-time updates, partial merges, and CDC changelogs via integrated RocksDB state storage, sharing unified tiering and lakehouse sinking.

Apache FlussCDCLogTable
0 likes · 19 min read
Apache Fluss Dual-Table Model: LogTable and PrimaryKeyTable Explained
Didi Tech
Didi Tech
Aug 20, 2026 · Big Data

Didi’s Three Sessions at COC Asia 2026: Object Storage, Lakehouse, AI‑Friendly

At Apache COC Asia 2026, Didi’s engineers presented three deep‑dive sessions covering the evolution of massive‑scale object storage with Ozone, cost‑effective lakehouse migration using Iceberg and real‑time ingestion, and AI‑friendly enhancements to the open‑source Seata project, detailing architectural choices, performance gains, and open‑source contributions.

AI‑Friendly Open‑SourceApache OzoneObject Storage
0 likes · 11 min read
Didi’s Three Sessions at COC Asia 2026: Object Storage, Lakehouse, AI‑Friendly
Lakehouse Research Base
Lakehouse Research Base
Aug 17, 2026 · Big Data

StarRocks Real-Time Wide Tables: Direct Write vs Paimon Lakehouse Architecture Comparison

This article deeply compares two StarRocks real-time wide table architectures—direct primary key table writes versus Paimon lakehouse external tables—across seven dimensions including query performance, write latency, data reuse, resource isolation, operational complexity, storage cost, and evolution potential, providing banking scenario selection criteria and a recommended Flink+Fluss+Paimon+StarRocks streaming lakehouse architecture.

FlinkPaimonStarRocks
0 likes · 21 min read
StarRocks Real-Time Wide Tables: Direct Write vs Paimon Lakehouse Architecture Comparison
DataFunSummit
DataFunSummit
Aug 7, 2026 · Big Data

Apache Fluss Graduates to Top‑Level Project, Launching Agentic Lake’s Full Real‑Time Era

In July 2024 Apache Fluss received unanimous approval from the Apache Incubator IPMC and ASF board, graduating to a Top‑Level Project; the article details its community growth, core Lakestream architecture, real‑time streaming storage capabilities, adoption by major enterprises, and how it enables AI agents with fresh, unified data for real‑time decisions.

AI agentApache Flusslakehouse
0 likes · 14 min read
Apache Fluss Graduates to Top‑Level Project, Launching Agentic Lake’s Full Real‑Time Era
ByteDance Data Platform
ByteDance Data Platform
Aug 7, 2026 · Big Data

Can a Single AI‑Native Lakehouse Format Power Multimodal Data, Retrieval and Agent Memory?

At AICon 2026, Ma Jin explained how Lance’s layered lakehouse format—spanning file, table, index and catalog layers—addresses AI workloads by supporting wide columns, cheap schema evolution, mixed storage and low‑latency random reads, enabling unified handling of training data, RAG retrieval and Agent memory.

AI-native FormatAgent MemoryLance
0 likes · 16 min read
Can a Single AI‑Native Lakehouse Format Power Multimodal Data, Retrieval and Agent Memory?
Big Data Technology & Architecture
Big Data Technology & Architecture
Aug 5, 2026 · Big Data

12 Tough Data‑AI Interview Questions from Leading Companies – Can You Master the Latest Trends? (Part 1)

This article (part 1) presents twelve high‑level interview questions from top tech firms covering the shift from AI‑Ready to Data‑Agent‑Ready data warehouses, AI‑centric metadata and lineage, lakehouse formats like Paimon, and key Iceberg features that empower AI‑driven analytics.

AIData EngineeringInterview questions
0 likes · 8 min read
12 Tough Data‑AI Interview Questions from Leading Companies – Can You Master the Latest Trends? (Part 1)
Past Memory Big Data
Past Memory Big Data
Aug 3, 2026 · Industry Insights

Beyond the Lakehouse: How Databricks Is Targeting the Enterprise Agent Operating System

The article analyzes Databricks' shift from a unified Lakehouse architecture to building an "Agent operating system" that supplies context, state, tools, identity and governance for enterprise agents, outlines its four‑layer data stack, compares it with Palantir, Snowflake and Microsoft Fabric, and discusses the technical and strategic challenges ahead.

Agent OSCloud Data PlatformDatabricks
0 likes · 16 min read
Beyond the Lakehouse: How Databricks Is Targeting the Enterprise Agent Operating System
DataFunTalk
DataFunTalk
Aug 1, 2026 · Industry Insights

Beyond Lakehouse: How Databricks Is Building an Agent Operating System

The article analyzes Databricks' shift from a pure Lakehouse data platform to an emerging Agent operating system, detailing a four‑layer architecture for facts, semantics, governance, and agent execution, and comparing its approach with Palantir, Snowflake and Microsoft Fabric.

AI agentsAgent OSDatabricks
0 likes · 15 min read
Beyond Lakehouse: How Databricks Is Building an Agent Operating System
ITPUB
ITPUB
Jul 30, 2026 · Industry Insights

Why Data Professionals Avoid Saying They Work on Data Warehouses

The article explains that although modern data platforms are rebranded as lakehouses or AI data foundations, the core data‑warehouse tasks—ingestion, cleaning, modeling, metric alignment, quality, lineage and governance—remain unchanged, and practitioners often hide the term to avoid being labeled as using outdated technology.

AIData GovernanceData Platform
0 likes · 14 min read
Why Data Professionals Avoid Saying They Work on Data Warehouses
dbaplus Community
dbaplus Community
Jul 23, 2026 · Databases

Mid‑Year 2026 Database Roundup: AI‑Native Foundations and Major Product Updates

The article provides a detailed 2026 H1 review of global database trends, highlighting the shift to AI‑native and lake‑house architectures, summarizing major version releases across RDBMS, NoSQL, big‑data ecosystems and domestic solutions, and analyzing their technical features, compliance, performance and market implications.

AI NativeVersion Updatesbig data
0 likes · 37 min read
Mid‑Year 2026 Database Roundup: AI‑Native Foundations and Major Product Updates
Shuge Unlimited
Shuge Unlimited
Jul 19, 2026 · Databases

How Milvus 3.0 Queries External Lakehouse Files Without Copying Data

Milvus 3.0 introduces an External Collection that treats Parquet and other lakehouse files as a read‑only query view, detailing how external_source and external_spec are validated, how stable file lists are built, how the two‑stage refresh recomputes segment mappings, and how virtual primary keys and milvus‑table snapshots enable seamless querying without data duplication.

External CollectionMilvusVirtual PK
0 likes · 17 min read
How Milvus 3.0 Queries External Lakehouse Files Without Copying Data
StarRocks
StarRocks
Jul 15, 2026 · Big Data

Building a Lake‑Stream Integrated Data Pipeline with Fluss, Paimon, and StarRocks

The article details how Taotian Group’s senior data engineer Zhu Ao designed a lake‑stream integrated architecture using Fluss for second‑level real‑time storage, Paimon for minute‑level lakehouse persistence, and StarRocks as a unified OLAP query layer, achieving over 50% faster development and more than 80% cost reduction.

FlussOLAPPaimon
0 likes · 14 min read
Building a Lake‑Stream Integrated Data Pipeline with Fluss, Paimon, and StarRocks
Lakehouse Research Base
Lakehouse Research Base
Jul 14, 2026 · Big Data

Flink + Paimon End-to-End Exactly-Once: Production Implementation Guide

This guide details how to achieve end-to-end exactly-once semantics with Apache Flink and Apache Paimon, covering consistency models, three-layer coordination mechanisms, production-grade configurations, concurrency rules, verification tests, failure injection scenarios, performance trade-offs, and operational SOPs for lakehouse streaming workloads.

Apache FlinkApache PaimonProduction Operations
0 likes · 26 min read
Flink + Paimon End-to-End Exactly-Once: Production Implementation Guide
DataFunTalk
DataFunTalk
Jul 14, 2026 · Big Data

How Xiaohongshu Re‑engineered Its Data Architecture for the Big AI Data Era

Xiaohongshu transformed its data platform from a simple ClickHouse‑based stack to a Lambda‑enhanced architecture and finally to a Lakehouse with incremental compute, cutting architecture complexity, resource and development costs by two‑thirds while delivering second‑level analytics on petabyte‑scale data.

ClickHouseFlinkIncremental Compute
0 likes · 22 min read
How Xiaohongshu Re‑engineered Its Data Architecture for the Big AI Data Era
DataFunTalk
DataFunTalk
Jul 11, 2026 · Big Data

How Xiaohongshu’s Data Architecture Evolved for the Big AI Data Era

The article details Xiaohongshu’s journey from a simple ClickHouse‑based ad‑hoc analytics stack to a Lambda‑style architecture and finally to a lakehouse with generic incremental compute, cutting architecture complexity, resource cost and development effort each to roughly one‑third while achieving sub‑10‑second query latency on petabyte‑scale data.

AIClickHouseIncremental Compute
0 likes · 21 min read
How Xiaohongshu’s Data Architecture Evolved for the Big AI Data Era
DataFunTalk
DataFunTalk
Jul 6, 2026 · Big Data

How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era

Xiaohongshu transformed its data platform from a simple ClickHouse‑based ad‑hoc analysis system to a Lambda‑style architecture and finally to a lakehouse with incremental compute, cutting architecture complexity, resource and development costs by one‑third while delivering second‑level queries over petabyte‑scale data.

ClickHouseFlinkIncremental Compute
0 likes · 23 min read
How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era
AI Programming Lab
AI Programming Lab
Jul 3, 2026 · Databases

Why OceanBase’s AI Database Is More Than Just a Vector Store

The article analyzes how OceanBase’s new AI‑native database tackles the data‑layer challenges of autonomous agents by introducing logical tables, multi‑modal storage, Fork DB sandboxes and lake‑warehouse integration, arguing that the product’s value lies beyond simple vector retrieval.

AI DatabaseConsistencyFork DB
0 likes · 12 min read
Why OceanBase’s AI Database Is More Than Just a Vector Store
ITPUB
ITPUB
Jul 2, 2026 · Databases

Why OceanBase Built Lakebase: The Need for an AI‑Ready Lake‑Database

Lakebase, the core engine of OceanBase AI Database, unifies storage, management, computation and search for structured, unstructured and vector data, offering multimodal data capabilities, flexible deployment modes, and AI‑oriented use cases such as autonomous driving and financial document analytics.

AI DatabaseAI applicationsData Management
0 likes · 9 min read
Why OceanBase Built Lakebase: The Need for an AI‑Ready Lake‑Database
DataFunTalk
DataFunTalk
Jun 30, 2026 · Big Data

How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era

Xiaohongshu, with over 3.5 billion monthly users and daily logs in the trillions, migrated 500 PB of data to Alibaba Cloud and iterated its data platform through four architecture generations—ClickHouse‑based ad‑hoc, Lambda, Lakehouse, and a unified incremental compute model—cutting resource, development, and storage costs to one‑third while delivering sub‑10‑second query latency at petabyte scale.

ClickHouseFlinkIncremental Compute
0 likes · 22 min read
How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era
DataFunTalk
DataFunTalk
Jun 24, 2026 · Big Data

How Xiaohongshu Re‑engineered Its Data Architecture for the Big AI Data Era

Xiaohongshu, with over 350 million monthly users and daily logs in the billions, migrated its data platform from AWS to Alibaba Cloud and iterated four times—from a ClickHouse‑based ad‑hoc layer to a Lambda architecture and finally a Lakehouse with incremental compute—cutting architecture complexity, resource cost and development effort each to about one‑third while delivering second‑level analytics on trillion‑scale data.

ClickHouseFlinkIncremental Compute
0 likes · 22 min read
How Xiaohongshu Re‑engineered Its Data Architecture for the Big AI Data Era
DataFunTalk
DataFunTalk
Jun 20, 2026 · Big Data

How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era

The article details Xiaohongshu's step‑by‑step migration from a simple ClickHouse‑based analytics stack to a Lambda‑style 2.0 architecture and finally to a Lakehouse‑based 3.0 design, highlighting concrete performance numbers, cost reductions, and the definition of a generic incremental‑compute model (SPOT) that underpins the evolution.

ClickHouseFlinkIncremental Compute
0 likes · 22 min read
How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era
StarRocks
StarRocks
Jun 12, 2026 · Big Data

Building a Millisecond-Responsive Real-Time Data Engine with StarRocks, Fluss, and Paimon

This article presents a lake‑stream integrated solution that combines Apache Fluss, Apache Paimon, and StarRocks to achieve second‑level data freshness, tenfold storage cost reduction, and a single‑query access pattern for both real‑time and historical data, detailing its architecture, advantages, query modes, and future roadmap.

FlussPaimonStarRocks
0 likes · 13 min read
Building a Millisecond-Responsive Real-Time Data Engine with StarRocks, Fluss, and Paimon
DataFunTalk
DataFunTalk
May 28, 2026 · Big Data

How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era

Xiaohongshu transformed its data platform from a simple ClickHouse‑based ad‑hoc analysis to a Lambda‑style architecture and finally to a lakehouse with generic incremental compute, cutting architecture complexity, resource and development costs by one‑third while delivering second‑level queries over trillions of rows.

ClickHouseFlinkIncremental Compute
0 likes · 21 min read
How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era
Lakehouse Research Base
Lakehouse Research Base
May 27, 2026 · Databases

Paimon Bloom Index Deep Dive: 25x Query Speedup from 38s to 1.5s with Production Best Practices

This article analyzes Paimon Bloom Index internals, demonstrates a real-world 25x query acceleration (38s to 1.5s) on a 400GB partitioned table, explains false positive rates, optimal use cases, and provides production-ready configuration patterns for StarRocks+Paimon lakehouse architectures.

Bloom IndexData EngineeringFalse Positive Rate
0 likes · 19 min read
Paimon Bloom Index Deep Dive: 25x Query Speedup from 38s to 1.5s with Production Best Practices
DataFunTalk
DataFunTalk
May 22, 2026 · Big Data

How Xiaohongshu Cut Data Architecture Complexity and Cost by One‑Third in the Big AI Data Era

The article details Xiaohongshu's evolution from a simple ClickHouse‑based analytics layer to a Lambda‑enabled 2.0 stack and finally a Lakehouse‑based 3.0 architecture, showing how each iteration reduced infrastructure complexity, resource consumption and development effort by roughly one‑third while supporting trillions of daily events and AI‑driven use cases.

ClickHouseFlinkIncremental Compute
0 likes · 21 min read
How Xiaohongshu Cut Data Architecture Complexity and Cost by One‑Third in the Big AI Data Era
DataFunTalk
DataFunTalk
May 21, 2026 · Databases

How the Agent Paradigm Is Redefining Enterprise Data Infrastructure

The article examines how the rise of AI agents is reshaping enterprise data infrastructure, tracing software evolution from rule‑based systems to lakehouses and arguing that real‑time OLAP engines with sub‑second latency, hybrid search, and semantic schemas will become the core of the new Agent‑centric stack.

Data InfrastructureLLMReal-time OLAP
0 likes · 13 min read
How the Agent Paradigm Is Redefining Enterprise Data Infrastructure
StarRocks
StarRocks
May 20, 2026 · Big Data

How StarRocks, Paimon, and Fluss Enable Multimodal Fusion Search in a Lakehouse

The Streaming Lakehouse Meetup (May 27) explores breaking data silos by unifying structured tables, images, video, audio, and high‑dimensional vectors through StarRocks‑Paimon‑Fluss integration, covering multimodal fusion retrieval, vector search internals, native reader/writer performance gains, and real‑world ANN indexing practices.

FlussPaimonStarRocks
0 likes · 5 min read
How StarRocks, Paimon, and Fluss Enable Multimodal Fusion Search in a Lakehouse
DataFunSummit
DataFunSummit
May 20, 2026 · Databases

Apache Doris 4.1: A Unified Data Store and Retrieval Engine for AI & Search

Apache Doris 4.1 introduces a systematic evolution for AI and search workloads, adding low‑cost massive vector storage, unified structured, full‑text and vector search, 100 MB JSON document support, Segment V3 metadata decoupling, sparse column optimizations, lakehouse lifecycle management, and a suite of performance‑boosting features such as aggregate push‑down, condition cache, and spill‑to‑disk, all backed by detailed benchmark results.

AIApache DorisSQL
0 likes · 30 min read
Apache Doris 4.1: A Unified Data Store and Retrieval Engine for AI & Search
DataFunSummit
DataFunSummit
May 14, 2026 · Big Data

How Gravitino, Daft, and Lance Enable Secure, AI‑Driven Multimodal Lakehouse

The article examines the challenges of multimodal data in modern lakehouses and presents a three‑tool stack—Gravitino, Daft, and Lance—that provides unified metadata, distributed multimodal compute, and high‑performance storage, while detailing security governance, integration paths, and future directions.

DaftGravitinoLance
0 likes · 11 min read
How Gravitino, Daft, and Lance Enable Secure, AI‑Driven Multimodal Lakehouse
DataFunTalk
DataFunTalk
May 11, 2026 · Big Data

How Xiaohongshu Re‑engineered Its Data Architecture for the Big AI Data Era

Xiaohongshu transformed its data platform from a simple ClickHouse‑based ad‑hoc analysis to a Lambda‑style architecture and finally to a lakehouse built on Iceberg, StarRocks, Flink and Spark, cutting architecture complexity, resource and development costs by two‑thirds while supporting trillions of daily events with sub‑second query latency.

ClickHouseFlinkIncremental Compute
0 likes · 22 min read
How Xiaohongshu Re‑engineered Its Data Architecture for the Big AI Data Era
DataFunTalk
DataFunTalk
May 6, 2026 · Big Data

How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era

The article details Xiaohongshu's four‑stage data‑platform evolution—from a simple ClickHouse ad‑hoc setup to a Lambda‑based 2.0 design and finally a lakehouse‑driven 3.0 architecture—highlighting the adoption of general incremental compute, cost‑reduction to one‑third, performance gains of up to ten‑fold, and the SPOT standards that guide the new system.

ClickHouseFlinkIncremental Compute
0 likes · 21 min read
How Xiaohongshu Evolved Its Data Architecture for the Big AI Data Era
DataFunTalk
DataFunTalk
Apr 29, 2026 · Big Data

How Xiaohongshu Revamped Its Data Architecture for the Big AI Data Era

Xiaohongshu transformed its data platform from a simple ClickHouse‑based analytics stack to a unified lakehouse with generic incremental compute, cutting architecture complexity, resource cost, and development effort by roughly one‑third while supporting petabyte‑scale, sub‑second queries across its 350 million‑user app.

ClickHouseFlinkIncremental Compute
0 likes · 22 min read
How Xiaohongshu Revamped Its Data Architecture for the Big AI Data Era
DataFunTalk
DataFunTalk
Apr 22, 2026 · Industry Insights

How Xiaohongshu Cut Data Platform Costs by Two‑Thirds with Incremental Computing

This article details Xiaohongshu's journey from a ClickHouse‑based batch analytics stack to a unified lakehouse architecture powered by generic incremental computing, showing how the company reduced architecture complexity, resource consumption and development effort each to roughly one‑third while supporting trillions of daily events with sub‑10‑second query latency.

Xiaohongshubig datadata architecture
0 likes · 24 min read
How Xiaohongshu Cut Data Platform Costs by Two‑Thirds with Incremental Computing
StarRocks
StarRocks
Apr 16, 2026 · Databases

Why Traditional Databases Stall AI Agents—and How StarRocks Overcomes the Bottleneck

Traditional databases were built for low‑frequency, human‑driven queries, but AI agents generate dozens of concurrent, sub‑second queries that expose architectural limits, and StarRocks addresses these challenges with self‑healing optimization, real‑time data pipelines, extreme concurrency handling, and seamless lakehouse access.

Database ConcurrencySelf-HealingStarRocks
0 likes · 13 min read
Why Traditional Databases Stall AI Agents—and How StarRocks Overcomes the Bottleneck
DataFunTalk
DataFunTalk
Apr 16, 2026 · Big Data

How Xiaohongshu Cut Data Architecture Costs by Two‑Thirds with Incremental Computing

This article details Xiaohongshu's data platform evolution from a simple ClickHouse‑based ad‑hoc system to a Lambda‑style architecture and finally a lakehouse solution, highlighting how the adoption of a new incremental computing model reduced architectural complexity, resource consumption and development effort each to roughly one‑third while delivering sub‑second query performance on petabyte‑scale data.

Xiaohongshubig datadata architecture
0 likes · 21 min read
How Xiaohongshu Cut Data Architecture Costs by Two‑Thirds with Incremental Computing
DataFunTalk
DataFunTalk
Apr 10, 2026 · Big Data

How Xiaohongshu Cut Data Architecture Costs by Two‑Thirds with Incremental Computing

This article analyzes Xiaohongshu's data platform evolution—from a simple ClickHouse‑based analytics layer to a Lambda architecture and finally a lakehouse design—highlighting how adopting a new incremental computing model reduced architecture complexity, resource consumption, and development effort each to roughly one‑third while delivering sub‑second query performance on petabyte‑scale data.

Xiaohongshubig datadata architecture
0 likes · 22 min read
How Xiaohongshu Cut Data Architecture Costs by Two‑Thirds with Incremental Computing
Baidu Geek Talk
Baidu Geek Talk
Mar 23, 2026 · Databases

How Baidu’s MEG Platform Revamped ClickHouse with a Lakehouse Architecture

This article analyzes the challenges of scaling ClickHouse within Baidu’s MEG data platform and details a lake‑house solution that decouples storage and compute, integrates a meta‑service for transparent data access, optimizes query performance through caching, data roll‑up and layout tuning, and introduces a unified query gateway that gracefully falls back to Spark for complex workloads.

ClickHouseData PlatformQuery Gateway
0 likes · 25 min read
How Baidu’s MEG Platform Revamped ClickHouse with a Lakehouse Architecture
TechVision Expert Circle
TechVision Expert Circle
Mar 17, 2026 · Industry Insights

How Leading CTOs Build an End-to-End Data Pipeline from Collection to AI‑Driven Insight

The article outlines a full‑stack data architecture for 2026, covering edge‑preprocessed collection, unified observability with OpenTelemetry, CDC‑based real‑time sync, a Kafka‑Flink‑Iceberg processing stack, Data Mesh governance, and AI‑Agent powered insight, while offering practical adoption paths and pitfalls to avoid.

AI agentCDCFlink
0 likes · 14 min read
How Leading CTOs Build an End-to-End Data Pipeline from Collection to AI‑Driven Insight
StarRocks
StarRocks
Mar 5, 2026 · Big Data

How Fanatics Scaled to PB‑Level Data with StarRocks & Apache Iceberg Lakehouse

Fanatics unified its fragmented data stack by building a StarRocks‑powered Lakehouse on Apache Iceberg, replacing Redshift, Snowflake, Athena, and Druid, which cut costs by up to 95%, delivered sub‑second dashboard queries on petabyte‑scale data, and enabled real‑time and historical analytics on a single platform.

Apache IcebergFanaticsStarRocks
0 likes · 10 min read
How Fanatics Scaled to PB‑Level Data with StarRocks & Apache Iceberg Lakehouse
Lakehouse Research Base
Lakehouse Research Base
Feb 12, 2026 · Big Data

Spark & Flink in Lakehouse: Latency, Accuracy & Cost Trade-offs for Batch-Stream Design

This article analyzes how Spark and Flink should divide responsibilities in lakehouse architectures by evaluating three core dimensions—data latency, computation accuracy, and resource cost—arguing that mature batch-stream integration balances business needs against technical overhead rather than pursuing universal real-time processing.

Computation AccuracyData LatencyFlink
0 likes · 9 min read
Spark & Flink in Lakehouse: Latency, Accuracy & Cost Trade-offs for Batch-Stream Design
StarRocks
StarRocks
Feb 11, 2026 · Big Data

How StarRocks and Apache Paimon Build a True Lakehouse Native Engine

This article details the deep integration of StarRocks with Apache Paimon, describing the unified architecture, version evolution, performance enhancements, time‑travel queries, native readers/writers, distributed planning, and future roadmap for achieving lakehouse‑native analytics at scale.

Apache PaimonStarRocksTime Travel
0 likes · 10 min read
How StarRocks and Apache Paimon Build a True Lakehouse Native Engine
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Feb 2, 2026 · Big Data

Real‑Time Analytics with Alibaba Cloud Serverless Spark & Paimon for Taobao Flash Sale

This article details how Alibaba Cloud EMR Serverless Spark combined with the Paimon lakehouse framework enables Taobao Flash Sale’s retail data team to achieve low‑latency, high‑throughput real‑time analytics, batch processing, and feature generation, outlining architecture evolution, performance gains, and practical Spark tuning techniques.

PaimonPerformance TuningSpark
0 likes · 18 min read
Real‑Time Analytics with Alibaba Cloud Serverless Spark & Paimon for Taobao Flash Sale
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Feb 2, 2026 · Big Data

How We Built a Scalable Lakehouse Architecture with StarRocks, Paimon, and Flink

This article details the evolution of a data warehouse at RenliJia from a MaxCompute‑centric setup to a modern lakehouse using StarRocks, Paimon, Flink, and Fluss, describing design goals, technical evaluations, implementation steps for offline, OLAP, and real‑time workloads, and the challenges and future plans that emerged.

FlinkPaimonStarRocks
0 likes · 25 min read
How We Built a Scalable Lakehouse Architecture with StarRocks, Paimon, and Flink
StarRocks
StarRocks
Jan 15, 2026 · Artificial Intelligence

How AI‑First Lakehouse Redefines Data Platforms for Multimodal Analytics

The article outlines the evolution from traditional OLAP to an AI‑first Lakehouse, detailing unified multimodal storage, CPU/GPU heterogeneous scheduling, native vector search, in‑database AI inference, agent‑centric execution, and self‑evolving platform capabilities that together reshape modern data analytics.

AIIn‑Database InferenceVector Search
0 likes · 11 min read
How AI‑First Lakehouse Redefines Data Platforms for Multimodal Analytics
Data Integration and Governance
Data Integration and Governance
Jan 12, 2026 · Big Data

Choosing the Right Real‑Time Data Architecture: Tech Options and Performance Trade‑offs

The article explains that real‑time data processing requires not only speed but also accuracy, stability, and long‑term maintainability, compares Lambda, Kappa, and unified batch‑stream architectures, discusses lakehouse storage, and provides practical guidance on selecting the most suitable approach for different project needs.

FlinkKappa architectureLambda architecture
0 likes · 9 min read
Choosing the Right Real‑Time Data Architecture: Tech Options and Performance Trade‑offs
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jan 8, 2026 · Big Data

How Gaode Maps Built a Real‑Time Lakehouse for Billion‑Scale Trajectory Data

This article details Gaode Maps' end‑to‑end lakehouse solution for massive, high‑frequency trajectory data, covering the challenges of real‑time visibility, query performance, and storage cost, and explaining how a hot‑warm‑cold tiering architecture built on Apache Flink, Paimon, StarRocks, Redis and Lindorm delivers millisecond‑level queries while cutting storage expenses.

Apache FlinkApache PaimonStarRocks
0 likes · 19 min read
How Gaode Maps Built a Real‑Time Lakehouse for Billion‑Scale Trajectory Data
Lakehouse Research Base
Lakehouse Research Base
Jan 8, 2026 · Big Data

SME Data Architecture Selection: Lightweight Lakehouse Implementation Guide

This article provides a practical framework for SMEs to select and implement data platform architectures, comparing traditional warehouses, lakehouse, and multimodal data lakes across cost, ROI, and operational efficiency, with scenario-based recommendations and a lightweight lakehouse implementation guide using open-source stack Flink, Paimon, StarRocks, and MinIO.

FlinkPaimonSME
0 likes · 21 min read
SME Data Architecture Selection: Lightweight Lakehouse Implementation Guide
StarRocks
StarRocks
Jan 7, 2026 · Big Data

How Gaode Maps Built a Real‑Time Lakehouse for Billion‑Scale Trajectory Data

This article details Gaode Maps' end‑to‑end lakehouse solution for handling high‑frequency, high‑volume trajectory data, covering the challenges of real‑time visibility, multi‑scenario queries, storage cost, and data silos, and describing the layered storage architecture, performance validation, and future expansion plans.

Apache FlinkStarRocksTrajectory Storage
0 likes · 21 min read
How Gaode Maps Built a Real‑Time Lakehouse for Billion‑Scale Trajectory Data
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
Jan 6, 2026 · Industry Insights

Apache Paimon: Boosting Real-Time Data Lakes for Fraud Detection & Manufacturing

This article examines Apache Paimon’s innovative lakehouse architecture, detailing its LSM‑Tree storage, flexible merge engine, and multi‑engine integration, and showcases two real‑world deployments—an operator’s real‑time fraud‑prevention system and a manufacturing firm’s unified data platform—highlighting performance gains and cost reductions.

Apache PaimonReal-time Data Lakebig data
0 likes · 15 min read
Apache Paimon: Boosting Real-Time Data Lakes for Fraud Detection & Manufacturing
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Dec 30, 2025 · Big Data

How StarRocks and Apache Paimon Unite to Build a True Lakehouse Native Engine

StarRocks and Apache Paimon have been progressively integrated across multiple releases, enabling a unified lakehouse architecture that supports multi-source federated analysis, time-travel queries, native readers/writers, distributed planning, and advanced profiling, while delivering performance gains that bring Paimon query speed on par with native StarRocks tables.

Apache PaimonStarRocksdata integration
0 likes · 9 min read
How StarRocks and Apache Paimon Unite to Build a True Lakehouse Native Engine
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Dec 24, 2025 · Big Data

How Paimon’s Column‑Separation Architecture Powers Real‑Time Multi‑Modal Lakehouse for AI

This article explains the challenges of frequent column changes in AI feature engineering, introduces Paimon’s column‑separation storage with a global continuous Row ID, details its Blob data type for efficient multi‑modal handling, and outlines production results and future roadmap for building an AI‑native data lakehouse.

Apache PaimonBLOBbig data
0 likes · 11 min read
How Paimon’s Column‑Separation Architecture Powers Real‑Time Multi‑Modal Lakehouse for AI
Lakehouse Research Base
Lakehouse Research Base
Dec 21, 2025 · Databases

StarRocks Join Performance Gap: Paimon/Iceberg vs Internal Tables - Root Causes & Fixes

This article analyzes why StarRocks multi-table joins on Paimon/Iceberg tables remain significantly slower than internal tables even after cache warming, detailing six root causes across storage format, data layout, caching, execution engine, metadata, and version management, plus four optimization strategies to narrow the gap.

Join PerformanceOLAPPaimon
0 likes · 17 min read
StarRocks Join Performance Gap: Paimon/Iceberg vs Internal Tables - Root Causes & Fixes
StarRocks
StarRocks
Dec 18, 2025 · Databases

How Fresha Scaled Real‑Time Analytics with StarRocks: A Deep Dive into Their Hybrid Architecture

Facing Postgres overload and costly Snowflake queries, Fresha rebuilt its analytics platform by introducing StarRocks as a unified SQL entry point, combining federated lakehouse queries with high‑performance internal tables, which reduced homepage query latency to around 200 ms and achieved minute‑level data freshness across real‑time, historical, and search workloads.

StarRockscompute-storage separationdata pipeline
0 likes · 20 min read
How Fresha Scaled Real‑Time Analytics with StarRocks: A Deep Dive into Their Hybrid Architecture
DataFunSummit
DataFunSummit
Dec 1, 2025 · Big Data

7 Cutting-Edge Data Engineering Practices Shaping AI-Driven Data Lakes

This article collection showcases seven advanced data engineering solutions—from Tencent Cloud's Iceberg batch‑stream integration and Apache Gravitino metadata lineage to Xiaohongshu's Lakehouse evolution and multimodal AI data lake implementations—highlighting architectural innovations, performance optimizations, and real‑world deployment insights for modern big‑data platforms.

Apache GravitinoApache IcebergBatch-Stream Integration
0 likes · 7 min read
7 Cutting-Edge Data Engineering Practices Shaping AI-Driven Data Lakes
Lakehouse Research Base
Lakehouse Research Base
Nov 30, 2025 · Big Data

Apache Paimon 1.3: 150x Faster Queries, Pure Python SDK, AI-Ready Lakehouse

Apache Paimon 1.3 introduces incremental clustering for 150x faster append-table queries, a pure Python SDK 95x faster than its JVM-based predecessor, data evolution cutting wide-table storage by 99.4%, a virtual file system for unified cross-engine access, and upcoming vector storage for AI workloads.

AI Data ManagementApache PaimonData Evolution
0 likes · 8 min read
Apache Paimon 1.3: 150x Faster Queries, Pure Python SDK, AI-Ready Lakehouse
Big Data Technology & Architecture
Big Data Technology & Architecture
Nov 28, 2025 · Big Data

What’s New in Apache Paimon 2025? Core Performance, AI Integration & Real‑Time Lakehouse Updates

The 2025 Apache Paimon release brings major performance boosts, AI‑centric multimodal storage, deeper streaming‑batch integration, and broader engine compatibility, detailing query and write optimizations, memory management tweaks, and a unified lake format for structured and unstructured data.

AI IntegrationApache Paimonbig data
0 likes · 6 min read
What’s New in Apache Paimon 2025? Core Performance, AI Integration & Real‑Time Lakehouse Updates
Alibaba Cloud Developer
Alibaba Cloud Developer
Nov 20, 2025 · Big Data

Mastering Large‑Scale Data Migration: Challenges, Strategies and Real‑World Solutions

This article explains why data migration is the essential first step for cloud modernization, outlines the technical challenges of moving terabytes to petabytes, compares physical and logical migration methods, and presents practical solutions and real‑world case studies across Hive, cloud warehouses, lake‑house formats and analytic databases.

ETLbig datacloud platforms
0 likes · 56 min read
Mastering Large‑Scale Data Migration: Challenges, Strategies and Real‑World Solutions
Lakehouse Research Base
Lakehouse Research Base
Nov 15, 2025 · Big Data

StarRocks Lakehouse: Internal Tables vs. Paimon/Iceberg – 5-10x Performance Gains

The article benchmarks StarRocks internal tables against Paimon and Iceberg lake tables using TPCH 100G, shows internal tables excel at real-time analytics while lake tables optimize cold storage cost and multi-engine sharing, and details optimization strategies (metadata, data cache, predicate pushdown) achieving 5-10x speedup, illustrated by a retail case study cutting query latency from seconds to milliseconds and storage cost by 65%.

Data CacheHot-Cold TieringPaimon
0 likes · 9 min read
StarRocks Lakehouse: Internal Tables vs. Paimon/Iceberg – 5-10x Performance Gains
Smart Sea Tide
Smart Sea Tide
Nov 4, 2025 · Big Data

Implementing an Integrated Data Lake and Lakehouse Architecture with Apache Iceberg and Flink

The article explains the concepts of data lakes and lakehouses, compares them with traditional data warehouses, outlines the reliability, performance, and security challenges of data lakes, and then details a practical lakehouse implementation using Apache Iceberg, Flink SQL, CDC pipelines, and supporting tools such as Hive Metastore and Trino.

Apache IcebergCDCFlink
0 likes · 18 min read
Implementing an Integrated Data Lake and Lakehouse Architecture with Apache Iceberg and Flink
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 13, 2025 · Databases

Apache Doris 3.1 Unveiled: Variant, Index, and Lakehouse Boosts

The Apache Doris 3.1 release strengthens lake‑house capabilities with major upgrades to the VARIANT data type, vertical compaction, inverted index storage, new tokenizers, enhanced materialized view support for Iceberg/Paimon/Hudi, and numerous query‑performance optimizations such as faster partition pruning and dynamic partition clipping, offering smoother handling of thousands of columns and large‑scale semi‑structured data.

Apache DorisIndexQuery Performance
0 likes · 8 min read
Apache Doris 3.1 Unveiled: Variant, Index, and Lakehouse Boosts
DataFunSummit
DataFunSummit
Oct 4, 2025 · Big Data

How Xiaohongshu Cut Data Architecture Costs by Two‑Thirds with Incremental Computing

This article details how Xiaohongshu's massive user‑generated data platform evolved from a simple ClickHouse‑based architecture to a multi‑stage lakehouse design, adopting a new incremental computing model that reduced architecture complexity, resource and development costs by one‑third while boosting query performance for petabyte‑scale data.

incremental computinglakehouse
0 likes · 19 min read
How Xiaohongshu Cut Data Architecture Costs by Two‑Thirds with Incremental Computing
IT Architects Alliance
IT Architects Alliance
Sep 21, 2025 · Big Data

From Data Warehouses to Lakehouses: Why Data Architecture Keeps Evolving

This article traces the three‑generation evolution of data architecture—from the structured‑data era of data warehouses, through the flexible, multi‑format data lake, to the unified lakehouse model—explaining the drivers, benefits, challenges, and future trends shaping modern data platforms.

data architecturedata lakedata warehouse
0 likes · 11 min read
From Data Warehouses to Lakehouses: Why Data Architecture Keeps Evolving
High Availability Architecture
High Availability Architecture
Sep 10, 2025 · Big Data

How Ctrip Business Travel Built a Near‑Real‑Time Lakehouse with Flink CDC & Paimon

This article details Ctrip Business Travel’s implementation of a near‑real‑time data warehouse using Flink CDC and the Paimon lakehouse engine, covering order wide‑table construction, ticket refund alerts, ad attribution, batch‑stream integration, and practical lessons on Partial Update, Aggregation, and Tag‑based incremental processing.

Batch-Stream IntegrationFlinkPaimon
0 likes · 17 min read
How Ctrip Business Travel Built a Near‑Real‑Time Lakehouse with Flink CDC & Paimon
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 8, 2025 · Big Data

How Ele.me Revolutionized Real‑Time Data Warehousing with Flink‑Paimon Lakehouse

In this detailed case study, Alibaba’s Ele.me team explains how they evolved from siloed, chimney‑style real‑time warehouses to a unified Flink‑Paimon lakehouse, highlighting the three development stages, technology evaluations, the Alake platform’s one‑stop capabilities, production results, and future directions such as Fluss and AI integration.

AlakeFlinkPaimon
0 likes · 17 min read
How Ele.me Revolutionized Real‑Time Data Warehousing with Flink‑Paimon Lakehouse
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 5, 2025 · Big Data

How StarRocks + Paimon Powered Real‑Time Analytics for Alibaba’s Taobao Flash Sale

Facing minute‑level decision demands and billions of marketing events during Taobao's Flash Sale, the Ele.me data team built a real‑time lakehouse with StarRocks and Paimon, leveraging asynchronous materialized views, RoaringBitmap de‑duplication, and resource isolation to achieve sub‑second query latency, lower storage costs, and stable high‑concurrency.

PaimonRoaringBitmapStarRocks
0 likes · 25 min read
How StarRocks + Paimon Powered Real‑Time Analytics for Alibaba’s Taobao Flash Sale
StarRocks
StarRocks
Sep 2, 2025 · Big Data

How StarRocks + Paimon Powered Real‑Time Analytics for Alibaba’s Flash Sale

Faced with billions of marketing events and minute‑level decision requirements during Taobao's flash‑sale campaign, the e‑commerce data team built a real‑time lakehouse using StarRocks and Paimon, leveraged asynchronous materialized views and RoaringBitmap deduplication, and achieved sub‑second query latency, massive cost savings, and stable high‑concurrency performance.

PaimonRoaringBitmapStarRocks
0 likes · 26 min read
How StarRocks + Paimon Powered Real‑Time Analytics for Alibaba’s Flash Sale
Ctrip Technology
Ctrip Technology
Sep 2, 2025 · Big Data

How Ctrip Built a Near‑Real‑Time Lakehouse with Flink & Paimon

This article details Ctrip Business Travel’s implementation of a near‑real‑time data warehouse and lakehouse using Flink CDC and Apache Paimon, covering order wide‑table construction, automated ticket reminders, ad attribution, batch‑stream integration, and lessons on Partial Update, Aggregation, and Tag‑based incremental processing.

Batch-Stream IntegrationFlinkPaimon
0 likes · 17 min read
How Ctrip Built a Near‑Real‑Time Lakehouse with Flink & Paimon
StarRocks
StarRocks
Aug 19, 2025 · Big Data

How Joydata Scaled to 150 Billion Daily Events with StarRocks: A Data Architecture Journey

Facing daily data growth from millions to 150 billion records, Joydata‑U transformed its analytics platform through three architectural stages—Hadoop, Hadoop + Trino, and finally StarRocks—introducing resource isolation, Flat JSON acceleration, and Bitmap indexing to cut query latency by up to seven times and achieve sub‑2‑minute data freshness across BI, ad‑tech, game analytics, and CRM workloads.

Bitmap IndexFlat JSONFlink
0 likes · 12 min read
How Joydata Scaled to 150 Billion Daily Events with StarRocks: A Data Architecture Journey
Big Data Technology Tribe
Big Data Technology Tribe
Aug 12, 2025 · Databases

Why Lakehouse Architecture Is Redefining Modern Data Platforms

This article explains the evolution from traditional data warehouses and data lakes to the unified Lakehouse architecture, detailing its design, benefits, challenges, and research directions for delivering high‑performance SQL and advanced analytics on open‑format storage.

Metadata LayerSQL Optimizationbig data
0 likes · 20 min read
Why Lakehouse Architecture Is Redefining Modern Data Platforms