BestHub
Sign in
Lakehouse Research Base
Author

Lakehouse Research Base

Focused on technical sharing in the data field, covering a tech stack that includes Hadoop, Spark, Flink, Kafka, Fluss, Paimon, Iceberg, StarRocks, ClickHouse, ES, Milvus, and more. Welcome to follow.

17
Articles
0
Likes
7
Views
0
Comments
Recent Articles

Latest from Lakehouse Research Base

17 recent articles
Lakehouse Research Base
Lakehouse Research Base
Sep 10, 2026 · Databases

Apache Fluss Virtual Tables: $changelog vs $binlog for Queryable Change Streams

This article deep-dives into Apache Fluss virtual tables, explaining how $changelog and $binlog suffixes expose change logs as read-only queryable tables, detailing their schemas, use cases, differences between PrimaryKey and Log tables, startup modes, limitations, and the design philosophy enabling native CDC consumption via SQL without external tools.

Apache FlussBinlogCDC
0 likes · 9 min read
Apache Fluss Virtual Tables: $changelog vs $binlog for Queryable Change Streams
Lakehouse Research Base
Lakehouse Research Base
Sep 6, 2026 · Big Data

StarRocks Query Acceleration on Paimon: Production Tuning & Best Practices

This article details production practices for accelerating StarRocks queries on Paimon external tables, covering architecture, table design (partitioning, bucketing, compaction), dirty data handling, catalog configuration, predicate pushdown verification, SQL optimization with partition/bucket pruning, query method selection (direct, async materialized views, hot/cold tiering), and BE-level tuning.

Bucket PruningCompactionLakehouse
0 likes · 22 min read
StarRocks Query Acceleration on Paimon: Production Tuning & Best Practices
Lakehouse Research Base
Lakehouse Research Base
Aug 31, 2026 · Big Data

Factory Lines & Data Pipelines: The Shared Orchestration DNA

This article reveals the deep structural isomorphism between manufacturing assembly lines and data pipeline orchestration, mapping five shared design philosophies, a 15-dimension logical correspondence, bidirectional lessons, and six practical mental models for data engineers to adopt factory-floor thinking.

assembly linedata engineeringdata orchestration
0 likes · 22 min read
Factory Lines & Data Pipelines: The Shared Orchestration DNA
Lakehouse Research Base
Lakehouse Research Base
Aug 25, 2026 · Big Data

StarRocks on Paimon: Morning Fast, Daytime Slow - Root Cause & Layered Optimization

This article analyzes why identical StarRocks queries on Paimon external tables run fast in early morning but slow dramatically during daytime peaks, identifying five layered root causes from file fragmentation to storage pressure, and provides a systematic troubleshooting methodology plus a four-layer optimization framework covering source governance, compute caching, storage scaling, and business scheduling.

CompactionDelete VectorLakehouse
0 likes · 21 min read
StarRocks on Paimon: Morning Fast, Daytime Slow - Root Cause & Layered Optimization
Lakehouse Research Base
Lakehouse Research Base
Aug 24, 2026 · Big Data

Apache Fluss: Four Merge Engines Explained for Real-Time Analytics

This article systematically analyzes Apache Fluss's four merge engines—Default (LastRow), FirstRow, Versioned, and Aggregation—covering core principles, supported operations, behavior examples, applicable scenarios, and a production selection guide for real-time data warehousing.

AggregationApache FlussFirstRow
0 likes · 14 min read
Apache Fluss: Four Merge Engines Explained for Real-Time Analytics
Lakehouse Research Base
Lakehouse Research Base
Aug 23, 2026 · Big Data

Apache Fluss Dual-Table Model: LogTable and PrimaryKeyTable Explained

This article details Apache Fluss's dual-table model where LogTable handles high-throughput append-only streaming with columnar storage while PrimaryKeyTable supports real-time updates, partial merges, and CDC changelogs via integrated RocksDB state storage, sharing unified tiering and lakehouse sinking.

Apache FlussCDCLakehouse
0 likes · 19 min read
Apache Fluss Dual-Table Model: LogTable and PrimaryKeyTable Explained
Lakehouse Research Base
Lakehouse Research Base
Aug 22, 2026 · Big Data

Apache Fluss: Dual Engines & Tiered Storage Power Real-Time Lakehouse

This article deep-dives into Apache Fluss architecture, detailing its Master-Worker design, dual LogStore and KvStore engines, tablet-based sharding, tiered hot/cold storage on remote object stores, and Flink-centric client integration, explaining how these components unify streaming and lakehouse workloads.

Apache FlussFlink connectorKvStore
0 likes · 14 min read
Apache Fluss: Dual Engines & Tiered Storage Power Real-Time Lakehouse
Lakehouse Research Base
Lakehouse Research Base
Aug 20, 2026 · Big Data

Big Data Across 10 Industries: Finance, New Energy & AI — Who Reigns as Data King?

This article maps big data applications across ten industries — finance, retail, manufacturing, healthcare, government, transportation, new energy, AI, agriculture, and property — detailing use cases, technical architectures, and measurable value, concluding that AI and new energy form a mutually reinforcing data-driven loop.

Big DataMLOpsagriculture
0 likes · 32 min read
Big Data Across 10 Industries: Finance, New Energy & AI — Who Reigns as Data King?
Lakehouse Research Base
Lakehouse Research Base
Aug 19, 2026 · Big Data

How 1565PB of High-Quality Datasets Are Reshaping Lakehouse Architecture for AI

China's high-quality dataset count hit 120,000 totaling 1,565 PB with 60% quarterly growth, exposing four systemic gaps in traditional BI-oriented lakehouse architectures — storage, governance, compute performance, and security — and driving an AI-native reference architecture built on Paimon, StarRocks, tiered storage, operator-level lineage, and multi-modal retrieval.

AI training dataApache PaimonStarRocks
0 likes · 43 min read
How 1565PB of High-Quality Datasets Are Reshaping Lakehouse Architecture for AI