BestHub
Sign in
Lakehouse Research Base
Author

Lakehouse Research Base

Focused on technical sharing in the data field, covering a tech stack that includes Hadoop, Spark, Flink, Kafka, Fluss, Paimon, Iceberg, StarRocks, ClickHouse, ES, Milvus, and more. Welcome to follow.

90
Articles
0
Likes
310
Views
0
Comments
Recent Articles

Latest from Lakehouse Research Base

90 recent articles
Lakehouse Research Base
Lakehouse Research Base
Oct 27, 2026 · Databases

Unified Lakehouse Retrieval: One SQL for Hybrid Keyword, Filter, and Vector Search

The article explains how Alibaba Cloud EMR Serverless StarRocks converges full-text, scalar, and vector search into a single engine using RRF for score fusion, In-Filter for predicate pushdown into vector search, and Partial Update for column-level annotation writes, reducing data movement and operational complexity.

Hybrid SearchIn-FilterLakehouse
0 likes · 11 min read
Unified Lakehouse Retrieval: One SQL for Hybrid Keyword, Filter, and Vector Search
Lakehouse Research Base
Lakehouse Research Base
Oct 24, 2026 · Big Data

Apache Paimon 2.0 Multimodal Lakehouse: BLOB, VECTOR, and Indexing Realities

This article analyzes Apache Paimon 2.0's multimodal lakehouse capabilities, distinguishing Object Table from BLOB storage, clarifying that VECTOR type alone doesn't enable similarity search, detailing indexing visibility pitfalls, and comparing lakehouse retrieval with dedicated vector databases like Milvus.

AI data engineeringANN searchApache Paimon
0 likes · 14 min read
Apache Paimon 2.0 Multimodal Lakehouse: BLOB, VECTOR, and Indexing Realities
Lakehouse Research Base
Lakehouse Research Base
Oct 22, 2026 · Big Data

Fluss: Real-Time AI Data Storage Foundation — Primary Key Tables, Delta Join & Latest State Delivery

This article analyzes Apache Fluss as a real-time data storage layer for AI workloads, detailing its primary key tables for current state and changelogs, Delta Join for reducing Flink state redundancy, TTL and tiering for lifecycle management, and clarifies that Fluss provides storage foundation but training-serving consistency requires additional pipeline governance.

Apache FlinkApache FlussDelta Join
0 likes · 22 min read
Fluss: Real-Time AI Data Storage Foundation — Primary Key Tables, Delta Join & Latest State Delivery
Lakehouse Research Base
Lakehouse Research Base
Oct 21, 2026 · Big Data

Agentic Lakehouse: Rethinking Data Architecture for AI Agents

This article explores how lakehouse architecture must evolve to serve AI agents as first-class users, covering a four-layer reference architecture, Apache Fluss 1.0 capabilities for real-time and historical data access, secure query and write-back patterns, and practical troubleshooting for production deployments.

AI AgentsAgentic LakehouseApache Fluss
0 likes · 39 min read
Agentic Lakehouse: Rethinking Data Architecture for AI Agents
Lakehouse Research Base
Lakehouse Research Base
Oct 19, 2026 · Big Data

Lakehouse: Mandatory Path or Over-Engineering? A Decision Framework for SMEs

The article provides a decision framework for enterprises evaluating Lakehouse adoption, arguing architecture should evolve with business complexity rather than follow trends. It defines six evaluation dimensions, contrasts Lakehouse with traditional OLAP, outlines phased evolution from basic analytics to streaming Lakehouse and AI data infrastructure, and warns against five common over-engineering pitfalls.

Apache FlussApache IcebergApache Paimon
0 likes · 34 min read
Lakehouse: Mandatory Path or Over-Engineering? A Decision Framework for SMEs
Lakehouse Research Base
Lakehouse Research Base
Oct 18, 2026 · Big Data

Migrating Core Real-Time Indexing from Kafka to Apache Fluss: Xiaohongshu's Engineering Journey

This article details Xiaohongshu's migration of its core real-time indexing pipeline from Kafka to Apache Fluss, covering architectural drivers like read amplification and historical replay contention, Fluss's columnar storage and Lakestream integration with Paimon, and a phased migration approach including baseline testing, shadow dual-run, and gradual cutover.

Apache FlussApache PaimonKafka
0 likes · 50 min read
Migrating Core Real-Time Indexing from Kafka to Apache Fluss: Xiaohongshu's Engineering Journey
Lakehouse Research Base
Lakehouse Research Base
Oct 18, 2026 · Big Data

Ziroom's One-Click Lake Ingestion: StreamPark + Paimon for 4400+ MySQL Tables

Ziroom migrated 4,400+ MySQL tables to a real-time lakehouse using Apache StreamPark and Paimon, replacing a complex Canal/Kafka/Flink/Airflow pipeline with standardized CDC ingestion, automated job deployment via StreamPark API, and Paimon's snapshot management to reduce source database load and operational overhead.

Apache FlinkApache PaimonApache StreamPark
0 likes · 35 min read
Ziroom's One-Click Lake Ingestion: StreamPark + Paimon for 4400+ MySQL Tables
Lakehouse Research Base
Lakehouse Research Base
Oct 15, 2026 · Databases

StarRocks Integrates Paimon C++ for Native Lake Query Execution

StarRocks integrates Paimon C++ (paimon-cpp) to enable native C++ execution paths for querying Apache Paimon tables, eliminating JNI overhead, supporting primary key merges and delete handling, and achieving 1.4-3.4x speedups in benchmarks while reusing StarRocks' caching, memory management, and query profiling.

JNILakehouseNative Execution
0 likes · 14 min read
StarRocks Integrates Paimon C++ for Native Lake Query Execution
Lakehouse Research Base
Lakehouse Research Base
Oct 13, 2026 · Big Data

Taobao's Real-Time Lakehouse: Breaking the Impossible Triangle with Apache Fluss

This article details how Taobao's instant retail team replaced their Kafka-Flink-Paimon stack with Apache Fluss to achieve second-level real-time decisions, using Delta Join for stateless dual-stream joins, Partial Update for decoupled wide-table writes, and Auto-Tiering to eliminate sync jobs, while contrasting Ele.me's Paimon+StarRocks evolutionary path.

Apache FlussApache PaimonAuto-Tiering
0 likes · 19 min read
Taobao's Real-Time Lakehouse: Breaking the Impossible Triangle with Apache Fluss