BestHub
Sign in
Lakehouse Research Base
Author

Lakehouse Research Base

Focused on technical sharing in the data field, covering a tech stack that includes Hadoop, Spark, Flink, Kafka, Fluss, Paimon, Iceberg, StarRocks, ClickHouse, ES, Milvus, and more. Welcome to follow.

90
Articles
0
Likes
310
Views
0
Comments
Recent Articles

Latest from Lakehouse Research Base

90 recent articles
Lakehouse Research Base
Lakehouse Research Base
Oct 12, 2026 · Big Data

Why Message Queues Can't Do Real-Time Aggregation: Alibaba Mama's Flink + Paimon Lakehouse

Alibaba Mama evolved its advertising real-time data warehouse from a message queue-based architecture to a Flink + Paimon streaming lakehouse, solving structural defects like lack of deduplication, aggregation layer support, and schema enforcement by leveraging Paimon's primary key upsert and changelog capabilities, while sharing production optimization practices and comparing storage choices for advertising vs. risk control scenarios.

Alibaba MamaClickHouseFlink
0 likes · 22 min read
Why Message Queues Can't Do Real-Time Aggregation: Alibaba Mama's Flink + Paimon Lakehouse
Lakehouse Research Base
Lakehouse Research Base
Oct 12, 2026 · Databases

Doris vs StarRocks: Which OLAP Engine Fits Your Workload and Team?

This article provides a practical decision framework for choosing between Apache Doris and StarRocks for real-time OLAP workloads, comparing their architectural origins, licensing, optimal use cases, and guiding teams through self-hosted versus managed deployment decisions based on organizational capacity and query profiles.

Apache DorisOLAPPoC checklist
0 likes · 13 min read
Doris vs StarRocks: Which OLAP Engine Fits Your Workload and Team?
Lakehouse Research Base
Lakehouse Research Base
Oct 11, 2026 · Big Data

Financial Risk Control Lakehouse: DiDi's StarRocks & Ant's Paimon Architecture

This article analyzes two financial risk control lakehouse architectures: DiDi uses StarRocks to unify real-time and batch feature serving with primary-key tables and bucket pruning, while Ant Group replaces HBase and Elasticsearch with Apache Paimon's first-row, partial-update, and sort-compaction mechanisms for long-window deduplication, fast reconciliation, and historical lookback.

Apache PaimonData ArchitectureLSM-tree
0 likes · 23 min read
Financial Risk Control Lakehouse: DiDi's StarRocks & Ant's Paimon Architecture
Lakehouse Research Base
Lakehouse Research Base
Oct 11, 2026 · Big Data

Real-Time Lakehouse Migration: Tongcheng's Hudi→Paimon Shift & Trip.com's StarRocks Unification

The article analyzes two online travel case studies: Tongcheng Travel migrating from Hudi to Paimon to solve slow large-table real-time writes using LSM-tree storage, and Trip.com adopting StarRocks with materialized views to unify lake queries and eliminate data warehouse copies, detailing migration methodologies, architectural reasoning, and production troubleshooting.

Apache HudiApache PaimonLSM-tree
0 likes · 22 min read
Real-Time Lakehouse Migration: Tongcheng's Hudi→Paimon Shift & Trip.com's StarRocks Unification
Lakehouse Research Base
Lakehouse Research Base
Oct 10, 2026 · Industry Insights

Before the Tide Washes You Up: Hard-Won Lessons for CS Students

A veteran reflects on the widening gap between university curricula and industry demands, urging computer science students to reverse-engineer learning from job descriptions, treat graduation projects as multi-year capstones, complete end-to-end projects, use AI as a tool not a crutch, maintain continuous output, and master English to access global opportunities.

AI toolsCapstone ProjectComputer Science Education
0 likes · 11 min read
Before the Tide Washes You Up: Hard-Won Lessons for CS Students
Lakehouse Research Base
Lakehouse Research Base
Oct 8, 2026 · R&D Management

Palantir's FDE+PDE Model: The Feedback Loop That Powers AI-Era Engineering

This article analyzes Palantir's Forward Deployed Engineer (FDE) and Product Development Engineer (PDE) model, explaining how continuous feedback from customer deployments drives platform evolution, why this approach solves complex enterprise AI integration challenges, and how AI agents are now automating the FDE role itself.

AI EngineeringEngineering OrganizationEnterprise AI
0 likes · 22 min read
Palantir's FDE+PDE Model: The Feedback Loop That Powers AI-Era Engineering
Lakehouse Research Base
Lakehouse Research Base
Oct 5, 2026 · Artificial Intelligence

Lakehouse + AI: Vector Database as Derived Index, Not New System

This article explains how to implement RAG within a lakehouse architecture by treating the vector database as a derived retrieval index rather than a separate system, covering embedding pipelines, Milvus index trade-offs, hybrid search, real-time updates via Flink, consistency governance, and troubleshooting common production issues.

ConsistencyEmbeddingFlink
0 likes · 22 min read
Lakehouse + AI: Vector Database as Derived Index, Not New System
Lakehouse Research Base
Lakehouse Research Base
Oct 3, 2026 · Big Data

Lakehouse Capacity Planning: Stress Testing, Bottleneck Detection & Scaling Decisions

This article presents a complete methodology for lakehouse performance stress testing and capacity planning, covering TPC-DS benchmark adaptation, end-to-end bottleneck identification across CPU, memory, disk, and network, a quantitative capacity derivation framework, and vertical versus horizontal scaling decision criteria for components like Kafka, Flink, Paimon, and StarRocks.

FlinkKafkaLakehouse
0 likes · 27 min read
Lakehouse Capacity Planning: Stress Testing, Bottleneck Detection & Scaling Decisions
Lakehouse Research Base
Lakehouse Research Base
Oct 1, 2026 · Databases

StarRocks Vectorized Execution & CBO Optimizer Deep Dive: Pipeline, CodeGen & Cost Model

This article provides a deep technical analysis of StarRocks' vectorized execution engine and cost-based optimizer, covering pipeline scheduling, vectorized operators, CodeGen/JIT compilation, statistics-driven cost modeling, parameter tuning strategies, and production troubleshooting methodologies for low-latency analytical queries.

CBO OptimizerCodeGenCost Model
0 likes · 40 min read
StarRocks Vectorized Execution & CBO Optimizer Deep Dive: Pipeline, CodeGen & Cost Model