Lakehouse Research Base
Author

Lakehouse Research Base

Focused on technical sharing in the data field, covering a tech stack that includes Hadoop, Spark, Flink, Kafka, Fluss, Paimon, Iceberg, StarRocks, ClickHouse, ES, Milvus, and more. Welcome to follow.

90
Articles
0
Likes
310
Views
0
Comments
Recent Articles

Latest from Lakehouse Research Base

90 recent articles
Lakehouse Research Base
Lakehouse Research Base
Aug 15, 2025 · Big Data

Big Data & Platform Engineering Fusion: Building Scalable Data Infrastructure

This article explores the convergence of big data engineering and platform engineering, detailing how platform engineering methodologies solve big data's complexity challenges through unified resource pooling, standardized pipelines, observability, and governance, delivering faster deployment, 30-50% resource utilization gains, and reduced MTTR.

Big DataElastic ScalingKubernetes
0 likes · 15 min read
Big Data & Platform Engineering Fusion: Building Scalable Data Infrastructure
Lakehouse Research Base
Lakehouse Research Base
Jul 24, 2025 · Big Data

Two Solutions for ElasticSearch Wildcard Index Collection: Flink ETL Outperforms Logstash/Kafka Pipeline

The author compares two architectures for collecting ElasticSearch wildcard index data when DataX lacks support: a Logstash-Kafka-MaxCompute pipeline with existing tools but longer chain, and a simpler Flink ETL approach writing directly to MaxCompute, concluding Flink is preferable due to lower cost and operational complexity.

DataXETLElasticsearch
0 likes · 3 min read
Two Solutions for ElasticSearch Wildcard Index Collection: Flink ETL Outperforms Logstash/Kafka Pipeline
Lakehouse Research Base
Lakehouse Research Base
May 30, 2025 · Fundamentals

Git Command Cheat Sheet: Basics, Branching, Remotes & Workflows

This comprehensive guide covers essential Git commands for repository initialization, file staging, committing, branching, merging, remote synchronization, undo operations, tagging, submodules, and workflow patterns like GitHub Flow and Git Flow, with practical examples and common pitfalls.

Gitbranchinggitflow
0 likes · 11 min read
Git Command Cheat Sheet: Basics, Branching, Remotes & Workflows
Lakehouse Research Base
Lakehouse Research Base
May 28, 2025 · Big Data

End-to-End Data Lifecycle Management: Closed-Loop Framework for Data Value

This article details a closed-loop Data Lifecycle Management (DLM) framework covering six stages—requirement confirmation, model design, development, testing, monitoring, and archiving—with governance practices, toolchains, and a bank case study showing reduced rework, storage costs, and model drift.

Data ArchivingData Lifecycle Managementcase study
0 likes · 12 min read
End-to-End Data Lifecycle Management: Closed-Loop Framework for Data Value
Lakehouse Research Base
Lakehouse Research Base
May 22, 2025 · Big Data

Four Core Data Science Challenges and the DataOps Solution

The article identifies four core challenges in data science—data acquisition and management, technical engineering gaps, team collaboration barriers, and maintenance issues—and proposes a DataOps approach across technology, process, and organization to transform data assets into business value.

DataOpsMLOpsTechnical Debt
0 likes · 9 min read
Four Core Data Science Challenges and the DataOps Solution
Lakehouse Research Base
Lakehouse Research Base
May 20, 2025 · Big Data

Why DataOps Jobs Will Explode: The Chemistry of Analytics, Lean, Agile & DevOps

This article analyzes DataOps as a deep fusion of data analytics, lean thinking, agile practices, and DevOps culture, contrasting it with DevOps, detailing its four genetic components with case studies, explaining its emergence from technical, business, and organizational drivers, examining current hiring fragmentation and talent gaps, and predicting explosive job growth driven by policy, tooling maturity, and talent supply reforms.

AgileBig DataData Engineering
0 likes · 20 min read
Why DataOps Jobs Will Explode: The Chemistry of Analytics, Lean, Agile & DevOps