Tagged articles
data lakehouse
26 articles · Page 1 of 1
The article details how Alibaba Cloud's EMR Serverless StarRocks (Stella kernel) and Paimon lake tables enable hybrid vector-scalar SQL queries over multimodal data stored in OSS, providing architecture layers, three SQL examples for autonomous driving scenarios, and a bad-case-to-retraining loop.
Alibaba CloudPaimonSQL analytics
0 likes · 24 min read

This article analyzes Apache Paimon 2.0's multimodal lakehouse capabilities, distinguishing Object Table from BLOB storage, clarifying that VECTOR type alone doesn't enable similarity search, detailing indexing visibility pitfalls, and comparing lakehouse retrieval with dedicated vector databases like Milvus.
AI data engineeringANN searchApache Paimon
0 likes · 14 min read

This article explores how lakehouse architecture must evolve to serve AI agents as first-class users, covering a four-layer reference architecture, Apache Fluss 1.0 capabilities for real-time and historical data access, secure query and write-back patterns, and practical troubleshooting for production deployments.
AI agentsAgentic LakehouseApache Fluss
0 likes · 39 min read

Ziroom migrated 4,400+ MySQL tables to a real-time lakehouse using Apache StreamPark and Paimon, replacing a complex Canal/Kafka/Flink/Airflow pipeline with standardized CDC ingestion, automated job deployment via StreamPark API, and Paimon's snapshot management to reduce source database load and operational overhead.
Apache FlinkApache PaimonApache StreamPark
0 likes · 35 min read

The article outlines a seven-step methodology for planning cement industrial data platforms, emphasizing business-driven scenarios, data inventory, unified object models, semantic definitions, logical data layering, storage selection, data quality operations, metric governance, and service delivery, with references to national standards and a practical case study on grinding power consumption comparison.
GB/T 36344ISA-95cement industry
0 likes · 27 min read

StarRocks introduces multimodal capabilities to handle structured, semi-structured, and unstructured data in a single SQL pipeline, combining object processing, full-text and vector search, and lakehouse integration with Paimon and Lance for unified retrieval and analysis.
AI analyticsHybrid RetrievalLance
0 likes · 24 min read

This article maps big data applications across ten industries — finance, retail, manufacturing, healthcare, government, transportation, new energy, AI, agriculture, and property — detailing use cases, technical architectures, and measurable value, concluding that AI and new energy form a mutually reinforcing data-driven loop.
MLOpsagricultureartificial intelligence
0 likes · 32 min read

Apache Iceberg v3 introduces deletion vectors, row‑level lineage, a native VARIANT type, default column values, and nanosecond timestamps, delivering up to ten‑fold faster updates, native CDC, seamless semi‑structured data handling, and industry‑wide adoption that effectively ends the format war between lake and warehouse solutions.
Apache IcebergDefault Column ValuesDeletion Vectors
0 likes · 14 min read

This article examines the evolution from separate stream and batch processing to unified stream-batch architecture, explaining the three key unifications (logic, storage, resources), debunking three common misconceptions, and arguing that stream-batch unification is essential for modern real-time decision-making and data-driven business growth.
Data EngineeringFlinkbatch processing
0 likes · 14 min read

This step‑by‑step tutorial shows how to deploy StarRocks and MinIO in a decoupled storage‑compute architecture using Docker Compose and Kubernetes, configure local caching, create storage volumes, load public datasets, and run SQL queries to explore the combined data.
Decoupled StorageDocker ComposeKubernetes
0 likes · 14 min read

The Flink Forward Asia 2025 conference in Singapore showcased Apache Flink's evolution with new AI‑driven projects such as Flink Agents, the integration of AI Functions in Flink 2.1, the disaggregated state management architecture of Flink 2.0, and complementary lakehouse technologies like Paimon and Fluss, underscoring the platform's role as the real‑time backbone for modern AI applications.
Apache FlinkDisaggregated State Managementdata lakehouse
0 likes · 9 min read

To empower enterprise AI in the LLM era, Baidu Cloud unveils a cloud‑native data platform featuring upgraded databases—PegaDB, GaiaDB 5.0, Vector DB 2.0, Palo 2.0—and integrated services like DBSC 2.0, EDAP 2.0, and DBStack, delivering high‑performance, cost‑effective handling of structured, unstructured, and vector data for fine‑tuning and Enterprise RAG.
Cloud-Native DatabaseDBStackEDAP
0 likes · 10 min read

This article summarizes Alibaba Cloud researcher Xu Sheng's presentation on the company's big data and AI product portfolio, covering current offerings, market trends, lakehouse evolution, open‑source contributions, serverless solutions, search capabilities, and the future roadmap for integrated big data‑AI services.
AIAlibaba Cloudbig data
0 likes · 22 min read

The article examines the rapid rise of lakehouse architecture, its market momentum, core components—including storage, metadata, table formats, and compute layers—compares Iceberg, Hudi, and Delta Lake, discusses the shift from HDFS to object storage, and outlines the strategic importance of lakehouses for AI-driven data management and future data infrastructure trends.
AIApache IcebergData Infrastructure
0 likes · 28 min read

StarRocks, an open‑source, high‑performance MPP analytical database under the Linux Foundation, offers vectorized engines, CBO optimizer, materialized views, and storage‑compute separation, integrates with BI tools and data lakes, and demonstrates superior query speed in benchmark tests against ClickHouse, Druid, and Trino.
MPPStarRocksanalytical database
0 likes · 10 min read

This article presents OPPO's smart data lakehouse solution, describing its massive EB‑scale architecture, the integration of batch and streaming engines, the Glacier service for table management, schema‑adaptive ingestion, performance optimizations, and future technical road‑maps for unified data processing.
FlinkOPPOSchema Evolution
0 likes · 15 min read

This article introduces Alluxio as an open‑source data orchestration layer, explains its architecture and core features such as unified namespace, caching strategies, and cloud‑native deployment, and shares practical experiences on using Alluxio to simplify data lakehouse construction, migration, and hot‑cold data separation in complex big‑data environments.
AlluxioCachingbig data
0 likes · 13 min read

Vivo’s big‑data team deployed Apache Hudi to create a lakehouse that unifies streaming and batch workloads, leverages COW and MOR storage modes, automates small‑file clustering and compaction, and applies extensive version, streaming, batch, and lifecycle optimizations, delivering minute‑level latency, hundred‑million‑records‑per‑minute ingestion, and query speeds up to 20 % faster than Hive.
Apache HudiStreaming Processingbatch processing
0 likes · 11 min read

This article provides a comprehensive technical overview of LakeSoul, an open‑source, cloud‑native lakehouse framework, covering its design philosophy, core features, architecture, performance benchmarks, real‑time ingestion, incremental computation, multi‑stream joining, security, community progress, and future roadmap.
FlinkLakeSoulSpark
0 likes · 16 min read

This article details Taikang Life Insurance's end‑to‑end technical selection, architecture design, implementation, and custom enhancements of an Apache Hudi‑driven lakehouse platform for large‑scale health‑insurance data, covering background, component evaluation, performance benchmarking, multi‑layer architecture, and real‑world results.
Apache HudiFlinkbig data
0 likes · 44 min read

This article introduces LakeSoul, an open‑source end‑to‑end real‑time lakehouse framework, detailing its design philosophy, key technologies such as ELT, metadata management, upsert and merge‑on‑read capabilities, performance benchmarks, real‑world use cases, and the roadmap for future enhancements.
ELTFlink CDCLakeSoul
0 likes · 18 min read

This interview with NetEase data‑lake technology manager Ma Jin explains the distinction between data lakes and lakehouses, reviews the evolution of table‑format technologies such as Iceberg, Hudi and Delta Lake, evaluates feature maturity and performance trade‑offs, and discusses systematic versus non‑systematic adoption in enterprises.
Delta LakeHudiStreaming‑Batch Integration
0 likes · 13 min read

This article explores the open‑source lakehouse trend, outlines the architectural features of Volcano Engine EMR, examines key challenges of building enterprise‑grade data lakehouses, and presents best‑practice case studies demonstrating how EMR enables scalable, real‑time analytics, storage‑compute separation, and seamless integration with modern big‑data engines.
EMRStorage-Compute Separationdata lakehouse
0 likes · 22 min read

Delta Lake, an open‑source storage layer from Databricks, provides ACID transactions, data versioning, schema evolution, and unified batch‑stream processing, with a detailed file structure and metadata mechanism, while Alibaba Cloud EMR enhances it with advanced DML, performance optimizations, deep DLF integration, and solutions for G‑SCD and CDC.
CDCDLFDelta Lake
0 likes · 11 min read

Shopee replaced its hourly Hive pipeline with a hybrid Flink‑Hudi real‑time data warehouse that groups Kafka topics, applies lightweight stream ETL, uses partial‑update MOR tables for multi‑stream joins and COW tables for versioned batches, cutting latency from about 90 minutes to 2–30 minutes and halving resource usage.
Apache FlinkApache Hudibatch processing
0 likes · 20 min read


政采云技术Feb 8, 2022 · Industry Insights
This article traces the evolution from traditional data warehouses to modern data lakes and data middle platforms, explains why siloed data development hampers efficiency, and details the architecture and indicator‑library design used by Zhengcaiyun to achieve unified, reusable data services.
big datadata governancedata lakehouse
0 likes · 14 min read
