Tagged articles
Precomputation
11 articles · Page 1 of 1
This article presents Bilibili's practical implementation of Trino within a lakehouse architecture, focusing on the compute engine placement, stability enhancements, and containerized deployment, while detailing indexing strategies, pre‑computation techniques, Iceberg metadata optimizations, and performance gains for large‑scale analytical queries.
ContainerizationIndexingPrecomputation
0 likes · 14 min read


ITPUBJan 20, 2023 · Big Data
This article details Bilibili's practical deployment of an Iceberg lake‑warehouse architecture within its OLAP platform, covering the motivations for lake‑warehouse integration, core Iceberg optimizations such as data‑organization sorting, Z‑order and secondary indexes, the Magnus intelligent management platform, and future roadmap plans.
IndexingPrecomputationbigdata
0 likes · 16 min read

Apache Kylin leverages pre‑computed OLAP cubes on Hadoop/Spark/Flink to deliver sub‑second query responses for massive datasets, detailing its architecture, integration with BI platforms, user security, cube building, monitoring, and storage using HBase, illustrating how it overcomes big‑data analytical challenges.
Apache KylinHBaseOLAP
0 likes · 12 min read

This article explains the background, challenges, and architectural design of a big‑data OLAP platform that integrates Apache Kylin with a BI system, detailing pre‑computation strategies, cube construction, user authentication, storage engines, and query mechanisms to achieve sub‑second analytics on massive datasets.
Apache KylinHBaseOLAP
0 likes · 11 min read

The article examines the challenges big data brings to traditional technologies and surveys major OLAP solutions—MPP, batch processing, and pre‑computation—including Greenplum, Druid, Kylin, and Hadoop‑based engines, then outlines Youku’s specific use‑case selections for real‑time APIs, BI reporting, and ad‑hoc analysis.
MPPOLAPPrecomputation
0 likes · 13 min read

This article explores the challenges big data brings to traditional data technologies and reviews various OLAP solutions—including MPP, batch processing, pre‑computation, and Hadoop‑based engines—while detailing Youku’s specific business scenarios and how different OLAP engines are selected to meet performance, scalability, and real‑time analysis requirements.
AnalyticsMPPOLAP
0 likes · 14 min read

This article provides a comprehensive overview of Apache Kylin, covering its background, core OLAP concepts, technical architecture, installation steps, cube-building methods, real‑world enterprise deployments, and resources for further learning, illustrating how it enables sub‑second query performance on massive datasets.
Apache KylinCubeOLAP
0 likes · 20 min read

This article explains how Apache Kylin, an open‑source distributed analytics engine built on Hadoop/Spark, achieves sub‑second OLAP query performance through pre‑computed cubes, a layered cuboid generation algorithm, bitmap‑based distinct counting, dimension optimization techniques, and tight integration with HBase for storage and fast SQL querying.
Apache KylinCubeHBase
0 likes · 15 min read

To tackle Meituan‑Dianping’s massive POI and user data challenges, the team built a hybrid 3NF‑plus‑dimensional data warehouse with ODS, BAS, FACT, and optional TOPIC layers, added Kylin‑based pre‑computation cubes, a plug‑in middle‑platform service (metric dictionary, rule engine, compute engine), and interactive ECharts visualizations, delivering unified metrics, faster ad‑hoc queries, scalable analytics, and reduced development costs.
Precomputationservice architecturevisualization
0 likes · 17 min read

Meituan built a scalable scenario‑query platform that unifies traffic, activity and investment data by layering RPC services, a Storm‑driven pre‑computation tree stored in Redis/Tair, and a middle‑platform API with circuit‑breaker logic, cutting response times from seconds to under one second while dramatically reducing code coupling and simplifying future feature development.
Apache StormNoSQLPrecomputation
0 likes · 12 min read


ITPUBSep 22, 2017 · Big Data
This article presents a detailed case study of Baidu Waimai's traffic analysis platform, outlining the data challenges of high dimensionality and volume, the evaluation of OLAP engines, the adoption of Apache Kylin for pre‑computation, the end‑to‑end data modeling, cube construction, incremental builds, and integration with Saiku‑Mondrian reporting, while sharing practical lessons and performance gains.
Apache KylinData ModelingOLAP
0 likes · 29 min read
