Tagged articles
Materialized View
57 articles · Page 1 of 1
This article details production practices for accelerating StarRocks queries on Paimon external tables, covering architecture, table design (partitioning, bucketing, compaction), dirty data handling, catalog configuration, predicate pushdown verification, SQL optimization with partition/bucket pruning, query method selection (direct, async materialized views, hot/cold tiering), and BE-level tuning.
Bucket PruningMaterialized ViewPaimon
0 likes · 22 min read

The article shows that asking team members to scroll through long chat histories (“go check the floor”) forces them to replay log‑style data, which is costly and error‑prone, and argues that using state‑oriented tools such as task boards and documentation—akin to materialized views—eliminates this inefficiency.
CollaborationMaterialized Viewcognitive load
0 likes · 13 min read

The article explains how Hologres Dynamic Table, a cloud‑native materialized‑view‑like feature, supports full and incremental refresh modes, enables minute‑level data freshness for billion‑row price tables, and provides join, aggregation, and partition capabilities while outlining its architecture, limitations, and real‑world performance gains.
Dynamic TableHologresIncremental Refresh
0 likes · 8 min read

Facing painfully slow log queries under high concurrency, the team enabled SLS materialized views and, through three real‑world cases, reduced query latency from thousands of milliseconds to sub‑second levels, achieving up to 89‑fold performance gains while keeping storage costs negligible.
Materialized ViewPerformance TuningSLS
0 likes · 7 min read

Backend developers often struggle with log queries that become unbearably slow at scale, causing timeouts and alerts; this article details how applying Alibaba Cloud Log Service materialized views transformed several real‑world cases—from high‑concurrency SDK calls to complex de‑duplication and latency‑comparison queries—cutting response times from seconds to milliseconds and delivering stable performance.
Materialized ViewSQLcloud-native
0 likes · 7 min read

When log volumes explode from gigabytes to petabytes, Alibaba Cloud Log Service’s traditional on‑the‑fly querying becomes slow, resource‑hungry, and inaccurate, but materialized views pre‑compute and store results, delivering seconds‑level responses with far lower resource consumption.
Log AnalyticsMaterialized Viewcloud-native
0 likes · 11 min read

After disabling Redis in production and carefully testing on PostgreSQL 18, the author reduced p95 latency, simplified the system, and lowered operational overhead by replacing the cache with a covering index, a generated column, and a materialized view, while providing detailed query examples, configuration tweaks, and performance measurements.
IndexingMaterialized ViewPostgreSQL
0 likes · 10 min read


ITPUBOct 11, 2025 · Databases
This article details OceanBase's evolution from a distributed OLTP system to a unified HTAP database, covering its cost‑based optimizer, vectorized execution, integrated row‑column storage, bypass import, materialized views, external tables, full‑text search, and real‑world use cases for real‑time analytics.
HTAPMaterialized ViewOceanBase
0 likes · 12 min read

This article explains the materialized view pattern, describing why pre‑populated views are created when source data formats hinder efficient queries, how they improve performance as disposable caches, and the key considerations, trade‑offs, and scenarios for adopting this approach.
CachingData ConsistencyDatabase Design
0 likes · 11 min read

This article details how MaxCompute leverages fuzzy materialized views, DAG scheduling adjustments, public layer mining, and FBI acceleration techniques to reduce compute resource consumption by up to 10%, improve task visibility, and achieve significant daily savings in large‑scale data warehouse environments.
Materialized ViewMaxComputecompute cost
0 likes · 12 min read

Xiaohongshu tackled low reuse of APP tables, limited scalability of single-table BI datasets, and poor dashboard query performance by introducing logical datasets and materialized views, which enable query pruning, reduce data redundancy, and accelerate BI queries, achieving up to 80% latency reduction and higher hit rates.
BIMaterialized ViewStarRocks
0 likes · 25 min read

This tutorial walks you through using Alibaba Cloud EMR Serverless StarRocks and Apache Paimon to create a cost‑effective, high‑performance game player profiling and behavior analysis platform, covering data import, materialized view creation, DWD/ADS layer construction, and lakehouse integration.
Alibaba CloudGame AnalyticsMaterialized View
0 likes · 12 min read

This article walks through StarRocks' materialized view refresh mechanisms, explains the various refresh triggers, details the refresh workflow, and introduces new parameters that allow selective refreshing of only changed data to avoid costly full‑partition refreshes.
Materialized ViewSQLStarRocks
0 likes · 8 min read

This article details the performance challenges of Ctrip's Nova data reporting platform and describes a series of governance measures—including multi‑dimensional data caching, materialized view acceleration, query strategy optimization, and SQL quality improvements—that collectively reduced average query latency by over 50% and stabilized the system.
CachingMaterialized ViewSQL Performance
0 likes · 26 min read

Shopee’s deployment of StarRocks across DataService, DataGo, and DataStudio demonstrates that its vectorized engine, cost‑based optimizer, and materialized‑view caching can query Hive, Iceberg, Delta Lake and Hudi up to 20,000× faster than Presto, cutting CPU usage and delivering consistently lower latency for complex analytics.
HiveMPPMaterialized View
0 likes · 11 min read

This guide walks through the core concepts of Apache Hive, its architecture and key features, then shows how to integrate Hive with StarRocks via the Hive Catalog, construct ODS/DWD/DWS/ADS tables, enable DataCache, use materialized views, and handle automatic partition detection for fast lakehouse analytics.
Apache HiveDataCacheMaterialized View
0 likes · 17 min read

The article describes how Kuaishou transformed its high‑traffic OLAP system from a separated lake‑and‑warehouse architecture using Hive/Hudi and ClickHouse into a unified lakehouse solution powered by Apache Doris, detailing the challenges, design choices, caching and automatic materialization mechanisms, and the resulting performance and governance improvements.
Apache DorisData CachingMaterialized View
0 likes · 18 min read

This article explains the concept, advantages, and drawbacks of materialized views, describes how MaxCompute implements them—including creation syntax, maintenance properties, automatic query rewrite, smart recommendation, and auto‑materialization—and shares performance results and future improvement plans.
Automatic RefreshMaterialized ViewMaxCompute
0 likes · 13 min read

StarRocks 3.3 introduces a comprehensive set of enhancements—including maturity levels, ARM‑optimized performance, advanced caching, materialized‑view rewrites, storage optimizations, and expanded lakehouse ecosystem support—that together boost stability, query speed, and usability for large‑scale analytics workloads.
Materialized ViewQuery PerformanceStarRocks
0 likes · 15 min read

This article explains how to build a high‑performance data‑lake analytics stack by combining StarRocks with Apache Paimon, covering direct queries, Data Cache acceleration, and asynchronous materialized views, and presents benchmark results that show StarRocks achieving up to 4.3× faster query speeds than Trino and significant latency reductions with caching and materialized views.
Apache PaimonData CacheMaterialized View
0 likes · 12 min read


StarRocksApr 25, 2024 · Artificial Intelligence
The April 16 online meetup by Tencent Game Data and StarRocks explored AI‑generated SQL, tackled NL2SQL challenges, showcased a demo that lifted one‑shot accuracy to 89%, and introduced StarRocks AutoMV technology that automates materialized‑view recommendation and merging to accelerate data‑warehouse queries.
AIAutoMVMaterialized View
0 likes · 9 min read

This article explains how MaxCompute leverages materialized views as a query accelerator, covering their history, advantages and drawbacks, creation and maintenance details, automatic query rewriting, intelligent recommendation, auto‑materialization, and future enhancements for large‑scale data warehousing.
Automatic RefreshIntelligent RecommendationMaterialized View
0 likes · 13 min read

This article shares Kangaroo Cloud's exploration and practice of a real-time data lake, covering background, data lake concepts, challenges, solution architecture using the Shuzhan platform with Iceberg/Hudi, CDC ingestion, small file handling, cross-cluster ingestion, materialized view acceleration, and future development plans.
CDCCross-Cluster IngestionHudi
0 likes · 12 min read

The Apache Doris 2.1.0 release introduces over 100% query performance improvements on TPC‑DS, up to 230% gains on ARM platforms, new Variant and IP data types, async materialized views, auto‑increment columns, auto‑partitioning, group commit, hardened workload groups, TopSQL monitoring, a built‑in job scheduler, and several behavior changes, all aimed at delivering faster, more flexible and more reliable OLAP processing.
ARM OptimizationApache DorisMaterialized View
0 likes · 42 min read

This article details Didi's evolution of OLAP systems, the adoption of StarRocks for high‑performance MPP analytics, and how materialized views, global dictionary mapping, and transparent acceleration were engineered to boost real‑time dashboard queries while outlining performance gains, challenges, and future optimization plans.
DidiMaterialized ViewOLAP
0 likes · 16 min read

This article presents Didi's practical experience with StarRocks materialized views, covering the evolution of its OLAP architecture, the challenges of previous engines, the adoption of StarRocks, the design of materialized view acceleration for real‑time dashboards, and future optimization directions.
Materialized ViewOLAPStarRocks
0 likes · 17 min read

WeChat transformed its data platform from Hadoop and ClickHouse to a StarRocks‑based lakehouse, tackling massive data volume, ultra‑low latency, and storage fragmentation by deploying lake‑on‑warehouse and warehouse‑lake fusion architectures, real‑time incremental materialized views, and unified SQL access, resulting in dramatic cost cuts and performance gains.
Materialized ViewStarRocksWeChat
0 likes · 15 min read

This article presents a comprehensive overview of MaxCompute's near‑real‑time incremental update and processing architecture, the design of Transactional Table 2.0, intelligent materialized view evolution and recommendation, as well as multi‑level adaptive execution optimizations for the SQL engine, illustrating how these innovations improve efficiency, cost, and scalability for large‑scale data workloads.
Materialized ViewMaxComputeSQL Engine
0 likes · 20 min read

Ctrip migrated its Artnova reporting platform from Hive‑based queries to StarRocks, first loading data into OLAP tables and then using StarRocks as a lakehouse with Hive catalog, Data Cache and materialized views, achieving average query latency reductions from 20 seconds to 1.5 seconds, over 7× speed‑up versus Trino and up to 40× acceleration for complex workloads.
Data CacheMaterialized ViewOLAP
0 likes · 15 min read

This article investigates why Oracle and OceanBase return different results when querying the USER_TAB_COLUMNS view in stored procedures, demonstrates reproducible tests, analyzes system view behavior, and proposes workarounds such as using ALL_TAB_COLUMNS, creating synonyms, intermediate tables, or materialized views to ensure consistent table name retrieval.
Database ViewsMaterialized ViewOceanBase
0 likes · 19 min read

The article provides a deep technical overview of StarRocks 3.0’s data‑lake analysis capabilities, its unified Lakehouse architecture, Catalog integration, Trino compatibility, extensive I/O optimizations, materialized view features, resource isolation techniques, real‑world use cases, and future development directions.
AnalyticsMaterialized ViewStarRocks
0 likes · 22 min read

This article reviews traditional Lambda and Kappa data‑warehouse architectures, then details four Paimon‑StarRocks lakehouse solutions—including a data‑lake center, accelerated query with materialized views, hot‑cold data separation, and the JNI connector—while also outlining StarRocks’ future roadmap for lakehouse analytics.
Materialized ViewPaimonStarRocks
0 likes · 11 min read

RisingWave is an open‑source distributed streaming SQL database that uses SQL to define tables and materialized views, offering low‑latency incremental query processing, a scalable architecture with separate compute and storage, robust consistency guarantees, and real‑time analytics demonstrated through several practical use cases.
Materialized ViewSQLStreaming Database
0 likes · 24 min read

StarRocks 3.0 introduces a lake‑warehouse unified architecture where materialized views reduce data processing complexity, boost query performance, and improve timeliness, offering declarative modeling, transparent acceleration, and incremental computation for enterprise‑scale analytics.
Data ModelingIncremental RefreshLake Warehouse
0 likes · 19 min read

This article explains how to implement real‑time materialized views to accelerate large‑scale time‑series data queries, covering the need for materialized views, their definition, storage, incremental updates, pre‑computation, query partitioning, performance testing, and future directions.
Data PartitioningMaterialized ViewQuery Acceleration
0 likes · 16 min read

The article presents a comprehensive big‑data solution that combines Flink and Apache Hudi to build a real‑time data lake, solving latency, observability, resource duplication, and data‑isolation challenges across DB ingestion, event tracking, BI reporting, and infrastructure optimization.
Materialized View
0 likes · 20 min read

This article presents a comprehensive overview of YouShu BI's materialized view product, detailing performance pain points of traditional BI, the fundamentals and architecture of database materialized views, the product's design, ETL generation, query rewriting, scheduling, intelligent recommendation, and future development directions.
BIClickHouseETL
0 likes · 15 min read

StarRocks 3.0 introduces a storage‑compute separation architecture, a full‑featured RBAC permission framework, enhanced materialized views, Trino‑compatible query dialect, richer Primary‑Key update/delete syntax, automatic partition creation, and numerous performance optimizations, marking a major step from OLAP to lakehouse analytics.
Materialized ViewRBACStarRocks
0 likes · 10 min read

This article analyzes the performance bottlenecks of A/B experiment report queries on Apache Doris at Xiaomi, presents data-driven insights on query latency, field usage, and experiment ID matching, and details a series of optimizations—including pre‑aggregation, materialized views, bitmap deduplication, and schema redesign—that reduced query times by up to 60× and lowered cluster load.
A/B testingApache DorisBitmap
0 likes · 17 min read

This article analyzes the requirements, design choices, and implementation details of materialized views in StarRocks, covering demand analysis, synchronous and asynchronous refresh solutions, partition binding, task scheduling, partition‑refresh maintenance, Insert‑Overwrite mechanics, view invalidation handling, and the upcoming features planned for version 2.5.
Async RefreshInsert OverwriteMaterialized View
0 likes · 14 min read

This article explains how to create a ClickHouse materialized view that aggregates per‑minute data from a per‑second table, demonstrates insertion and query tests, investigates an unexpected 1970‑01‑01 timestamp caused by time‑zone handling, and provides the corrected view definition aligning field names.
ClickHouseMaterialized Viewdatabase
0 likes · 8 min read

This article presents Huya's big data platform evolution, detailing cost‑saving measures, SLA practices, multi‑datacenter architecture, containerized resources, metadata‑driven intelligence, and future directions such as hybrid‑engine materialized views to improve efficiency and service reliability.
Cost OptimizationMaterialized ViewSLA
0 likes · 15 min read

This article provides an overview of real-time and offline integrated data warehousing, tracing its evolution from early offline warehouses to modern cloud-native solutions, and details the latest capabilities—including multi-engine computation, data sharing between MaxCompute and Hologres, progressive computing, materialized views, and practical use cases such as telecom analytics and connected‑car scenarios.
HologresMaterialized ViewMaxCompute
0 likes · 16 min read

This article presents Car Home's experience building a real‑time materialized view system on Apache Flink, detailing system analysis, problem decomposition, a global‑version‑based CDC algorithm, its implementation as a Flink connector, practical deployment results, and remaining challenges such as clock dependency and state size.
AlgorithmCDCFlink
0 likes · 17 min read

This article shares practical experiences with Doris, covering materialized view concepts, typical use cases, index principles, performance optimizations, and real‑world scenarios such as order analysis, PV/UV aggregation, and detailed queries, while also providing operational tips and Q&A insights.
DorisIndexMaterialized View
0 likes · 16 min read

The article explains how JD’s Activity Cockpit tackles mega‑sale challenges by monitoring the consumer golden‑link, applying Optimize Table, BitMap, and materialized view techniques to reduce data volume, accelerate queries, and enable precise real‑time marketing for brands.
E-commerce AnalyticsMaterialized Viewbig data
0 likes · 6 min read

Didi's data architecture team migrated high‑volume, real‑time funnel analysis from ClickHouse to StarRocks, built a multi‑layer pipeline with Kafka, Flink/Spark, Hive, and materialized views, and achieved sub‑3‑second query times on billions of rows, while outlining future enhancements.
Funnel AnalysisHiveMaterialized View
0 likes · 14 min read

This article explains how PostgreSQL's Foreign Data Wrapper (FDW) and Materialized Views (MV) can be combined to synchronize large‑scale data across databases or clusters, offering alternatives to pg_dump, reducing load, and improving performance for both real‑time and batch scenarios.
FDWMaterialized ViewSQL/MED
0 likes · 14 min read

This article shares practical experiences with Doris, covering materialized view concepts, typical use cases, advantages, creation syntax, prefix index principles, performance‑boosting scenarios such as order analysis, PV/UV counting, detail queries, and operational tips for high‑throughput and low‑latency workloads.
DorisIndexMaterialized View
0 likes · 18 min read

The article explains ClickHouse's new Projection feature, how it overcomes MergeTree's single‑sort limitation and materialized view drawbacks, provides step‑by‑step commands to create, materialize, and query projections, demonstrates massive performance gains, and outlines the rules for automatic projection selection.
ClickHouseMaterialized ViewProjection
0 likes · 12 min read

JD’s Algorithmic Intelligence team built a ClickHouse‑based real‑time analytics engine that ingests Kafka and offline data, uses MergeTree tables with strategic partitioning and sorting, and employs batch writes, materialized views, and monitoring to achieve second‑level queries over billions of rows.
ClickHouseMaterialized ViewMergeTree
0 likes · 17 min read

QQ Music replaced its slow Hive warehouse with a massive ClickHouse cluster, achieving sub‑second to ten‑second query latency on petabyte‑scale data, enabling real‑time analytics for non‑technical users, and following five operational best practices—ZooKeeper planning, idempotent writes, sensible partitions, read‑write separation, and localized joins—while leveraging Tencent Cloud’s managed ClickHouse service.
ClickHouseMaterialized ViewOLAP
0 likes · 24 min read

The article explains PostgreSQL materialized views, their evolution, how they differ from regular views, demonstrates creating and refreshing them, and compares them with incremental rollup tables using upsert to help decide which method best fits performance and scalability needs.
Materialized ViewPostgreSQLSQL
0 likes · 6 min read

This article provides an in‑depth analysis of Stream SQL theory, incremental query algorithms, materialized view maintenance, optimizer cost models, time handling, windowing, and the practical capabilities and limitations of Apache Flink’s streaming SQL engine.
Apache FlinkIncremental QueryMaterialized View
0 likes · 30 min read

This article explains how to handle high‑volume advertising monitoring by storing raw request logs in ClickHouse, enabling sampling and materialized views, and using TP999 metrics, aggregating tables, and Grafana queries to achieve fast, flexible, and low‑impact real‑time analytics on billions of events.
ClickHouseMaterialized Viewbig-data
0 likes · 10 min read

The article explains the Materialized View Based Optimizer (MBO) in Inceptor, detailing its purpose, configuration parameters, supported aggregation, filter, and join scenarios, and shows how combining MBO with Transwarp Rubik cubes can dramatically accelerate OLAP query performance.
InceptorMaterialized ViewOLAP
0 likes · 12 min read

Discover six powerful techniques—including B‑tree and bitmap indexes, materialized views, result‑set caching, and clever query rewrites—to dramatically reduce logical reads and accelerate Oracle's SELECT COUNT(*) performance, with step‑by‑step examples and measurable improvements.
Materialized ViewOraclePerformance Tuning
0 likes · 6 min read
