Databases 17 min read

How MaxCompute’s Intelligent Data Warehouse Optimizes Queries with AutoMV

This article explains MaxCompute’s intelligent data warehouse architecture, its self‑learning optimization pipeline, the role of intelligent materialized views, the automated recommendation system for materialized views, and the AutoMV feature that automatically creates, updates, and cleans up materialized views to reduce compute costs and improve query performance.

Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
How MaxCompute’s Intelligent Data Warehouse Optimizes Queries with AutoMV

04 AutoMV

AutoMV automates the selection, creation, updating, and cleanup of the most beneficial materialized views, minimizing manual effort and storage waste.

When a query first hits an AutoMV, the view is initially empty; data is written to the view only upon first use, avoiding unnecessary resource consumption.

AutoMV performs precise rewrites only, preventing performance regressions caused by imprecise rewrites.

Cost impact is minimal: storage overhead is negligible compared to the compute savings, with typical projects seeing 16.8% reduction in compute resources and significant CU savings.

Future plans include cross‑project support, fuzzy rewrite capabilities, workflow orchestration improvements, dynamic updates, and enhanced visual interfaces.

AutoMV Architecture
AutoMV Architecture
Original Source

Signed-in readers can open the original source through BestHub's protected redirect.

Sign in to view source
Republication Notice

This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactadmin@besthub.devand we will review it promptly.

Big DataQuery OptimizationData WarehouseMaxComputeAutoMV
Alibaba Cloud Big Data AI Platform
Written by

Alibaba Cloud Big Data AI Platform

The Alibaba Cloud Big Data AI Platform builds on Alibaba’s leading cloud infrastructure, big‑data and AI engineering capabilities, scenario algorithms, and extensive industry experience to offer enterprises and developers a one‑stop, cloud‑native big‑data and AI capability suite. It boosts AI development efficiency, enables large‑scale AI deployment across industries, and drives business value.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.