Tagged articles
ODPS
18 articles · Page 1 of 1
Alibaba Cloud unveiled a strategic upgrade to its ODPS big data platform at the 2026 Yunqi Conference, introducing AI-native, multimodal capabilities across MaxCompute, Hologres, and DataWorks to support Agentic AI workloads with vector search, heterogeneous compute, data sandboxes, and semantic knowledge graphs.
AI NativeAgentic AIDataWorks
0 likes · 19 min read

At Yunqi 2026, Alibaba Cloud unveiled a strategic upgrade to its ODPS big data platform, introducing agent-native architecture and multimodal computing across MaxCompute, Hologres, and DataWorks to support large model data refinement, embodied intelligence, and autonomous data operations with SQL AI, vector search, data sandboxes, and semantic knowledge graphs.
Agentic AIData SandboxDataWorks
0 likes · 21 min read

This article chronicles ODPS's 15‑year journey from its exploratory beginnings to a modern, AI‑enabled big data platform, detailing its four development phases, architectural layers, SQL engine upgrades, real‑time processing, lakehouse integration, and the new Data+AI capabilities offered by MaxCompute and DataWorks.
AI integrationDataWorksMaxCompute
0 likes · 12 min read

Over ten years, Alibaba’s data engineers transformed a modest Hadoop‑based system into a globally‑scalable, high‑performance big data platform—ODPS/MaxCompute—supporting massive offline and real‑time workloads, pioneering innovations like the 5K cluster expansion, Blink streaming, and the unified ‘Moon’ migration.
AlibabaMaxComputeODPS
0 likes · 25 min read

This guide walks through the end‑to‑end flow of SQL execution on Alibaba MaxCompute (ODPS), explains how to use Logview to pinpoint performance bottlenecks, enumerates common causes of slow queries, and presents concrete optimization techniques such as MapJoin hints, double‑group‑by rewrites, TRANS_COLS, bucket partitioning and UDF tuning, all illustrated with step‑by‑step examples and visual diagrams.
LogviewMaxComputeODPS
0 likes · 16 min read

This comprehensive ODPS (MaxCompute) development guide serves as a mini‑encyclopedia, detailing common parameter tuning, built‑in SQL functions, step‑by‑step Java UDF creation, job lifecycle insights, and practical performance‑optimization techniques such as parallelism adjustment, map‑join hints, and small‑file mitigation.
MaxComputeODPSSQL
0 likes · 26 min read

This guide provides a comprehensive, beginner‑to‑advanced reference for ODPS (MaxCompute) SQL, covering table creation, DDL/DML commands, query syntax, join hints, MySQL‑to‑ODPS synchronization, one‑click and custom imports into Hologres, and scheduling variables for automated data pipelines.
ETLHologresODPS
0 likes · 37 min read

This article explores practical SQL optimization techniques for Alibaba's ODPS platform, covering fundamentals, common pitfalls like null handling and select *, advanced strategies such as multi‑insert, partition limiting, UDF placement, data‑skew mitigation, parameter tuning, and real‑world case studies that dramatically reduce query runtimes.
Data SkewHiveMaxCompute
0 likes · 23 min read

This article walks through the end‑to‑end lifecycle of a SQL task in a big‑data environment, covering creation, scheduling metadata, instance generation, resource allocation, ODPS execution, and final processing on the Fuxi distributed engine.
FuxiODPSSQL
0 likes · 11 min read

This article walks through three real‑world MaxCompute optimization cases—tuning UNION handling, enabling JSON‑object batch extraction, and removing unnecessary GROUP BY—to dramatically reduce CPU, memory, and storage usage while improving job stability.
DistMapJoinJSONUDFMaxCompute
0 likes · 6 min read

This article examines ODPS SQL performance by dissecting logical execution plans and Logview visualizations, explaining the underlying principles of various optimization techniques such as multi‑distinct handling, shuffle reduction, system parameters, and different join strategies, and demonstrates how to apply these methods to improve query efficiency in real‑world data engineering tasks.
ODPSShuffleexecution plan
0 likes · 17 min read

This article shares practical methods, based on real‑world team experience, to identify and resolve data skew and data expansion issues in big data SQL queries, offering systematic investigation steps and optimization techniques for Map, Reduce, and Join stages.
Data SkewHiveODPS
0 likes · 9 min read

This article walks through common ODPS SQL scenarios—union, count distinct, large‑table joins, mapjoin, and predicate placement—explains why naïve implementations can be inefficient, shows how to read and interpret execution plans, and provides concrete rewritten queries that dramatically improve performance and resource usage.
COUNT DISTINCTMapJoinODPS
0 likes · 17 min read


ITPUBMar 25, 2023 · Big Data
This article walks through common SQL development scenarios on ODPS, examining why naïve UNION and COUNT DISTINCT can be slow, how to rewrite queries with GROUP BY, UNION ALL, JSON aggregation, and map‑join techniques, and shows the resulting execution‑plan improvements with concrete code and performance numbers.
CountDistinctMapJoinODPS
0 likes · 17 min read

This article shares engineering practices for constructing a tag‑profile system, covering core concepts, minimal architecture, technology selection, key modules such as estimation, selection, deployment, and validation, and offers design details and implementation tips for large‑scale marketing scenarios.
Alibaba CloudData EngineeringMaxCompute
0 likes · 11 min read

This article outlines Alibaba Cloud’s ODPS evolution, its multi‑engine architecture, recent MaxCompute and Hologres enhancements, and how these innovations deliver scalable, fast, and simple big‑data solutions for diverse cloud‑native scenarios.
HologresMaxComputeODPS
0 likes · 10 min read

The article presents practical ODPS SQL optimization strategies—including explicit column selection, partition limiting, multi‑insert, proper handling of nulls, join‑type choices, map‑join and skew hints, bucketed tables, and tuned task parameters—illustrated with three real‑world cases that dramatically cut execution time and resource usage.
Data SkewHiveODPS
0 likes · 23 min read

The Alibaba iDST team clinched first place in the ACM MM2017 LSVC competition by leveraging Alibaba Cloud’s ODPS to extract eight multimodal features, achieving a 0.8485 mAP on the validation set, and demonstrating the critical role of rich modality fusion in large‑scale video classification.
AlibabaODPSlarge-scale AI
0 likes · 5 min read
