Tagged articles

DistMapJoin

2 articles · Page 1 of 1

Apr 3, 2024 · Big Data

How Simple Parameter Tweaks Slash MaxCompute Job Costs by Half

This article walks through three real‑world MaxCompute optimization cases—tuning UNION handling, enabling JSON‑object batch extraction, and removing unnecessary GROUP BY—to dramatically reduce CPU, memory, and storage usage while improving job stability.

DistMapJoinJSONUDFMaxCompute

0 likes · 6 min read

How Simple Parameter Tweaks Slash MaxCompute Job Costs by Half

Alibaba Cloud Developer

Feb 22, 2024 · Big Data

Tackling Data Skew in Large-Scale SQL Joins with MapJoin, DistMapJoin & SkewJoin

This article explores practical techniques for mitigating data skew in massive SQL join operations, detailing MapJoin, handling special/empty values, hotspot dispersion, SkewJoin, and the novel DistMapJoin approach, complete with code snippets and performance results from Alibaba's payment data pipeline.

DistMapJoinMapJoinSQL

0 likes · 15 min read

Tackling Data Skew in Large-Scale SQL Joins with MapJoin, DistMapJoin & SkewJoin