360 Smart Cloud
Jul 9, 2024 · Big Data
Understanding Shuffle in Spark: From Native Shuffle to External and Remote Shuffle Services (Uniffle)
This article examines the critical role of shuffle in big‑data processing, compares Spark's native shuffle with the External Shuffle Service (ESS) and Remote Shuffle Service (RSS) solutions, introduces Uniffle's architecture and configuration, and shares practical deployment experiences and performance results within a 360 internal environment.
External Shuffle ServiceRemote Shuffle ServiceShuffle
0 likes · 15 min read