Big Data Technology & Architecture

Aug 25, 2020 · Big Data

Understanding Spark SQL Query Execution: From Parsing to Physical Plan

This article explains how Spark SQL processes a SELECT query—detailing parsing, binding, optimization, planning, and execution steps—including the roles of SQLContext, HiveContext, Catalyst optimizer, logical and physical plans, and provides code excerpts from the Spark source.