Big Data Technology Architecture
Jun 20, 2020 · Big Data
Apache Spark 3.0.0 Release: New Features, Improvements, and Timeline
Apache Spark 3.0.0, released after a 21‑month development cycle and several preview and release‑candidate votes, introduces major enhancements such as Dynamic Partition Pruning, Adaptive Query Execution, accelerator‑aware scheduling, DataSource V2, expanded pandas UDFs, new join hints, richer monitoring, SparkR vectorization, Kafka header support, and broader ecosystem integrations, while fixing over 3,400 issues.
Adaptive Query ExecutionApache SparkDataSource V2
0 likes · 17 min read