Tagged articles

History Server

2 articles · Page 1 of 1

Apr 11, 2022 · Big Data

How ByteDance Cut Spark History Storage by 90% with a Cloud‑Native UIService

ByteDance rebuilt Spark's History Server into a cloud‑native UIService that stores only essential UI metadata, reducing storage usage by over 90%, cutting UI latency by up to 94%, and enabling seamless horizontal scaling for large‑scale analytics workloads.

History ServerPerformance OptimizationSpark

0 likes · 12 min read

How ByteDance Cut Spark History Storage by 90% with a Cloud‑Native UIService

ByteDance Data Platform

Mar 14, 2022 · Big Data

How ByteDance Cut Spark History Server Storage by 90% and Boost UI Speed

ByteDance’s Spark History Server was re‑engineered into a cloud‑native UIService that reduces storage usage by over 90%, cuts UI latency by up to 94%, and enables horizontal scaling, dramatically improving the user experience for large‑scale Spark jobs.

Cloud NativeHistory ServerPerformance Optimization

0 likes · 12 min read

How ByteDance Cut Spark History Server Storage by 90% and Boost UI Speed