Spark on K8S | BestHub

vivo Internet Technology

Feb 28, 2024 · Cloud Native

vivo's Online-Offline Co-location Technology Practice: Data Center Resource Optimization

Vivo’s online‑offline co‑location platform consolidates latency‑sensitive online services and batch offline workloads on shared Kubernetes nodes, using differentiated resource views, priority‑based QoS, and safety watermarks to boost CPU utilization from 13 % to 25 %, adding 20 000 cores and 50 TB memory for peak‑hour offline tasks.

Container OrchestrationDevOpsKubernetes

0 likes · 17 min read

vivo's Online-Offline Co-location Technology Practice: Data Center Resource Optimization

NetEase Media Technology Team

Sep 15, 2022 · Big Data

SparkSQL on Kubernetes: NetEase Media's Cloud-Native Big Data Infrastructure Practice

NetEase Media migrated SparkSQL to Kubernetes in 2021, using storage‑compute decoupling, hybrid deployment, custom scripts, Kyuubi failover, and extensive monitoring and resource governance, which cut cluster size by over 30% while keeping CPU utilization above 80% and GC throughput above 95%.

Big DataK8S MigrationKubernetes

0 likes · 13 min read

SparkSQL on Kubernetes: NetEase Media's Cloud-Native Big Data Infrastructure Practice