Tagged articles
elastic scheduling
17 articles · Page 1 of 1
Apache Kyuubi, an enterprise‑grade multi‑tenant data gateway, replaces Livy and Flink SQL Gateway to support multiple engine versions, cross‑cluster elastic scheduling, high‑availability batch jobs, and traffic control, dramatically reducing deployment complexity, improving resource utilization, and accelerating release cycles for large‑scale Spark and Flink workloads.
Apache KyuubiData GatewayFlink
0 likes · 18 min read

ACK One Fleet, Alibaba Cloud's enterprise multi‑cluster solution, provides inventory‑aware elastic GPU scheduling, cross‑region resource sharing, multi‑cluster HPA and model distribution, allowing AI inference and training workloads to scale efficiently, reduce costs, and maximize GPU utilization.
AIGPU schedulingHPA
0 likes · 12 min read

This article explains how Baidu's vertical search platform tackled massive data growth and scaling challenges by redesigning its data management system, introducing elastic scheduling, decoupling ETCD access, implementing auto‑scaling, and advancing shard expansion to improve performance, stability, and cost efficiency.
Auto ScalingData ManagementSearch Architecture
0 likes · 18 min read

The article explains how the vivo Internet Big Data team containerized offline Spark jobs and deployed them with the Spark Operator on a mixed online‑offline Kubernetes cluster, using elastic scheduling and resource‑over‑subscription to boost CPU utilization by 30‑40% and handle over 100,000 daily tasks.
ContainerizationKubernetesSpark
0 likes · 36 min read

Baiguang Technology rebuilt its data platform on Alibaba Cloud EMR, leveraging OSS storage, open‑source ecosystems, and custom elastic scheduling to handle massive, complex data workloads, resulting in up to 70% faster cluster operations, 68% lower compute costs, and significant business performance gains.
Cost OptimizationEMRcloud computing
0 likes · 12 min read


AntTechOct 16, 2024 · Artificial Intelligence
The CNCC2024 forum held on October 24‑26 in Hangzhou showcases industry‑academia‑research integration through keynote speeches, speaker introductions, and detailed abstracts on topics such as AI, privacy computing, graph machine learning, and elastic cloud scheduling, while announcing the CCF‑Ant Research Fund and related initiatives.
AIelastic schedulinggraph-ml
0 likes · 10 min read

StarRocks 3.3.1 introduces a cloud‑native persistent index that moves index files to object storage, eliminates local‑disk constraints, and supports elastic scaling, delivering up to ten‑fold latency improvement over local‑disk indexes in elastic scheduling while matching performance in batch and real‑time imports.
StarRockscloud-nativedatabase
0 likes · 11 min read

This article explains how to use Alibaba Cloud Container Service (ACK) virtual nodes and Elastic Container Instances (ECI) to achieve second‑scale elasticity, covering installation, ResourcePolicy configuration, zone‑aware scheduling, high‑availability setups, and performance results with concrete YAML examples.
ECIKubernetesResourcePolicy
0 likes · 12 min read

This article shares Xiaomi's internal practices of Hadoop YARN, covering scheduling and resource optimization, elastic scheduling, node overcommit handling, federation architecture, metadata warehouse construction, and future plans to improve cluster utilization and cost efficiency.
HadoopYARNbig data
0 likes · 20 min read

Shilong Fei from Xiaomi Data Platform presents an in‑depth exploration of elastic scheduling for Hadoop YARN, covering background, design of resource pools, auto‑scaling architecture, challenges such as job stability and user transparency, achieved cost reductions, and future plans for further optimization.
Auto ScalingHadoopYARN
0 likes · 20 min read

This talk presents Xiaomi's design and deployment of an elastic scheduling system for Hadoop YARN, covering background analysis, resource‑pool strategy, auto‑scaling architecture, stability challenges, label‑based resource isolation, Spark shuffle handling, cost‑saving results and future plans.
HadoopYARNautoscaling
0 likes · 16 min read


AntTechJul 13, 2020 · Artificial Intelligence
ElasticDL is an open‑source distributed deep learning framework built on TensorFlow 2.x and Kubernetes that simplifies programming by letting users define models with the Keras API, while providing elastic scheduling, fault tolerance, and significant performance gains demonstrated through extensive benchmarks.
Distributed Deep LearningElasticDLKubernetes
0 likes · 19 min read


AntTechSep 11, 2019 · Artificial Intelligence
ElasticDL, the first industry‑level open‑source system for elastic deep learning on TensorFlow, leverages Kubernetes‑native scheduling, fault‑tolerance, and TensorFlow 2.0 Eager Execution to dramatically improve cluster utilization, simplify distributed training, and integrate seamlessly with tools like Kubeflow and SQLFlow.
Distributed Deep LearningElasticDLKubernetes
0 likes · 13 min read

This article details JD.com's database automation journey, covering their intelligent database management platform (DBS), automated deployment systems, intelligent analysis and diagnostics, and the evolution from traditional containerization to ContainerDB, a smart database service with elastic scheduling and resource optimization.
ContainerDBDatabase AutomationDatabase High Availability
0 likes · 22 min read

This article explains why Cainiao needed an elastic scheduling system, how its unique business and technical characteristics make it ideal for such a solution, and details the architecture, decision‑making layers, strategies, and real‑world results that together improve resource utilization, stability, and cost efficiency.
Auto ScalingCainiao ArkCloud Operations
0 likes · 27 min read

In this comprehensive talk, Alibaba’s database chief Zhang Rui shares the challenges of high‑availability, cost, and elasticity in massive transaction systems, outlines innovations like AliSQL X‑Cluster, Paxos‑based consistency, X‑KV, dual‑engine storage, and discusses the evolving role of DBAs toward automation and intelligent optimization.
AliSQLDBA automationDatabase Architecture
0 likes · 23 min read

This article details JD.com's journey from physical servers to a massive Docker‑based cloud‑native platform, covering challenges, architecture, elastic scheduling, monitoring, and resource‑driven operations that support tens of thousands of containers across multiple data centers.
Dockerelastic schedulingmonitoring
0 likes · 26 min read
