Tagged articles

Custom Scheduler

7 articles · Page 1 of 1

Jun 17, 2026 · Backend Development

Rebalance Optimization for Million‑QPS Kafka Clusters: From Default to Custom Assignors

At a 5,000‑instance, 20,000‑partition Kafka consumer cluster, the default eager Rebalance caused a 90‑second stop‑the‑world pause, illustrating how a single GC‑induced heartbeat miss can flood brokers with tens of millions of messages; the article dissects eager vs cooperative protocols, built‑in assignor limits, and four custom assignor patterns to scale Rebalance from 100 K to tens of millions of QPS.

AssignorCooperative ProtocolCustom Scheduler

0 likes · 28 min read

Rebalance Optimization for Million‑QPS Kafka Clusters: From Default to Custom Assignors

BanTech Think Tank

Feb 20, 2025 · Cloud Native

How to Efficiently Schedule Containers at Scale with Kubernetes

The article explains Kubernetes Scheduler’s three‑stage workflow—pre‑selection, scoring, and binding—examines fairness, availability, timeliness and flexibility concerns, details built‑in pre‑selection and scoring policies, explores affinity, taints/tolerations, custom scheduler extensions, and multi‑cluster scheduling via KubeFed, providing a comprehensive guide for large‑scale container orchestration.

AffinityContainer OrchestrationCustom Scheduler

0 likes · 11 min read

How to Efficiently Schedule Containers at Scale with Kubernetes

Rare Earth Juejin Tech Community

Nov 18, 2024 · Cloud Native

Developing a Custom Kubernetes Controller for Flink Task Scheduling

This article provides a step‑by‑step guide to building a custom Kubernetes controller in Go that uses Prometheus metrics to intelligently schedule Flink TaskManager Pods, covering the underlying scheduler concepts, code implementation, Docker image creation, RBAC setup, deployment, testing, and advanced considerations.

Custom SchedulerFlinkGo

0 likes · 38 min read

Developing a Custom Kubernetes Controller for Flink Task Scheduling

System Architect Go

Jun 15, 2024 · Cloud Native

Understanding kube-scheduler and How to Create a Custom Scheduler in Kubernetes

This article explains the role of kube-scheduler in Kubernetes, details its scheduling workflow and plugin framework, and demonstrates how to define a custom scheduler by configuring KubeSchedulerConfiguration, creating a ConfigMap, deploying it via a Deployment, and verifying its operation alongside the default scheduler.

Custom SchedulerK8scloud-native

0 likes · 9 min read

Understanding kube-scheduler and How to Create a Custom Scheduler in Kubernetes

Tencent Cloud Developer

Aug 10, 2022 · Cloud Native

Understanding the Kubernetes Scheduler: Queues, Filtering, Scoring, and Plugins

The Kubernetes scheduler continuously watches for unscheduled Pods, places them in a priority queue, filters feasible Nodes, scores and selects the best Node using built‑in and custom plugins—adjusting the node‑sampling rate for large clusters, and allowing extensibility through extenders, multiple schedulers, and the scheduler framework configuration.

Custom SchedulerExtenderKubernetes

0 likes · 11 min read

Understanding the Kubernetes Scheduler: Queues, Filtering, Scoring, and Plugins

58 Tech

Nov 10, 2020 · Cloud Native

Design and Implementation of 58 Cloud Search Platform Using Kubernetes and Containerization

The article describes how 58 Cloud Search (WCS) was built as a fully self‑service search platform on Kubernetes, detailing its background, architecture, high‑availability master design with HAProxy and Keepalived, multi‑cluster deployment, automated indexing, fault recovery, resource‑aware scheduling, and operational optimizations that now serve over 200 business search services with billions of daily queries.

Custom SchedulerSearch Platformcloud-native

0 likes · 12 min read

Design and Implementation of 58 Cloud Search Platform Using Kubernetes and Containerization

MaGe Linux Operations

Oct 19, 2020 · Cloud Native

Mastering Kubernetes Pod Scheduling: Affinity, Anti‑Affinity, and Custom Schedulers

This article explains how Kubernetes Scheduler assigns Pods to nodes, covering fairness, resource efficiency, performance, and flexibility, then details the predicate and priority phases, common algorithms, node and pod affinity rules, custom scheduler configuration, and practical YAML examples with command‑line demonstrations.

AffinityCustom SchedulerKubernetes

0 likes · 14 min read

Mastering Kubernetes Pod Scheduling: Affinity, Anti‑Affinity, and Custom Schedulers