This article explains the internal architecture of Spark Operator, covering Kubernetes operator fundamentals, CRD definitions, code layout, job submission flow, state machine handling, monitoring integration, and troubleshooting techniques for reliable Spark workloads on Kubernetes.
This article explains why Kubernetes should be seen as a next‑generation operating system, walks through a simple nginx deployment using declarative YAML, introduces the concepts of CRDs, custom controllers and Operators, and shows how to create and manage resources such as etcd clusters and virtual machines within Kubernetes.
This article traces the rapid rise of Kubernetes Operators from a niche PoC to a de‑facto standard for deploying and managing distributed stateful applications, explains how they extend the controller pattern to provide declarative, dynamic lifecycle management, compares them with StatefulSets, and details the technical evolution from TPR to CRD with concrete code examples.
Ant Financial tackles the challenge of managing dozens of Kubernetes clusters and over a hundred thousand worker nodes by employing a meta‑cluster with Kube‑on‑Kube and Node Operators, enabling automated lifecycle management, scaling, upgrades, and fault recovery for both master components and worker nodes.
