Migrating Kafka from EC2 to PaaSTA on Kubernetes: Strategy, Implementation, and Lessons Learned

This article details Yelp's end‑to‑end migration of Kafka clusters from EC2‑based brokers to Kubernetes‑based PaaSTA services, covering architectural changes, automated tooling, risk mitigation, rollback procedures, and practical lessons learned from the deployment process.

KafkaPaaSTAcloud-native

0 likes · 12 min read

Migrating Kafka from EC2 to PaaSTA on Kubernetes: Strategy, Implementation, and Lessons Learned

Cloud Native Technology Community

Jun 28, 2022 · Cloud Native

How Yelp Re‑engineered Kafka on Kubernetes with PaaSTA: Architecture Deep Dive

Yelp migrated its massive Kafka deployment from EC2 to a Kubernetes‑based PaaSTA platform, introducing a custom Kafka operator and Cruise Control to cut provisioning time, simplify upgrades, improve lifecycle management, and reduce reliance on Puppet, while maintaining high‑throughput data pipelines.

Cloud NativeCruise ControlKafka

0 likes · 11 min read

How Yelp Re‑engineered Kafka on Kubernetes with PaaSTA: Architecture Deep Dive