Cross‑IDC Kafka Hot‑Standby with MirrorMaker 2: Architecture, Design, and Productization

This article explains how 360 Commercialization implements cross‑IDC hot‑standby for Kafka using MirrorMaker 2, covering MM2 fundamentals, architecture, internal topics, deployment on Kubernetes, design goals, solution details, challenges such as dynamic configuration and offset reverse‑mapping, and productized risk mitigation.

KafkaMirrorMaker2cross-IDC

0 likes · 11 min read

Cross‑IDC Kafka Hot‑Standby with MirrorMaker 2: Architecture, Design, and Productization

Java High-Performance Architecture

Aug 23, 2016 · Operations

How Pinterest Scales Service Discovery with ZooKeeper—and Overcomes Its Pitfalls

Pinterest shares its real‑world experience using ZooKeeper for service discovery and dynamic configuration, detailing the challenges of connection overload, transaction spikes, network partitions, and human error, and explains the multi‑step solutions that improved resilience and reduced operational risk.

Dynamic ConfigurationPinterestZooKeeper

0 likes · 7 min read

Cross‑IDC Kafka Hot‑Standby with MirrorMaker 2: Architecture, Design, and Productization

How Pinterest Scales Service Discovery with ZooKeeper—and Overcomes Its Pitfalls

Cross‑IDC Kafka Hot‑Standby with MirrorMaker 2: Architecture, Design, and Productization