BestHub
Sign in
dbaplus Community
dbaplus Community
Jan 14, 2023 · Backend Development

How to Minimize Data Movement When Scaling Kafka Replicas

This article explores strategies for batch scaling Kafka replicas with minimal data migration, presenting two design ideas, detailed calculations of broker lists, partition counts, start indexes, and replica shifts, and provides step‑by‑step algorithms and code snippets to compute optimal replica assignments for both expansion and contraction scenarios.

KafkaPartition AssignmentReplica Scaling
0 likes · 15 min read
How to Minimize Data Movement When Scaling Kafka Replicas
ShiZhen AI
ShiZhen AI
Nov 2, 2022 · Operations

How to Quickly Scale Kafka Topic Replicas with Know Streaming

This guide explains how Know Streaming adds a non‑native Kafka feature that lets users batch‑scale replicas for one or multiple topics, customize target brokers, preview and edit the reassignment plan, and throttle the operation to minimize impact on the cluster.

KafkaKafka OperationsKnow Streaming
0 likes · 5 min read
How to Quickly Scale Kafka Topic Replicas with Know Streaming