Tagged articles
5 articles
Page 1 of 1
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 12, 2025 · Backend Development

How to Prevent Kafka Message Loss: Producer, Broker, and Consumer Strategies

This guide explains comprehensive Kafka message loss prevention techniques, covering producer configurations like acks=all, retries, idempotence, broker settings such as replication factor and min.insync.replicas, consumer handling with manual offset commits, and full‑stack compensation and retry mechanisms with code examples.

Broker SettingsConsumer OffsetKafka
0 likes · 3 min read
How to Prevent Kafka Message Loss: Producer, Broker, and Consumer Strategies
Tencent Cloud Middleware
Tencent Cloud Middleware
Aug 1, 2025 · Backend Development

Mastering TDMQ CKafka Production: Configurations, Partitioning, and Reliable Messaging

This guide explains how to efficiently produce messages with TDMQ CKafka, covering topic creation, partition sizing, retry policies, asynchronous sending, key/value handling, batch tuning, sticky partitioning, idempotence, ACK settings, code examples, and strategies to avoid data skew and ensure high‑throughput, low‑latency messaging.

BatchingCKafkaIdempotence
0 likes · 18 min read
Mastering TDMQ CKafka Production: Configurations, Partitioning, and Reliable Messaging
Top Architect
Top Architect
May 15, 2023 · Backend Development

Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices

This article provides an in-depth overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, producer and consumer configurations, scaling strategies, monitoring tools, and practical operational commands for building and maintaining high‑throughput, highly available streaming systems.

BackendKafkaMessage Queue
0 likes · 31 min read
Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices