Tagged articles
partitions
24 articles · Page 1 of 1
This article explains how Kafka maintains order within partitions using keys and offsets, why ordering across partitions can break, and how to preserve strict sequencing through producer configuration, idempotent producers, and exactly‑once transactional processing.
KafkaTransactionsdata ordering
0 likes · 9 min read


mikechenSep 11, 2025 · Backend Development
This article explains why message ordering is critical in scenarios such as financial transactions, e‑commerce order updates, audit logs, and IoT devices, then details Kafka’s core components—topics, partitions, offsets, producers, brokers, and consumer groups—and describes how single‑partition consumption and consistent key hashing ensure ordered processing while balancing throughput.
BackendConsumer GroupKafka
0 likes · 5 min read

This article visually breaks down Kafka’s fundamental concepts—including producers, consumers, topics, consumer groups, partitions, and cluster architecture—explaining how messages flow, are stored, and achieve load balancing and ordering within a distributed streaming system.
KafkaMessage Streamingbackend development
0 likes · 7 min read

This article explains Paimon's core concepts—including snapshots, partitions, buckets, consistency guarantees, file layout, LSM‑tree organization, and compaction strategies—while also covering table management tasks such as snapshot expiration, rollback, partition expiration, and small‑file mitigation techniques.
BucketsLSM-treePaimon
0 likes · 12 min read

This article provides a comprehensive overview of Apache Kafka, explaining its distributed message‑queue architecture, the role of topics and partitions, producer and consumer workflows, leader election, offset management, consumer‑group rebalancing, delivery semantics, transaction processing, file organization, and key configuration settings.
Distributed MessagingKafkaTransactions
0 likes · 17 min read

Kafka is a high‑performance distributed message queue that uses topics, partitions, and replicas for scalability, with producers writing messages, consumers reading them via consumer groups, and advanced features such as offset management, delivery semantics, rebalancing, and exactly‑once transactional processing, all coordinated by Zookeeper.
ConsumersDistributed MessagingProducers
0 likes · 17 min read

This article visually explains Kafka's core concepts—including producers, consumers, topics, partitions, consumer groups, and cluster architecture—so readers can clearly understand how messages flow, are stored, and remain fault‑tolerant within a distributed streaming system.
BackendKafkaMessage Queue
0 likes · 6 min read

This article provides a diagram‑driven walkthrough of Kafka’s fundamental concepts—including topics, partitions, producers, consumers, consumer groups, and cluster architecture—explaining how messages flow, are stored, and achieve reliability and ordering within a distributed streaming system.
Cluster ArchitectureConsumer GroupKafka
0 likes · 6 min read

This article visually breaks down Kafka’s fundamental concepts—including topics, partitions, producers, consumers, consumer groups, and cluster architecture—so readers can grasp how messages flow, are stored, and achieve load balancing and ordering within a distributed streaming platform.
KafkaMessage Queuebig-data
0 likes · 6 min read

This article explains the fundamental concepts of Apache Kafka, including producers, consumers, topics, partitions, consumer groups, and the role of ZooKeeper in a clustered architecture, while illustrating how messages are stored, routed, and ordered for reliable, scalable stream processing.
Kafkabig-dataconsumer groups
0 likes · 6 min read

This article visually breaks down Kafka’s core concepts—including topics, partitions, producers, consumers, and cluster architecture—explaining how messages flow, how consumer groups achieve load balancing, and how ZooKeeper coordinates leaders and followers, providing a clear, illustrated guide for developers working with distributed streaming systems.
KafkaMessage Queueconsumer groups
0 likes · 6 min read

This article provides a clear, visual guide to Kafka’s core concepts—including producers, consumers, topics, partitions, consumer groups, message ordering, and the underlying ZooKeeper‑managed cluster architecture—helping readers grasp how Kafka enables reliable, scalable stream processing.
ConsumersProducersbig data
0 likes · 6 min read

This article visually breaks down Kafka’s core concepts—including producers, consumers, topics, partitions, consumer groups, and cluster architecture—explaining how messages flow, are stored, and replicated across partitions and nodes, while highlighting the role of ZooKeeper in managing metadata.
Kafkaconsumer groupsdistributed systems
0 likes · 5 min read

Kafka partitions are the fundamental storage units that enable topics to scale horizontally, maintain message order within each partition, provide fault‑tolerance through replication, and support parallel consumption, with various write strategies such as key‑based, round‑robin, and custom rules.
Kafkaconsumer groupsfault tolerance
0 likes · 9 min read

This article provides a visual walkthrough of Kafka's fundamental concepts—including producers, consumers, topics, partitions, and cluster architecture—illustrated with diagrams to help readers clearly understand how messages flow and are stored in a distributed streaming system.
KafkaMessage Streamingconsumer groups
0 likes · 6 min read

This article explains how Kafka producers decide which partition to send messages to, how topic partition counts are configured, and how consumer groups assign partitions to instances using default range and round‑robin strategies, with code examples for illustration.
ConsumerKafkaassignment
0 likes · 17 min read

This article explains Kafka's core architecture, covering how topics and partitions are stored, the advantages of its consumption model, the internal network and threading design, and the high‑reliability distributed log storage and replication mechanisms that ensure data durability and scalability.
Consumer GroupDistributed MessagingHigh Availability
0 likes · 11 min read

This article presents New Relic's 20 best‑practice recommendations for operating Apache Kafka at high throughput, covering partitions, consumers, producers, and brokers, and explains key concepts, configuration tuning, monitoring, and architectural considerations to ensure reliable, scalable streaming pipelines.
Best PracticesBrokersConsumers
0 likes · 14 min read

This article presents 20 practical best‑practice recommendations—from partition sizing and consumer tuning to producer configuration and broker optimization—to help engineers build scalable, reliable, and high‑throughput Apache Kafka clusters for large‑scale applications.
Apache KafkaBrokersConsumers
0 likes · 16 min read

This guide presents New Relic’s 20 practical best‑practice recommendations—covering partitions, consumers, producers, and brokers—to help engineers design, tune, and monitor Apache Kafka deployments for reliable, high‑throughput performance.
BrokersConsumersKafka
0 likes · 15 min read


ITPUBOct 27, 2018 · Fundamentals
This article explains how Linux models all resources—including disks, devices, and inter‑process communication—as files, describes the physical storage mechanisms of hard drives, and walks through the steps of partitioning, formatting, mounting, and navigating the Linux file system hierarchy.
LinuxMountingfile-system
0 likes · 24 min read

This article explains how to determine the optimal Kafka partition count by balancing throughput gains, key‑based ordering requirements, file descriptor limits, and availability impacts, offering practical guidelines such as testing hardware limits and using broker‑count multiples for scalable deployments.
big datapartitionsthroughput
0 likes · 8 min read

This guide explains how to use the kafka‑topics.sh script to increase a Kafka topic's partition count, warns about the impact on keyed messages and ordering, and details why Kafka does not support decreasing partitions, offering alternative strategies for replication changes.
Topicbig datacli
0 likes · 6 min read

This article explains the Unix principle that everything is a file, describes regular and special file types, outlines why and how disks are partitioned, introduces mount points, and details the standard Linux filesystem hierarchy and inode metadata.
LinuxMount Pointsfile-system
0 likes · 18 min read
