This article explains how MySQL partition tables and sharding (manual table splitting) both address performance issues caused by massive single‑table data, compares their architectures, lists limitations, outlines ideal use cases, and provides practical guidelines for choosing the right approach.
This guide walks you through checking the current partition layout, converting an MBR‑styled disk to GPT using fdisk and GNU Parted, recreating the partition, formatting it with ext4, mounting it, and finally expanding the filesystem to utilize the full cloud‑disk capacity, all while preserving existing data.
This article explains how Kafka achieves extremely high throughput by using a Reactor‑based non‑blocking I/O model, zero‑copy data transfer, sequential disk writes, memory‑mapped files, sparse indexing, partition load‑balancing, compression, batch processing, and a lock‑free offset design.
This article walks through the investigation of MySQL bug #115352, describing how an assertion failure in InnoDB’s dictionary cache caused a server crash during a killed ALTER TABLE on a partitioned table, the debugging steps taken, and the eventual fix applied in MySQL 8.0.40.
This article walks through StarRocks' materialized view refresh mechanisms, explains the various refresh triggers, details the refresh workflow, and introduces new parameters that allow selective refreshing of only changed data to avoid costly full‑partition refreshes.
This article explains Kafka's role as a messaging system, covering core concepts such as topics, partitions, producers, consumers, messages, cluster architecture, replicas, consumer groups, controller coordination with Zookeeper, and performance optimizations like sequential writes and zero‑copy networking.
This article explains how MySQL 8.x window functions such as OVER, PARTITION BY, and ORDER BY can simplify complex ranking and aggregation queries, demonstrates creating a sample scores table, and provides practical examples of functions like ROW_NUMBER, RANK, DENSE_RANK, NTILE, LAG, and LEAD with their results.
This article explains how improper bucket and partition settings in Apache Doris can degrade read/write performance, provides quantitative guidelines for choosing bucket and partition counts, and introduces the automatic bucket feature with practical syntax and usage tips.
This article explains Kafka's core concepts—including messages as byte arrays, optional keys for partition control, topic and partition organization, producer and consumer roles, offsets, consumer groups, and broker clusters—providing a concise technical overview for developers learning Kafka.
This article analyzes a real‑world Kafka outage caused by killing a broker process, explains why partitions with a replication factor of one lose their leader, and walks through the internal Zookeeper‑based failover mechanism and leader‑election logic that Kafka uses to recover from such failures.
This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication, leader/follower dynamics, and architectural diagrams, while also highlighting configuration details and operational considerations for building reliable distributed streaming systems.
This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, how they interact within a Kafka cluster, and illustrating the architecture with diagrams while also noting recent version changes and related disclaimer information.
This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication strategies, and how they work together within a Kafka cluster to ensure reliable, scalable message streaming.
This article provides a thorough overview of distributed systems, explaining their definition, core concepts such as partition and replication, key challenges, essential characteristics, typical components and protocols, a practical request flow example, and a curated list of real‑world implementations to help readers build a solid learning roadmap.
This article provides a visual walkthrough of Kafka's fundamental concepts—including its basic architecture, producer‑consumer model, topics, partitions, and cluster design—offering clear explanations and diagrams to help readers grasp how Kafka enables reliable, scalable message streaming in modern systems.
This article examines four common message middleware delivery models—Point-to-Point, Publish/Subscribe, Partition, and Transfer—explaining their core characteristics, differences, usage scenarios, and performance considerations, with practical examples from ActiveMQ, Kafka, RocketMQ, and NSQ in modern systems.
This article provides a clear, visual walkthrough of Kafka’s fundamental architecture, explaining how producers and consumers interact, the role of topics and partitions, consumer groups, and ZooKeeper’s coordination, helping readers grasp message flow, storage, ordering, and fault‑tolerance in a distributed streaming system.
This article explains Kafka's role as a decoupling message buffer, describes topics, partitions, replication, consumer groups, controller coordination with Zookeeper, and performance optimizations such as sequential writes, zero‑copy, log segmentation, and its reactor‑style network design.
This article explains the purpose of swap partitions, shows how to check current swap usage, and provides step‑by‑step instructions for creating swap space both via a dedicated disk partition and by using a swap file on a Linux server.
The article thoroughly explains Kafka’s message‑queue reliability design and implementation, covering use‑case scenarios, core concepts, storage format, producer acknowledgment settings, broker replication mechanisms (ISR, HW, LEO), consumer delivery semantics, the epoch solution for synchronization, and practical configuration guidelines for various consistency and availability requirements.
This guide explains how to shrink the /home partition, install missing fuser, resize the filesystem, and expand the root directory on a CentOS/RHEL 7 log server, including commands for unmounting, killing processes, resizing ext4 or xfs partitions, and re‑mounting the filesystem.
This guide explains how to safely reduce the /home partition size, free up space, and extend the root filesystem on a CentOS 7 server by unmounting /home, locating and terminating lingering processes, resizing the filesystem, installing required tools, and remounting the adjusted partitions.
This guide walks through diagnosing a mis‑partitioned CentOS 7 log server, installing missing tools, safely unmounting and shrinking the /home XFS filesystem, expanding the root volume, and remounting while emphasizing backup and proper command usage.
This article provides a comprehensive overview of Kafka, explaining how topics are divided into partitions, the roles of producers and consumers, consumer groups, broker responsibilities, offset management, data persistence, replication mechanisms, leader‑follower coordination, and the use of Zookeeper for metadata.
This article explains how Kafka uses topic partitions to achieve high throughput, discusses the advantages and costs of increasing partition counts, shows how messages are routed to partitions, and compares the built‑in range and round‑robin consumer assignment strategies with practical examples.
This article explains the end‑to‑end process of a Kafka producer sending a message to a broker, covering client components, the internal cache storage model, partition selection logic, and the workings of the sender thread and network client.
This article provides a thorough overview of distributed systems, explaining their definition, when to adopt them, core concepts like partition and replication, common challenges, essential properties, typical architectural components, and practical implementations to help readers build a solid learning roadmap.
This comprehensive guide walks you through essential Oracle database administration tasks—including starting and stopping the database, managing listeners, creating and altering tablespaces, handling users and privileges, controlling transactions, building indexes, defining views and materialized views, working with sequences, synonyms, and partitioned tables—complete with commands, examples, and best‑practice tips.
This article explains how to build a multi‑threaded Kafka consumer and producer in Java, covering partition concepts, consumer group offsets, thread‑pool configuration, and code examples that demonstrate proper use of Kafka streams, partition keys, and batch message sending for improved throughput.
This article explains Kafka's topic architecture, detailing how topics are split into partitions for scalability and parallelism, the role of logs, key-based and round-robin partitioning, replication with leaders, followers, ISR, and how these mechanisms enable fault‑tolerance and high‑performance consumer failover.
This guide walks through diagnosing a busy /home mount, installing missing tools, safely unmounting, resizing the home partition, installing XFS utilities, and finally expanding the root filesystem on a CentOS 7 server.
This guide explains essential Linux storage commands—including fdisk, df, du, mount, umount—covers automatic mounting via /etc/fstab, details disk partitioning with fdisk, and demonstrates how to format partitions using mkfs, providing practical examples for each operation.
This article explains Linux's hierarchical file system, detailing how the root directory, partitions, boot and super blocks, inodes, and data blocks interact to store and retrieve files, and it also covers file descriptors, sharing, and process forking.
This article explains Kafka's internal message storage mechanism, detailing how topics are divided into partitions, how partitions are segmented into LogSegments with data and index files, and how sparse indexing enables efficient offset lookups.
This article explains Kafka’s core architecture—including brokers, topics, partitions, offsets, producer and consumer mechanics, replication, availability, consistency, persistence, performance optimizations, and Zookeeper integration—providing a comprehensive guide for building reliable distributed messaging systems.
This article provides a clear, step‑by‑step overview of Linux storage fundamentals, covering disk anatomy, partition management, file system structures, inode concepts, hard and soft links, mounting principles, and essential command‑line tools for managing storage on CentOS 6.
This article explains the physical components of hard disk drives, the concepts of tracks, cylinders and sectors, compares MBR and GPT partition schemes, outlines common file system types, and provides practical command‑line examples using fdisk and parted for creating, modifying, and deleting partitions on Linux.
Kafka stores each topic as partitions that are divided into sequential segment files containing paired .log data and .index files, using global offsets and sparse memory‑mapped indexes to enable fast offset‑based lookups, efficient deletions, and minimal disk I/O in real‑world deployments.
