This guide introduces Redis as a high‑performance key‑value store, covering its core data structures, advantages, persistence mechanisms, publish/subscribe model, transaction handling, and replication strategies with practical command examples.
This article provides a comprehensive technical overview of Kafka's offset handling, covering the request entry point, in‑memory offset sources, offset commit and fetch implementations, file storage layout, and the leader‑follower synchronization process that ensures data replication and high‑watermark updates.
This article explains Kafka's topic architecture, detailing how topics are split into partitions for scalability and parallelism, the role of logs, key-based and round-robin partitioning, replication with leaders, followers, ISR, and how these mechanisms enable fault‑tolerance and high‑performance consumer failover.
This article reviews Alibaba's decade‑long evolution of HBase high‑availability, covering large‑cluster design, MTTF/MTTR metrics, disaster‑recovery strategies, traffic switching, and performance optimizations that together enable millions of requests per second with near‑zero downtime.
This comprehensive guide covers fundamental SQL Server operations such as creating databases, tables, indexes, and views, advanced techniques like set operators, subqueries, and linked servers, plus step‑by‑step instructions for replication, backup, compression, and automated synchronization using stored procedures and SQL Agent jobs.
This article explains the internal calculation of the Time column shown by MySQL's SHOW PROCESSLIST command, covering the source functions, overloads of THD::set_time, various scenarios that affect the result—including replication lag, manual timestamp settings, and idle sessions—and why Percona and official builds may display different values.
This guide introduces a set of scripts for installing MySQL 8.0, configuring master‑slave replication and group replication, detailing required files, command usage, repository location, and essential configuration notes for a three‑node deployment.
This guide explains CloudEndure’s features and walks through a step‑by‑step example of configuring AWS cross‑region disaster recovery, covering initial project setup, data replication, test and recovery mode switching, and the failback process, while highlighting networking and security considerations.
A detailed case study shows how a DELETE statement executed inside a MySQL stored procedure can switch binlog format to ROW, causing billions of bitmap operations on a partitioned table and resulting in severe master‑slave replication delay, and presents three practical solutions.
KeyDB is a high‑performance, multithreaded fork of Redis that retains full Redis compatibility while delivering up to twice the query throughput and 60 % lower latency, and the article explains its thread model, connection management, fastlock mechanism, and active‑replica features in detail.
This article explains how MySQL 8.0.18 introduced privilege checking for replication applier threads, outlines the three-step process to create a restricted‑privilege user, assign necessary permissions or roles, associate the user with the CHANGE MASTER TO statement, and discusses observability and important considerations.
This article explains the structure and purpose of the MySQL slave_relay_log_info table, how relay log positions are persisted and synchronized, the role of master_auto_position and GTID, and the mechanisms of relay_log_recovery to ensure reliable replication after crashes.
This article reviews MySQL replication concepts, compares asynchronous, semi‑synchronous, group, and Percona XtraDB Cluster solutions, explains row‑based versus statement‑based replication, and clears up common misconceptions about replication, clustering, backup, and load balancing.
This article provides a comprehensive MySQL replication FAQ covering cross‑OS and hardware compatibility, master‑slave connection behavior, monitoring lag, forcing master pause, bidirectional replication considerations, performance improvements, high‑availability setups, and how to exclude GRANT/REVOKE statements from replication.
This article provides a comprehensive introduction to Redis, covering its high‑performance key‑value architecture, supported data structures (string, hash, list, set, sorted set), core commands, persistence mechanisms, replication, sentinel monitoring, sharding, pub/sub messaging and transaction handling, with practical command‑line examples.
This article provides a comprehensive overview of HDFS, covering its purpose, architecture, read/write mechanisms, replication strategies, component responsibilities, common command‑line tools, and the advantages and disadvantages of using Hadoop Distributed File System for large‑scale data storage.
This article explains how MySQL's slave_rows_search_algorithms setting and the presence of primary or unique indexes affect the way a replica locates rows for DELETE operations, compares index‑scan, table‑scan, and hash‑scan methods, and provides practical guidance to reduce replication lag.
This guide explains how to configure replication from a MySQL 8.0 master to a MySQL 5.7 slave, covering supported version combinations, character‑set adjustments, authentication plugin changes, user creation, CHANGE MASTER commands, status verification, quick testing, and common pitfalls when using newer MySQL features.
This article provides a comprehensive guide to MySQL performance optimization, covering database design principles, field type selection, indexing strategies, storage engine choices, query caching, partitioning methods, master‑slave replication setup, read/write splitting, load balancing, and profiling tools for diagnosing slow queries.
This article explores Redis's text-based RESP protocol, examines whether Redis truly supports ACID transactions, explains its optimistic lock implementation, details persistence mechanisms like RDB and AOF, discusses memory‑saving data structures, outlines replication processes, and reviews expiration deletion strategies, providing a comprehensive technical overview.
This article provides a comprehensive, step‑by‑step analysis of MySQL’s binlog commit workflow, covering key parameters such as binlog_group_commit_sync_delay, sync_binlog, and binlog_transaction_dependency_tracking, and explains how last_commit and seq_number are generated and used in parallel replication.
The article describes how Tencent Financial Technology (FiT) built a globally largest, financial‑grade distributed MySQL cluster with multi‑active data‑center architecture, Raft‑based failover, priority‑driven switching, and automated backup to achieve 99.999% availability for massive payment workloads.
This article provides a comprehensive overview of Kafka, covering its core features, use‑case scenarios, partition and replica design, file storage structure, consumer‑group coordination, delivery guarantees, performance optimizations, and the role of Zookeeper in managing the cluster.
This article explains Elasticsearch's cluster architecture, including nodes, indices, shards, replicas, deployment models, and data layer storage, and compares two types of distributed data system designs—local file‑system based and shared‑storage based—highlighting their advantages and trade‑offs.
Kafka is a distributed, partitioned, replicated messaging system originally developed by LinkedIn, offering high throughput, low latency, fault tolerance, and scalability; this article explains its core concepts, file storage design, partition replication, leader election, consumer groups, delivery guarantees, and operational considerations for big‑data pipelines.
This article provides a comprehensive overview of Elasticsearch, covering its role in handling structured and unstructured data, core concepts such as Lucene, inverted indexes, clusters, shards, replicas, mapping, indexing processes, storage mechanisms, and practical performance tuning tips for deployment.
This article demonstrates how to install and verify the MySQL 8.0.17 clone plugin, create privileged clone users on both donor and recipient servers, configure cloning parameters, execute a full instance clone, set up replication with CHANGE MASTER, and discusses the plugin's limitations such as InnoDB‑only support and DDL restrictions.
This article explains the architecture of Elasticsearch clusters, covering core concepts such as nodes, indices, shards, replicas, indexing flow, mixed and tiered deployment models, data‑layer storage, and compares these designs with other distributed data system architectures.
This article provides a comprehensive tutorial on MySQL 8.0's Clone Plugin, covering its concepts, local and remote cloning procedures, required permissions, configuration steps, monitoring queries, and a detailed comparison with XtraBackup for fast data replication and recovery.
MySQL 8.0.17 introduces server cloning via MySQL Shell, multi‑value indexes for JSON arrays, enhanced JSON schema validation, optimizer and Volcano iterator upgrades, new collations, replication and routing enhancements, plus numerous bug fixes and deprecations, all detailed in the official release notes.
This article explains how to achieve high‑throughput Redis caching with master‑slave replication, cluster scaling, disk‑less sync, incremental replication, and Sentinel‑based automatic failover to reach 99.99% availability and handle tens of millions of QPS.
This article explains how Redis can be scaled for high concurrency using master‑slave architecture, clustering, and read‑write separation, and it details the mechanisms of replication, persistence, Sentinel monitoring, failover, and configuration that together achieve high availability and data safety.
Redis, the in‑memory data store, uses a simple RESP text protocol, offers limited ACID‑style transactions without rollback, employs optimistic locking via WATCH, provides multiple persistence options (RDB, AOF, hybrid), optimizes memory with ziplist and quicklist structures, and implements sophisticated replication and expiration strategies to balance performance and resource usage.
The article investigates why a DELETE without a WHERE clause on a 500k‑row MySQL table takes over ten hours to replay on a slave, analyzes row‑mode binlog replay mechanisms, compares different slave_rows_search_algorithms, presents test results, and offers practical recommendations for improving replication performance.
This article provides a concise, ten‑minute guide to MySQL master‑slave and master‑master replication, data sharding principles and implementations, and various database deployment architectures—including single‑instance, replication‑based scaling, and sharding‑based scaling—while highlighting practical considerations, advantages, and common pitfalls.
This article explains Kafka's mechanisms for ensuring data reliability through partition replicas, producer acknowledgments, and leader election, and describes how the high‑water‑mark and ISR concepts maintain strong data consistency across the cluster.
The article explains how MongoDB Change Streams, introduced in version 3.6 and expanded in 4.0, enable near‑real‑time subscription to collection, database, and cluster changes, discusses implementation details, options, code examples in the mongo shell and Python, and provides practical testing insights and driver compatibility notes.
The article explains that although Kafka could technically implement a master‑slave (write‑read) model, it deliberately avoids it because the master‑write master‑read design already provides superior load balancing, consistency, and lower latency, making a separate read‑only replica unnecessary.
NebulasFs is a self‑developed distributed, highly available and durable storage system designed to efficiently store billions of small files by using a master‑datanode architecture, multi‑tenant isolation, customizable replication, automatic scaling, and automated replica repair, addressing the challenges of massive unstructured data generated by modern applications.
This article explains the importance of high availability in distributed systems, defines MySQL high‑availability concepts such as replication, describes several HA architectures including MySQL Cluster, MMM, and MHA, and discusses design principles for building resilient database services.
This article explains the MySQL 5.6 slave_rows_search_algorithms parameter, reproduces the HASH_SCAN bug that causes "Can't find record" errors during row‑based replication, analyzes why it occurs, and provides practical solutions such as adjusting keys, changing the algorithm setting, or upgrading MySQL.
This article provides a comprehensive walkthrough of Redis replication, detailing the step‑by‑step sync process, data synchronization mechanisms, full and partial copy workflows, heartbeat design, and asynchronous replication, while highlighting key commands like PSYNC and their practical implications.
This guide explains Redis replication in depth, detailing the step‑by‑step slave‑of initiation, the PSYNC command’s role in data synchronization, the full and partial sync processes, heartbeat mechanisms, and asynchronous write propagation, while highlighting key configuration parameters and performance considerations.
This article provides a comprehensive overview of Kafka's architecture, covering topics, partitions, producer and consumer workflows, replication and leader election, offset management, consumer group coordination, rebalance processes, delivery semantics (at‑most‑once, at‑least‑once, exactly‑once), transactional messaging, and underlying file and configuration details.
This article analyzes common MySQL slave‑lag scenarios—including missing indexes, large master transactions, high write rates, and MyISAM backups—explains their risks, and provides practical solutions such as index tuning, hardware upgrades, configuration changes, and enabling parallel replication to improve replication performance.
This article explains how duplicate MySQL server_id or server_uuid values in replication topologies can cause data loss during high‑availability failover, illustrates the underlying mechanisms with diagrams, and provides practical configuration recommendations to avoid these issues.
The DTLE 2.19.03.0 release introduces cross‑data‑center transfer, cloud synchronization, data aggregation, DDL filtering, schema name conversion, and numerous bug fixes, providing a reliable MySQL‑focused middleware for diverse data replication and migration scenarios.
The article details CynosDB’s cloud‑native PostgreSQL design—using compute‑storage separation, log sinking with asynchronous replay, and multi‑version reads—to enable a one‑primary multi‑read architecture that delivers elastic scaling, reduced I/O, stateless instances, and rapid failover and efficient resource utilization through parallel log‑based recovery.
The article examines MySQL 5.6’s crash‑safe slave replication, explaining how earlier versions’ unsafe relay‑log handling could corrupt position data, describing the atomic update of mysql.slave_relay_log_info via table‑based relay‑log info and transaction coordination, and covering configuration options, recovery behavior, GTID implications, performance trade‑offs, and implementation guidance.
OceanBase, a fully proprietary distributed NewSQL database, has evolved over eight years to support high‑availability, strong consistency via Paxos, flexible replica management, OBProxy routing, LSM‑Tree storage, and migration tools, enabling seamless scaling, disaster recovery, and Oracle compatibility for large‑scale financial services.
The article recounts a pre‑promotion MySQL replication incident at JD.com, explains the master‑slave architecture and thread roles, identifies slow‑SQL and missing indexes as root causes of replication lag, and proposes practical measures to reduce latency and improve system stability.
This article examines multiple fault‑tolerant transaction designs—RSM‑based KV, RSM‑based transactions, shared‑storage approaches, high‑availability KV layers, and single‑node engine extensions—comparing their replication strategies, lock handling, and performance trade‑offs while raising open questions about ordering and consistency.
This guide explains why a single MySQL server is a bottleneck, how to form a clustered master‑slave architecture, the binlog and GTID replication mechanisms, step‑by‑step configuration commands, and the trade‑offs of each approach.
MongoDB 4.0 introduces multi‑document ACID transactions with snapshot isolation, supporting replica sets and WiredTiger, and this article explains ACID concepts, outlines limitations, demonstrates session commands, and compares transaction behavior—including conflict detection, repeatable reads, and phantom reads—to MySQL’s implementation.
This article explains Redis's core data types—String, Hash, List, Set, and Sorted Set—its internal object model, persistence options (RDB and AOF) with their pros and cons, transaction characteristics, master‑slave replication mechanisms, and common caching scenarios and design considerations.
This comprehensive guide explains Redis fundamentals, its rich data structures and common commands, then dives into performance optimization, replication, and clustering, offering practical examples and best‑practice recommendations for building reliable, high‑performance Redis deployments.
The talk by Tencent’s senior MySQL engineer explains high‑availability concepts—99.95% uptime, RPO/RTO metrics, backup methods, and replication modes—while comparing single‑node, shared‑storage, and share‑nothing architectures, detailing failover tools (Keepalived, MMM, MHA), cluster solutions (PXC, MGC, Group Replication) and NewSQL examples such as Aurora, PolarDB and CynosDB.
This guide explains the complete process of configuring MySQL master‑slave replication on two CentOS machines, covering prerequisite setup, enabling binary logging, creating a replication user, capturing binlog coordinates, configuring the slave, and verifying successful synchronization.
The Redis community is urging a rename of the master‑slave replication terminology due to social concerns, but the project's lead highlights significant compatibility costs, outlining short‑term compromises and long‑term redesigns while balancing technical feasibility and community expectations.
This article compares MySQL and PostgreSQL across open‑source licensing, ACID compliance, SQL standard support, replication modes, concurrency control, performance characteristics, high‑availability solutions, external data source integration, and storage models, helping readers decide which database best fits their workloads.
Uber’s engineering team explains how Postgres’s immutable rows, write‑ahead logging, and replication design caused write amplification, upgrade pain, and data‑corruption risks, leading them to adopt a MySQL‑based Schemaless sharding layer that offers better buffering, connection handling, and replication semantics for massive scale.
This article provides a comprehensive English translation of the Red Hat Ceph Storage Architecture Guide, covering Ceph's distributed object storage concepts, cluster architecture, storage pools, CRUSH algorithm, replication and erasure‑coding I/O, internal operations, high‑availability mechanisms, client interfaces, and encryption considerations for cloud environments.
This article explains fundamental MySQL concepts including primary, candidate, super and foreign keys, transaction ACID properties, view creation, differences among DROP, DELETE and TRUNCATE, index structures and types, join variations, normalization forms, optimization techniques, replication mechanisms, engine distinctions, and logging formats.
This article examines five common Redis deployment patterns—single instance, master‑slave replication, Sentinel, Cluster, and custom high‑availability solutions—detailing their architectures, advantages, drawbacks, and practical configuration tips to help engineers choose the most suitable setup for their workloads.
This article reviews traditional database high‑availability techniques, explains the advantages of distributed multi‑replica consistency (Paxos/Raft) used by OceanBase, and compares various deployment topologies—from single‑site three‑replica to multi‑city five‑replica designs—highlighting their trade‑offs and best‑practice recommendations.
This article explores Redis’s advanced features—including data types, master‑slave, sentinel, and cluster architectures, transaction handling, RDB/AOF persistence, pub/sub messaging, and a practical e‑commerce search case study—providing design insights and best‑practice configurations for high‑availability and performance.
This article describes how Ctrip's hotel R&D team tackled growing order‑volume challenges by sharding the database, building a real‑time Elasticsearch index, implementing a custom replication pipeline, and applying various write‑ and read‑optimizations to achieve low latency and stable performance.
This article explains Kafka's role as a distributed message queue, covering its architecture, replication mechanisms, producer‑consumer workflow, message integrity guarantees, schema management, and performance tuning for high‑throughput, low‑latency backend systems.
An in‑depth comparison of MySQL 8 and PostgreSQL 10 examines feature parity, storage architecture, indexing, memory usage, replication, update overhead, and garbage collection, highlighting how recent improvements narrow the gap and offering guidance on choosing the right database for specific workloads.
This article analyzes a MySQL master‑crash scenario where mismatched Read_Master_Log_Pos and Exec_Master_Log_Pos prevent HA failover, explains binlog event structures, and proposes updating Read_Master_Log_Pos only after a full transaction is received to ensure reliable asynchronous replication.
This guide walks through configuring MySQL master‑slave replication inside Docker containers, covering environment setup, container creation, MySQL configuration changes, replication user creation, synchronization commands, troubleshooting tips, and verification of data replication between the master and slave instances.
This article examines the core technologies behind NewSQL databases for OLTP workloads, contrasting them with NoSQL and traditional relational systems by exploring storage engines such as B‑Tree and LSM‑Tree, sharding strategies, replication models, and distributed transaction mechanisms like two‑phase commit.
This article walks readers through setting up MySQL replication, from the basic master‑slave model to a one‑master‑multiple‑slave cluster, covering configuration files, essential parameters, verification commands, performance tips, and common pitfalls for production deployments.
This article explains Dynamo, the decentralized key‑value storage system, covering its design goals, consistent‑hashing partitioning with virtual nodes, replication strategies, quorum‑based consistency, conflict resolution with vector clocks, hinted handoff, Merkle‑tree synchronization, and gossip‑based failure detection.
This article examines core distributed system design principles—reliability, scalability, and maintainability—explaining how techniques such as replication, partitioning, consensus algorithms, and transactions address hardware, software, and human failures, and discusses vertical and horizontal scaling strategies to achieve robust, extensible, and maintainable architectures.
This guide walks through configuring Oracle multi‑master data replication, covering site creation, group objects, propagator and receiver setup, purge scheduling, database link creation, replication group definition, table registration, conflict handling, and finally resuming replication, all illustrated with complete SQL code examples.
This tutorial explains how to set up two MySQL servers—one as master for writes and one as slave for reads—by configuring replication accounts, binary logging, server IDs, firewall rules, and then demonstrates read/write separation using a lightweight PHP framework.
This article presents an in‑depth overview of Zeppelin, a high‑availability, high‑performance block storage service, covering its motivation, online vs offline storage distinctions, data distribution strategies, centralized meta‑server design, replication policies, RocksDB‑based storage engine, Raft‑based consistency protocol, threading model, client request flow, and fault‑handling mechanisms.
This guide introduces Redis as an advanced key‑value store, explains how to start the server and use its CLI tools, and provides detailed command references and demos for strings, lists, sets, sorted sets, hashes, transactions, replication, and pub/sub.
This article walks through a real‑world case of MySQL 5.7 replication delay after switching to TokuDB, presenting a step‑by‑step methodology that examines network, hardware, large transactions, locks, configuration parameters, and multi‑threaded replication to identify and resolve the root cause.
This comprehensive guide introduces Redis fundamentals, covering its core data structures and essential commands, then delves into performance optimization, high‑availability setups with replication and Sentinel, and scaling strategies using Redis Cluster, providing practical examples and best‑practice recommendations for robust in‑memory data management.
This article explains step‑by‑step how to collect replication status, examine MySQL error logs and binary logs, understand common replication failures such as duplicate databases or missing binlog files, and apply GTID and configuration best practices to troubleshoot and fix MySQL replication problems in high‑availability setups.
This article interprets the 2017 SIGMOD paper on Amazon Aurora, explaining its cloud‑native architecture, key advantages such as self‑healing storage and reduced network I/O, the challenges it introduces, a comparison with traditional databases and TiDB, and insights into deployment, replication, and recovery mechanisms.
This article explains why Kafka needs high availability, how data replication and leader election work together to keep partitions serving despite broker failures, and details the Zookeeper structures and broker failover process that enable Kafka's robust HA design.
This article explains the importance of upgrading PostgreSQL to benefit from new features and security fixes, compares traditional upgrade methods, introduces the PGQ replication system, and provides a detailed step‑by‑step guide for performing a major version upgrade with minimal downtime.
This article explains how PostgreSQL's streaming replication can provide zero data loss, high availability, and disaster‑recovery for financial institutions, detailing feedback and consistency metrics, architecture simplifications, configuration examples, performance impact, failover rules, flexibility, and cost considerations.
This guide walks you through building custom MySQL Docker images, configuring master and slave my.cnf files, launching the containers, creating a replication user, and synchronizing the slave using Docker commands and a ready‑made shell script, all with detailed code examples.
This article provides a comprehensive English overview of Redis, covering its in‑memory key‑value data model, master‑slave replication, cluster topology, installation steps, persistence mechanisms (RDB and AOF), consistency hashing, node failure detection, slave election, and the advantages and drawbacks of using Redis Cluster.
Redis is an open-source, in-memory data store offering versatile structures and commands; this guide explains its fundamentals, key data types, essential commands, practical examples, performance optimization techniques, replication, clustering, and Java client choices to help you design robust, high-performance Redis solutions.
This article explains how to secure MySQL data by configuring single‑node safeguards, implementing cluster replication (including semi‑sync), and applying proper backup methods, guiding readers through practical settings and best practices for reliable data persistence.
This article explains the concept of Database-as-a-Service (DBaaS), introduces MongoDB’s core capabilities, outlines the essential components such as lifecycle management, disaster recovery, monitoring, and value‑added services, and provides practical guidance on building a production‑grade MongoDB DBaaS platform.
This article explains why Kafka introduced High Availability in version 0.8, covering the necessity of data replication and leader election, the internal replication and ACK mechanisms, Zookeeper metadata structures, broker failover procedures, and the command‑line tools that help manage and rebalance a Kafka cluster.
This article compiles a comprehensive set of MySQL interview questions covering replication mechanisms, differences between MyISAM and InnoDB, character type nuances, transaction logging, binlog formats, performance tuning, backup strategies, monitoring, consistency checks, and handling large datasets, providing concise answers for each topic.
This article presents nine classic MySQL error cases—from connection limits and replication conflicts to installation permission issues, forgotten passwords, auto‑increment resets, character‑set garbling, binlog misconfiguration, timeout problems, and file‑open limits—each accompanied by clear diagnosis steps and practical solutions.
This article details UDB's high‑availability architecture and four kernel‑level optimizations—binlog replication, relay‑log recording, master.info handling, and relay‑log locking—that together improve MySQL semi‑synchronous replication performance and reliability.
Redis‑replicator is a lightweight Java library that implements Redis master‑slave synchronization, parses RDB and AOF files, supports Redis 2.6‑4.0 (including modules), and offers extensible command and module hooks, making it suitable for embedding in backend systems.
This article compiles ten classic MySQL error scenarios—from connection limits and replication conflicts to charset issues and file‑open limits—explaining the root causes, diagnostic commands, and step‑by‑step solutions so beginners and seasoned DBAs can troubleshoot confidently.
At HBaseCon 2017 Asia, Alibaba showcased a series of groundbreaking HBase enhancements—including strong synchronous replication, SQL-on-HBase capabilities, cross‑cluster range data copy, and read/write path optimizations—that dramatically improve performance, reliability, and usability for large‑scale big‑data storage.
This comprehensive guide introduces Redis fundamentals, explores its rich data structures and essential commands, delves into performance optimization techniques, explains replication and clustering strategies, and compares popular Java clients, providing practical examples and best‑practice recommendations for reliable, high‑performance deployments.
A senior MySQL engineer recounts a puzzling case where a custom script flushing relay logs caused the first transaction in each relay log to be skipped, leading to daily loss of nearly ten thousand rows in a rapidly growing production environment.
