Tagged articles

replication

737 articles · Page 6 of 8
Open Source Linux
Open Source Linux
Mar 13, 2020 · Databases

Mastering SQL Server: Essential Commands, Queries, and Administration Tips

This comprehensive guide covers SQL Server basics such as logging in, creating and dropping databases, tables, indexes and views, advanced query techniques like UNION, outer joins and pagination, plus maintenance tasks, backup and restore, linked‑server data transfer, replication setup, and useful scripts for database administration.

Database AdministrationSQL ServerSQL queries
0 likes · 23 min read
Mastering SQL Server: Essential Commands, Queries, and Administration Tips
Sohu Tech Products
Sohu Tech Products
Mar 4, 2020 · Big Data

Introduction to HDFS: Architecture, Components, and Operations

This article provides a comprehensive overview of HDFS, covering its role as a distributed file system, the concepts of blocks, NameNode and DataNode responsibilities, replication, edit logs, snapshots, high‑availability mechanisms, and practical considerations for managing large‑scale data storage.

DataNodeDistributed File SystemHDFS
0 likes · 11 min read
Introduction to HDFS: Architecture, Components, and Operations
Aikesheng Open Source Community
Aikesheng Open Source Community
Mar 4, 2020 · Databases

Improved MySQL 8 Replication Lag Monitoring Using GTID Timestamps and Performance Schema

The article explains the shortcomings of traditional MySQL replication lag measurement, introduces the community heartbeat‑table approach and its limitations, and then details MySQL 8 enhancements (WL#7319, WL#7374) that embed transaction timestamps in binlog events and expose new performance_schema tables, providing precise SQL queries to monitor lag at various stages of the replication pipeline.

GTIDLag MonitoringPerformance Schema
0 likes · 8 min read
Improved MySQL 8 Replication Lag Monitoring Using GTID Timestamps and Performance Schema
Big Data Technology Architecture
Big Data Technology Architecture
Feb 26, 2020 · Big Data

Comprehensive Guide to Kafka Architecture, Messaging Mechanisms, Replication, Controllers, and Consumer Rebalance

This article provides an in‑depth yet approachable overview of Kafka's core concepts—including its architecture, terminology, message‑sending pipeline, replication strategy, controller role, and consumer group rebalance mechanisms—helping readers quickly grasp how Kafka works as a high‑throughput distributed messaging and streaming platform.

Consumer RebalanceDistributed MessagingStreaming
0 likes · 21 min read
Comprehensive Guide to Kafka Architecture, Messaging Mechanisms, Replication, Controllers, and Consumer Rebalance
Aikesheng Open Source Community
Aikesheng Open Source Community
Feb 24, 2020 · Databases

How to Build and Manage MySQL InnoDB Replica Sets with MySQL Shell & Router

This guide walks through preparing the environment, configuring MySQL instances, creating an InnoDB ReplicaSet using MySQL Shell, adding replicas, setting up MySQL Router for read/write splitting, testing connections, and performing common management tasks such as promoting a primary and removing or re‑adding nodes.

Database AdministrationInnoDB ReplicaSetMySQL Router
0 likes · 12 min read
How to Build and Manage MySQL InnoDB Replica Sets with MySQL Shell & Router
Architects' Tech Alliance
Architects' Tech Alliance
Feb 10, 2020 · Fundamentals

Mastering Distributed System Fundamentals: Models, Replication, Consistency, and Protocols

This article provides a comprehensive overview of distributed system fundamentals, covering node modeling, replica concepts, consistency levels, data distribution strategies, centralized and decentralized replica protocols, lease mechanisms, quorum, two‑phase commit, MVCC, Paxos, and the CAP theorem, while analyzing their trade‑offs in availability, consistency, and partition tolerance.

Consensus ProtocolsData Distributionconsistency
0 likes · 55 min read
Mastering Distributed System Fundamentals: Models, Replication, Consistency, and Protocols
dbaplus Community
dbaplus Community
Feb 2, 2020 · Databases

JDHBase Multi‑Active Disaster Recovery: Replication, Auto‑Failover & Consistency

JDHBase, JD.com’s large‑scale KV store, powers billions of daily reads and writes across 7,000 nodes, and this article details its multi‑active, cross‑region architecture—including HBase replication fundamentals, Fox Manager routing, automatic failover policies, dynamic replication tuning, and serial replication to ensure strong consistency.

Database ArchitectureDisaster RecoveryHBase
0 likes · 15 min read
JDHBase Multi‑Active Disaster Recovery: Replication, Auto‑Failover & Consistency
Architects Research Society
Architects Research Society
Jan 27, 2020 · Databases

CouchDB Final Consistency and Distributed System Design

This article explains CouchDB’s eventual consistency model, its use of MVCC, CAP theorem trade‑offs, incremental replication, and document validation, illustrating how these mechanisms enable scalable, high‑availability distributed databases without locking, and includes a practical case study of syncing Songbird playlists.

CouchDBMVCCdistributed systems
0 likes · 15 min read
CouchDB Final Consistency and Distributed System Design
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 16, 2020 · Big Data

Kafka Interview Guide: Core Concepts, Architecture, and Practical Tips

This article compiles essential Kafka interview material, covering its role as a message queue, usage scenarios, architectural components, storage mechanisms, consumer group rebalancing, high‑availability features, replication details, ordering guarantees, producer/consumer client design, topic management, log retention, performance optimizations, and key monitoring metrics.

Big DataHigh AvailabilityMessage Queue
0 likes · 16 min read
Kafka Interview Guide: Core Concepts, Architecture, and Practical Tips
Aikesheng Open Source Community
Aikesheng Open Source Community
Jan 14, 2020 · Databases

MySQL 8.0.19 Maintenance Release – New Features and Improvements

MySQL 8.0.19 introduces InnoDB ReplicaSet, Router enhancements, numerous SQL syntax additions, optimizer improvements, new Information Schema role views, security features, replication options, X Protocol compression, and a range of deprecations and bug fixes, providing a comprehensive update for database administrators and developers.

InnoDBX Protocoldatabase
0 likes · 12 min read
MySQL 8.0.19 Maintenance Release – New Features and Improvements
macrozheng
macrozheng
Jan 14, 2020 · Databases

How to Set Up MySQL Master‑Slave Replication in Docker (Step‑by‑Step Guide)

This article explains the principles of MySQL master‑slave replication and provides a detailed, step‑by‑step tutorial for configuring a master and a slave instance in a Docker environment, including configuration files, Docker commands, replication setup, testing, and troubleshooting.

DockerMaster‑Slavedatabase
0 likes · 9 min read
How to Set Up MySQL Master‑Slave Replication in Docker (Step‑by‑Step Guide)
Programmer DD
Programmer DD
Jan 13, 2020 · Backend Development

How Kafka’s Broker Controller Keeps Your Data Flowing – Inside the Replication Engine

This article dives deep into Kafka’s internal mechanics, explaining how brokers replicate data, how the controller coordinates the cluster via ZooKeeper, the roles of leader and follower replicas, ISR management, request handling, fail‑over strategies, and consumer group rebalancing, all illustrated with diagrams.

Broker ControllerISRRebalance
0 likes · 36 min read
How Kafka’s Broker Controller Keeps Your Data Flowing – Inside the Replication Engine
JD Retail Technology
JD Retail Technology
Jan 6, 2020 · Backend Development

JDHBase Multi‑Active Architecture and Replication Practices

This article describes JDHBase’s large‑scale KV storage deployment, its HBase‑based asynchronous replication mechanism, the multi‑active architecture with active‑standby clusters, client interaction via Fox Manager, automatic failover strategies, dynamic replication tuning, and serial replication techniques to ensure data consistency across data centers.

Distributed storageHBaseHigh Availability
0 likes · 13 min read
JDHBase Multi‑Active Architecture and Replication Practices
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 21, 2019 · Big Data

Kafka Offset Management and Replication Mechanisms Explained

This article provides a comprehensive technical overview of Kafka's offset handling, covering the request entry point, in‑memory offset sources, offset commit and fetch implementations, file storage layout, and the leader‑follower synchronization process that ensures data replication and high‑watermark updates.

Big DataHigh WatermarkOffset Management
0 likes · 16 min read
Kafka Offset Management and Replication Mechanisms Explained
Java High-Performance Architecture
Java High-Performance Architecture
Dec 17, 2019 · Backend Development

Understanding Kafka Topic Architecture: Partitions, Replication, and Failover

This article explains Kafka's topic architecture, detailing how topics are split into partitions for scalability and parallelism, the role of logs, key-based and round-robin partitioning, replication with leaders, followers, ISR, and how these mechanisms enable fault‑tolerance and high‑performance consumer failover.

PartitionTopicbackend
0 likes · 7 min read
Understanding Kafka Topic Architecture: Partitions, Replication, and Failover
ITPUB
ITPUB
Dec 4, 2019 · Databases

Essential SQL Server Commands: From Basic CRUD to Advanced Replication and Automation

This comprehensive guide covers fundamental SQL Server operations such as creating databases, tables, indexes, and views, advanced techniques like set operators, subqueries, and linked servers, plus step‑by‑step instructions for replication, backup, compression, and automated synchronization using stored procedures and SQL Agent jobs.

Linked ServerSQLSQL Server
0 likes · 27 min read
Essential SQL Server Commands: From Basic CRUD to Advanced Replication and Automation
Aikesheng Open Source Community
Aikesheng Open Source Community
Dec 3, 2019 · Databases

Understanding How MySQL SHOW PROCESSLIST Calculates the Time Column and Why Negative Values Appear

This article explains the internal calculation of the Time column shown by MySQL's SHOW PROCESSLIST command, covering the source functions, overloads of THD::set_time, various scenarios that affect the result—including replication lag, manual timestamp settings, and idle sessions—and why Percona and official builds may display different values.

Database InternalsSHOW PROCESSLISTTime calculation
0 likes · 10 min read
Understanding How MySQL SHOW PROCESSLIST Calculates the Time Column and Why Negative Values Appear
dbaplus Community
dbaplus Community
Oct 29, 2019 · Cloud Computing

How to Achieve AWS Cross‑Region Disaster Recovery with CloudEndure

This guide explains CloudEndure’s features and walks through a step‑by‑step example of configuring AWS cross‑region disaster recovery, covering initial project setup, data replication, test and recovery mode switching, and the failback process, while highlighting networking and security considerations.

AWSCloud ComputingCloudEndure
0 likes · 16 min read
How to Achieve AWS Cross‑Region Disaster Recovery with CloudEndure
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 26, 2019 · Databases

KeyDB Multithreaded Architecture and Design Overview

KeyDB is a high‑performance, multithreaded fork of Redis that retains full Redis compatibility while delivering up to twice the query throughput and 60 % lower latency, and the article explains its thread model, connection management, fastlock mechanism, and active‑replica features in detail.

KeyDBRedisarchitecture
0 likes · 7 min read
KeyDB Multithreaded Architecture and Design Overview
Aikesheng Open Source Community
Aikesheng Open Source Community
Oct 18, 2019 · Databases

Enabling Privilege Checks for MySQL Replication Threads

This article explains how MySQL 8.0.18 introduced privilege checking for replication applier threads, outlines the three-step process to create a restricted‑privilege user, assign necessary permissions or roles, associate the user with the CHANGE MASTER TO statement, and discusses observability and important considerations.

Database AdministrationPrivilege Checksmysql
0 likes · 11 min read
Enabling Privilege Checks for MySQL Replication Threads
Aikesheng Open Source Community
Aikesheng Open Source Community
Sep 25, 2019 · Databases

MySQL Replication FAQ: Compatibility, Master‑Slave Behavior, Performance, and High‑Availability

This article provides a comprehensive MySQL replication FAQ covering cross‑OS and hardware compatibility, master‑slave connection behavior, monitoring lag, forcing master pause, bidirectional replication considerations, performance improvements, high‑availability setups, and how to exclude GRANT/REVOKE statements from replication.

High AvailabilityMaster‑Slavedatabase
0 likes · 10 min read
MySQL Replication FAQ: Compatibility, Master‑Slave Behavior, Performance, and High‑Availability
Java Captain
Java Captain
Sep 24, 2019 · Databases

Redis Overview: Features, Data Types, Commands, Persistence, Replication, Pub/Sub and Transactions

This article provides a comprehensive introduction to Redis, covering its high‑performance key‑value architecture, supported data structures (string, hash, list, set, sorted set), core commands, persistence mechanisms, replication, sentinel monitoring, sharding, pub/sub messaging and transaction handling, with practical command‑line examples.

Data TypesKey-Value StoreRedis
0 likes · 16 min read
Redis Overview: Features, Data Types, Commands, Persistence, Replication, Pub/Sub and Transactions
360 Tech Engineering
360 Tech Engineering
Sep 19, 2019 · Big Data

Understanding HDFS: Architecture, Read/Write Operations, Component Roles, Commands, and Pros & Cons

This article provides a comprehensive overview of HDFS, covering its purpose, architecture, read/write mechanisms, replication strategies, component responsibilities, common command‑line tools, and the advantages and disadvantages of using Hadoop Distributed File System for large‑scale data storage.

Distributed File SystemHDFSHadoop
0 likes · 10 min read
Understanding HDFS: Architecture, Read/Write Operations, Component Roles, Commands, and Pros & Cons
Aikesheng Open Source Community
Aikesheng Open Source Community
Sep 6, 2019 · Databases

Setting Up MySQL 8.0 to MySQL 5.7 Replication

This guide explains how to configure replication from a MySQL 8.0 master to a MySQL 5.7 slave, covering supported version combinations, character‑set adjustments, authentication plugin changes, user creation, CHANGE MASTER commands, status verification, quick testing, and common pitfalls when using newer MySQL features.

MySQL5.7MySQL8Version Compatibility
0 likes · 7 min read
Setting Up MySQL 8.0 to MySQL 5.7 Replication
Java Captain
Java Captain
Sep 5, 2019 · Databases

MySQL Optimization and Best Practices: Indexing, Partitioning, Replication, and Performance Tuning

This article provides a comprehensive guide to MySQL performance optimization, covering database design principles, field type selection, indexing strategies, storage engine choices, query caching, partitioning methods, master‑slave replication setup, read/write splitting, load balancing, and profiling tools for diagnosing slow queries.

IndexingOptimizationmysql
0 likes · 43 min read
MySQL Optimization and Best Practices: Indexing, Partitioning, Replication, and Performance Tuning
21CTO
21CTO
Sep 3, 2019 · Databases

Redis Deep Dive: Protocols, ACID Myths, Persistence, and Optimization

This article explores Redis's text-based RESP protocol, examines whether Redis truly supports ACID transactions, explains its optimistic lock implementation, details persistence mechanisms like RDB and AOF, discusses memory‑saving data structures, outlines replication processes, and reviews expiration deletion strategies, providing a comprehensive technical overview.

ACIDExpirationMemory optimization
0 likes · 22 min read
Redis Deep Dive: Protocols, ACID Myths, Persistence, and Optimization
Big Data Technology Architecture
Big Data Technology Architecture
Aug 26, 2019 · Big Data

Kafka Architecture and File Storage Mechanism: Design, Performance, and Operational Practices

This article provides a comprehensive overview of Kafka, covering its core features, use‑case scenarios, partition and replica design, file storage structure, consumer‑group coordination, delivery guarantees, performance optimizations, and the role of Zookeeper in managing the cluster.

Distributed MessagingZookeeperconsumer groups
0 likes · 54 min read
Kafka Architecture and File Storage Mechanism: Design, Performance, and Operational Practices
Architecture Digest
Architecture Digest
Aug 19, 2019 · Big Data

Elasticsearch Cluster Architecture and Distributed Data System Design

This article explains Elasticsearch's cluster architecture, including nodes, indices, shards, replicas, deployment models, and data layer storage, and compares two types of distributed data system designs—local file‑system based and shared‑storage based—highlighting their advantages and trade‑offs.

Cluster ArchitectureElasticsearchdata storage
0 likes · 13 min read
Elasticsearch Cluster Architecture and Distributed Data System Design
Architecture Digest
Architecture Digest
Aug 14, 2019 · Big Data

Kafka Overview: Architecture, Storage Mechanism, Replication, and Consumer/Producer Model

Kafka is a distributed, partitioned, replicated messaging system originally developed by LinkedIn, offering high throughput, low latency, fault tolerance, and scalability; this article explains its core concepts, file storage design, partition replication, leader election, consumer groups, delivery guarantees, and operational considerations for big‑data pipelines.

Big DataMessage Queueconsumer groups
0 likes · 56 min read
Kafka Overview: Architecture, Storage Mechanism, Replication, and Consumer/Producer Model
Big Data Technology Architecture
Big Data Technology Architecture
Aug 9, 2019 · Databases

Understanding Elasticsearch: Architecture, Core Concepts, and Performance Optimization

This article provides a comprehensive overview of Elasticsearch, covering its role in handling structured and unstructured data, core concepts such as Lucene, inverted indexes, clusters, shards, replicas, mapping, indexing processes, storage mechanisms, and practical performance tuning tips for deployment.

ElasticsearchPerformance TuningSearch Engine
0 likes · 35 min read
Understanding Elasticsearch: Architecture, Core Concepts, and Performance Optimization
Aikesheng Open Source Community
Aikesheng Open Source Community
Aug 5, 2019 · Databases

Using MySQL 8.0.17 Clone Plugin to Create a Slave from Scratch

This article demonstrates how to install and verify the MySQL 8.0.17 clone plugin, create privileged clone users on both donor and recipient servers, configure cloning parameters, execute a full instance clone, set up replication with CHANGE MASTER, and discusses the plugin's limitations such as InnoDB‑only support and DDL restrictions.

Clone PluginInnoDBbackup
0 likes · 10 min read
Using MySQL 8.0.17 Clone Plugin to Create a Slave from Scratch
Aikesheng Open Source Community
Aikesheng Open Source Community
Jul 23, 2019 · Databases

MySQL 8.0.17 Release Highlights: Cloning, JSON Multi‑Value Indexes, Optimizer Improvements, and More

MySQL 8.0.17 introduces server cloning via MySQL Shell, multi‑value indexes for JSON arrays, enhanced JSON schema validation, optimizer and Volcano iterator upgrades, new collations, replication and routing enhancements, plus numerous bug fixes and deprecations, all detailed in the official release notes.

JSON Indexcloningdatabase
0 likes · 8 min read
MySQL 8.0.17 Release Highlights: Cloning, JSON Multi‑Value Indexes, Optimizer Improvements, and More
Java Backend Technology
Java Backend Technology
Jul 11, 2019 · Databases

Understanding Redis: Protocol, ACID Myths, Persistence, and Optimization

Redis, the in‑memory data store, uses a simple RESP text protocol, offers limited ACID‑style transactions without rollback, employs optimistic locking via WATCH, provides multiple persistence options (RDB, AOF, hybrid), optimizes memory with ziplist and quicklist structures, and implements sophisticated replication and expiration strategies to balance performance and resource usage.

In-Memory DatabaseMemory optimizationPersistence
0 likes · 23 min read
Understanding Redis: Protocol, ACID Myths, Persistence, and Optimization
Aikesheng Open Source Community
Aikesheng Open Source Community
Jun 25, 2019 · Databases

Performance Analysis of MySQL Row‑Based Binlog Replay for Large Table Delete without WHERE Clause

The article investigates why a DELETE without a WHERE clause on a 500k‑row MySQL table takes over ten hours to replay on a slave, analyzes row‑mode binlog replay mechanisms, compares different slave_rows_search_algorithms, presents test results, and offers practical recommendations for improving replication performance.

Binlogdatabasemysql
0 likes · 10 min read
Performance Analysis of MySQL Row‑Based Binlog Replay for Large Table Delete without WHERE Clause
ITPUB
ITPUB
Jun 22, 2019 · Databases

Master MySQL Replication, Sharding, and Distributed Deployment in 10 Minutes

This article provides a concise, ten‑minute guide to MySQL master‑slave and master‑master replication, data sharding principles and implementations, and various database deployment architectures—including single‑instance, replication‑based scaling, and sharding‑based scaling—while highlighting practical considerations, advantages, and common pitfalls.

High AvailabilityMycatdistributed systems
0 likes · 15 min read
Master MySQL Replication, Sharding, and Distributed Deployment in 10 Minutes
Big Data Technology Architecture
Big Data Technology Architecture
Jun 18, 2019 · Big Data

How Kafka Guarantees Data Reliability and Consistency

This article explains Kafka's mechanisms for ensuring data reliability through partition replicas, producer acknowledgments, and leader election, and describes how the high‑water‑mark and ISR concepts maintain strong data consistency across the cluster.

Data ReliabilityLeader Electionconsistency
0 likes · 9 min read
How Kafka Guarantees Data Reliability and Consistency
NetEase Game Operations Platform
NetEase Game Operations Platform
Jun 15, 2019 · Databases

Using MongoDB Change Streams for Real‑Time Data Synchronization

The article explains how MongoDB Change Streams, introduced in version 3.6 and expanded in 4.0, enable near‑real‑time subscription to collection, database, and cluster changes, discusses implementation details, options, code examples in the mongo shell and Python, and provides practical testing insights and driver compatibility notes.

Change StreamsData synchronizationMongoDB
0 likes · 12 min read
Using MongoDB Change Streams for Real‑Time Data Synchronization
Architect's Tech Stack
Architect's Tech Stack
Jun 13, 2019 · Big Data

Why Kafka Does Not Support a Master‑Slave (Write‑Read) Model and How Its Master‑Write Master‑Read Architecture Achieves Load Balancing

The article explains that although Kafka could technically implement a master‑slave (write‑read) model, it deliberately avoids it because the master‑write master‑read design already provides superior load balancing, consistency, and lower latency, making a separate read‑only replica unnecessary.

Master‑Slavereplicationwrite-read
0 likes · 8 min read
Why Kafka Does Not Support a Master‑Slave (Write‑Read) Model and How Its Master‑Write Master‑Read Architecture Achieves Load Balancing
360 Tech Engineering
360 Tech Engineering
Jun 11, 2019 · Databases

NebulasFs: A Distributed High‑Availability Small‑File Storage System

NebulasFs is a self‑developed distributed, highly available and durable storage system designed to efficiently store billions of small files by using a master‑datanode architecture, multi‑tenant isolation, customizable replication, automatic scaling, and automated replica repair, addressing the challenges of massive unstructured data generated by modern applications.

Cloud NativeDistributed storageHigh Availability
0 likes · 7 min read
NebulasFs: A Distributed High‑Availability Small‑File Storage System
21CTO
21CTO
May 30, 2019 · Databases

Mastering Redis Replication: From Sync Process to Partial and Full Copy

This article provides a comprehensive walkthrough of Redis replication, detailing the step‑by‑step sync process, data synchronization mechanisms, full and partial copy workflows, heartbeat design, and asynchronous replication, while highlighting key commands like PSYNC and their practical implications.

Asynchronous ReplicationFull SyncPSYNC
0 likes · 13 min read
Mastering Redis Replication: From Sync Process to Partial and Full Copy
dbaplus Community
dbaplus Community
May 29, 2019 · Databases

Redis Replication Deep Dive: PSYNC, Full & Partial Sync, Heartbeats and Async Writes

This guide explains Redis replication in depth, detailing the step‑by‑step slave‑of initiation, the PSYNC command’s role in data synchronization, the full and partial sync processes, heartbeat mechanisms, and asynchronous write propagation, while highlighting key configuration parameters and performance considerations.

Full SyncPSYNCPartial Sync
0 likes · 11 min read
Redis Replication Deep Dive: PSYNC, Full & Partial Sync, Heartbeats and Async Writes
Architecture Digest
Architecture Digest
May 5, 2019 · Big Data

Kafka Architecture Overview: Topics, Partitions, Producers, Consumers, Replication, Leader Election, Offsets, Rebalance, Delivery Semantics, and Transactions

This article provides a comprehensive overview of Kafka's architecture, covering topics, partitions, producer and consumer workflows, replication and leader election, offset management, consumer group coordination, rebalance processes, delivery semantics (at‑most‑once, at‑least‑once, exactly‑once), transactional messaging, and underlying file and configuration details.

Distributed MessagingExactly-onceTransactional Messaging
0 likes · 16 min read
Kafka Architecture Overview: Topics, Partitions, Producers, Consumers, Replication, Leader Election, Offsets, Rebalance, Delivery Semantics, and Transactions
Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 15, 2019 · Databases

Understanding and Solving MySQL Slave Lag: Causes, Scenarios, and Optimizations

This article analyzes common MySQL slave‑lag scenarios—including missing indexes, large master transactions, high write rates, and MyISAM backups—explains their risks, and provides practical solutions such as index tuning, hardware upgrades, configuration changes, and enabling parallel replication to improve replication performance.

Slave Lagmysqlparallel-replication
0 likes · 13 min read
Understanding and Solving MySQL Slave Lag: Causes, Scenarios, and Optimizations
Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 11, 2019 · Databases

MySQL Replication server_id and server_uuid: Pitfalls, Causes of Data Loss, and Best‑Practice Recommendations

This article explains how duplicate MySQL server_id or server_uuid values in replication topologies can cause data loss during high‑availability failover, illustrates the underlying mechanisms with diagrams, and provides practical configuration recommendations to avoid these issues.

Data lossHigh Availabilitymysql
0 likes · 6 min read
MySQL Replication server_id and server_uuid: Pitfalls, Causes of Data Loss, and Best‑Practice Recommendations
Tencent Cloud Developer
Tencent Cloud Developer
Apr 4, 2019 · Cloud Native

Design and Optimization of CynosDB for PostgreSQL: One‑Primary Multi‑Read Architecture

The article details CynosDB’s cloud‑native PostgreSQL design—using compute‑storage separation, log sinking with asynchronous replay, and multi‑version reads—to enable a one‑primary multi‑read architecture that delivers elastic scaling, reduced I/O, stateless instances, and rapid failover and efficient resource utilization through parallel log‑based recovery.

Cloud NativeCynosDBDatabase Architecture
0 likes · 15 min read
Design and Optimization of CynosDB for PostgreSQL: One‑Primary Multi‑Read Architecture
Youzan Coder
Youzan Coder
Mar 27, 2019 · Databases

MySQL Slave Crash-Safe Feature Analysis

The article examines MySQL 5.6’s crash‑safe slave replication, explaining how earlier versions’ unsafe relay‑log handling could corrupt position data, describing the atomic update of mysql.slave_relay_log_info via table‑based relay‑log info and transaction coordination, and covering configuration options, recovery behavior, GTID implications, performance trade‑offs, and implementation guidance.

BinlogCrash SafeGTID
0 likes · 9 min read
MySQL Slave Crash-Safe Feature Analysis
AntTech
AntTech
Mar 12, 2019 · Databases

Evolution and Architecture of OceanBase Distributed Database

OceanBase, a fully proprietary distributed NewSQL database, has evolved over eight years to support high‑availability, strong consistency via Paxos, flexible replica management, OBProxy routing, LSM‑Tree storage, and migration tools, enabling seamless scaling, disaster recovery, and Oracle compatibility for large‑scale financial services.

High AvailabilityPaxosdistributed database
0 likes · 15 min read
Evolution and Architecture of OceanBase Distributed Database
JD Tech
JD Tech
Feb 21, 2019 · Databases

Analysis of MySQL Master‑Slave Replication Delay and Mitigation Strategies

The article recounts a pre‑promotion MySQL replication incident at JD.com, explains the master‑slave architecture and thread roles, identifies slow‑SQL and missing indexes as root causes of replication lag, and proposes practical measures to reduce latency and improve system stability.

DatabasesIndexingLatency
0 likes · 6 min read
Analysis of MySQL Master‑Slave Replication Delay and Mitigation Strategies
dbaplus Community
dbaplus Community
Feb 18, 2019 · Databases

How Do Fault‑Tolerant Transactions Work? Exploring Raft, KV Engines, and Concurrency Control

This article examines multiple fault‑tolerant transaction designs—RSM‑based KV, RSM‑based transactions, shared‑storage approaches, high‑availability KV layers, and single‑node engine extensions—comparing their replication strategies, lock handling, and performance trade‑offs while raising open questions about ordering and consistency.

KV storeRaftdistributed transactions
0 likes · 15 min read
How Do Fault‑Tolerant Transactions Work? Exploring Raft, KV Engines, and Concurrency Control
dbaplus Community
dbaplus Community
Dec 17, 2018 · Databases

Exploring MongoDB 4.0 Multi-Document ACID Transactions vs MySQL

MongoDB 4.0 introduces multi‑document ACID transactions with snapshot isolation, supporting replica sets and WiredTiger, and this article explains ACID concepts, outlines limitations, demonstrates session commands, and compares transaction behavior—including conflict detection, repeatable reads, and phantom reads—to MySQL’s implementation.

ACID TransactionsMongoDBMySQL Comparison
0 likes · 10 min read
Exploring MongoDB 4.0 Multi-Document ACID Transactions vs MySQL
Efficient Ops
Efficient Ops
Dec 16, 2018 · Databases

Understanding Redis Data Structures, Persistence, Transactions, and Replication

This article explains Redis's core data types—String, Hash, List, Set, and Sorted Set—its internal object model, persistence options (RDB and AOF) with their pros and cons, transaction characteristics, master‑slave replication mechanisms, and common caching scenarios and design considerations.

CachingData StructuresPersistence
0 likes · 10 min read
Understanding Redis Data Structures, Persistence, Transactions, and Replication
MaGe Linux Operations
MaGe Linux Operations
Dec 15, 2018 · Databases

Mastering Redis: Core Data Structures, Commands, and Performance Tuning

This comprehensive guide explains Redis fundamentals, its rich data structures and common commands, then dives into performance optimization, replication, and clustering, offering practical examples and best‑practice recommendations for building reliable, high‑performance Redis deployments.

CommandsData StructuresPerformance Tuning
0 likes · 32 min read
Mastering Redis: Core Data Structures, Commands, and Performance Tuning
Tencent Cloud Developer
Tencent Cloud Developer
Nov 6, 2018 · Databases

Design and Implementation of High‑Availability MySQL

The talk by Tencent’s senior MySQL engineer explains high‑availability concepts—99.95% uptime, RPO/RTO metrics, backup methods, and replication modes—while comparing single‑node, shared‑storage, and share‑nothing architectures, detailing failover tools (Keepalived, MMM, MHA), cluster solutions (PXC, MGC, Group Replication) and NewSQL examples such as Aurora, PolarDB and CynosDB.

Database ArchitectureHigh AvailabilityRPO
0 likes · 15 min read
Design and Implementation of High‑Availability MySQL
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Nov 1, 2018 · Databases

How to Set Up MySQL Master‑Slave Replication

This guide explains the complete process of configuring MySQL master‑slave replication on two CentOS machines, covering prerequisite setup, enabling binary logging, creating a replication user, capturing binlog coordinates, configuring the slave, and verifying successful synchronization.

CentOSDatabase ConfigurationMaster‑Slave
0 likes · 5 min read
How to Set Up MySQL Master‑Slave Replication
ITPUB
ITPUB
Sep 13, 2018 · Databases

Why Redis’s Master‑Slave Terminology Sparks Debate and What Changes Are Planned

The Redis community is urging a rename of the master‑slave replication terminology due to social concerns, but the project's lead highlights significant compatibility costs, outlining short‑term compromises and long‑term redesigns while balancing technical feasibility and community expectations.

RedisTerminologycompatibility
0 likes · 4 min read
Why Redis’s Master‑Slave Terminology Sparks Debate and What Changes Are Planned
ITPUB
ITPUB
Sep 12, 2018 · Databases

MySQL vs PostgreSQL: In‑Depth Feature Comparison and Choosing the Right Database

This article compares MySQL and PostgreSQL across open‑source licensing, ACID compliance, SQL standard support, replication modes, concurrency control, performance characteristics, high‑availability solutions, external data source integration, and storage models, helping readers decide which database best fits their workloads.

Database ComparisonPostgreSQLmysql
0 likes · 12 min read
MySQL vs PostgreSQL: In‑Depth Feature Comparison and Choosing the Right Database
ITPUB
ITPUB
Sep 8, 2018 · Databases

Why Uber Switched from Postgres to MySQL: Scaling Lessons from a Real‑World Migration

Uber’s engineering team explains how Postgres’s immutable rows, write‑ahead logging, and replication design caused write amplification, upgrade pain, and data‑corruption risks, leading them to adopt a MySQL‑based Schemaless sharding layer that offers better buffering, connection handling, and replication semantics for massive scale.

PostgreSQLUberWrite Amplification
0 likes · 23 min read
Why Uber Switched from Postgres to MySQL: Scaling Lessons from a Real‑World Migration
Architects' Tech Alliance
Architects' Tech Alliance
Sep 5, 2018 · Fundamentals

Red Hat Ceph Storage Architecture Overview and Key Components

This article provides a comprehensive English translation of the Red Hat Ceph Storage Architecture Guide, covering Ceph's distributed object storage concepts, cluster architecture, storage pools, CRUSH algorithm, replication and erasure‑coding I/O, internal operations, high‑availability mechanisms, client interfaces, and encryption considerations for cloud environments.

CRUSHCephDistributed storage
0 likes · 40 min read
Red Hat Ceph Storage Architecture Overview and Key Components
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 21, 2018 · Databases

Mastering MySQL: Keys, Transactions, Indexes, Joins, and Optimization Essentials

This article explains fundamental MySQL concepts including primary, candidate, super and foreign keys, transaction ACID properties, view creation, differences among DROP, DELETE and TRUNCATE, index structures and types, join variations, normalization forms, optimization techniques, replication mechanisms, engine distinctions, and logging formats.

IndexesSQLdatabase
0 likes · 29 min read
Mastering MySQL: Keys, Transactions, Indexes, Joins, and Optimization Essentials
dbaplus Community
dbaplus Community
Aug 19, 2018 · Databases

Redis Deployment Options: Pros & Cons of Single, Replication, Sentinel, Cluster, and Custom Solutions

This article examines five common Redis deployment patterns—single instance, master‑slave replication, Sentinel, Cluster, and custom high‑availability solutions—detailing their architectures, advantages, drawbacks, and practical configuration tips to help engineers choose the most suitable setup for their workloads.

High AvailabilityRedisSentinel
0 likes · 12 min read
Redis Deployment Options: Pros & Cons of Single, Replication, Sentinel, Cluster, and Custom Solutions
AntTech
AntTech
Jul 31, 2018 · Databases

High Availability and Disaster Recovery Strategies for OceanBase Distributed Database

This article reviews traditional database high‑availability techniques, explains the advantages of distributed multi‑replica consistency (Paxos/Raft) used by OceanBase, and compares various deployment topologies—from single‑site three‑replica to multi‑city five‑replica designs—highlighting their trade‑offs and best‑practice recommendations.

Disaster RecoveryHigh AvailabilityOceanBase
0 likes · 23 min read
High Availability and Disaster Recovery Strategies for OceanBase Distributed Database
Efficient Ops
Efficient Ops
Jul 18, 2018 · Databases

Mastering Redis: Advanced Types, Replication, Persistence, and Real-World Design

This article explores Redis’s advanced features—including data types, master‑slave, sentinel, and cluster architectures, transaction handling, RDB/AOF persistence, pub/sub messaging, and a practical e‑commerce search case study—providing design insights and best‑practice configurations for high‑availability and performance.

PersistencePub-SubRedis
0 likes · 10 min read
Mastering Redis: Advanced Types, Replication, Persistence, and Real-World Design
Ctrip Technology
Ctrip Technology
Jul 10, 2018 · Databases

Designing Real‑Time Sharding Index and Replication with Elasticsearch for High‑Performance Order Queries

This article describes how Ctrip's hotel R&D team tackled growing order‑volume challenges by sharding the database, building a real‑time Elasticsearch index, implementing a custom replication pipeline, and applying various write‑ and read‑optimizations to achieve low latency and stable performance.

ElasticsearchPerformance OptimizationSQL Server
0 likes · 10 min read
Designing Real‑Time Sharding Index and Replication with Elasticsearch for High‑Performance Order Queries
ITPUB
ITPUB
Jun 17, 2018 · Databases

MySQL 8 vs PostgreSQL 10: Which Database Wins the Showdown?

An in‑depth comparison of MySQL 8 and PostgreSQL 10 examines feature parity, storage architecture, indexing, memory usage, replication, update overhead, and garbage collection, highlighting how recent improvements narrow the gap and offering guidance on choosing the right database for specific workloads.

Database ComparisonPostgreSQLStorage Engine
0 likes · 12 min read
MySQL 8 vs PostgreSQL 10: Which Database Wins the Showdown?
Tencent Database Technology
Tencent Database Technology
May 15, 2018 · Databases

Improving MySQL Asynchronous Replication by Aligning Read_Master_Log_Pos with Exec_Master_Log_Pos

This article analyzes a MySQL master‑crash scenario where mismatched Read_Master_Log_Pos and Exec_Master_Log_Pos prevent HA failover, explains binlog event structures, and proposes updating Read_Master_Log_Pos only after a full transaction is received to ensure reliable asynchronous replication.

AsynchronousBinlogExec_Master_Log_Pos
0 likes · 9 min read
Improving MySQL Asynchronous Replication by Aligning Read_Master_Log_Pos with Exec_Master_Log_Pos
Ops Development Stories
Ops Development Stories
May 11, 2018 · Databases

How to Set Up MySQL Master‑Slave Replication with Docker

This guide walks through configuring MySQL master‑slave replication inside Docker containers, covering environment setup, container creation, MySQL configuration changes, replication user creation, synchronization commands, troubleshooting tips, and verification of data replication between the master and slave instances.

DockerMaster‑Slavedatabase
0 likes · 4 min read
How to Set Up MySQL Master‑Slave Replication with Docker
dbaplus Community
dbaplus Community
May 6, 2018 · Databases

NewSQL Explained: Storage Engines, Sharding, and Distributed Transactions

This article examines the core technologies behind NewSQL databases for OLTP workloads, contrasting them with NoSQL and traditional relational systems by exploring storage engines such as B‑Tree and LSM‑Tree, sharding strategies, replication models, and distributed transaction mechanisms like two‑phase commit.

NewSQLShardingStorage Engines
0 likes · 20 min read
NewSQL Explained: Storage Engines, Sharding, and Distributed Transactions
ITFLY8 Architecture Home
ITFLY8 Architecture Home
May 5, 2018 · Databases

How to Build a MySQL Master‑Slave Cluster: Step‑by‑Step Guide

This article walks readers through setting up MySQL replication, from the basic master‑slave model to a one‑master‑multiple‑slave cluster, covering configuration files, essential parameters, verification commands, performance tips, and common pitfalls for production deployments.

High AvailabilityMaster‑Slavecluster
0 likes · 15 min read
How to Build a MySQL Master‑Slave Cluster: Step‑by‑Step Guide
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Apr 24, 2018 · Databases

How Dynamo Achieves High‑Availability in Distributed Key‑Value Stores

This article explains Dynamo, the decentralized key‑value storage system, covering its design goals, consistent‑hashing partitioning with virtual nodes, replication strategies, quorum‑based consistency, conflict resolution with vector clocks, hinted handoff, Merkle‑tree synchronization, and gossip‑based failure detection.

Consistent HashingDistributed storageDynamo
0 likes · 9 min read
How Dynamo Achieves High‑Availability in Distributed Key‑Value Stores
Architecture Digest
Architecture Digest
Apr 10, 2018 · Fundamentals

Reliability, Scalability, and Maintainability in Distributed System Design

This article examines core distributed system design principles—reliability, scalability, and maintainability—explaining how techniques such as replication, partitioning, consensus algorithms, and transactions address hardware, software, and human failures, and discusses vertical and horizontal scaling strategies to achieve robust, extensible, and maintainable architectures.

Consensusdistributed systemsmaintainability
0 likes · 8 min read
Reliability, Scalability, and Maintainability in Distributed System Design
ITPUB
ITPUB
Mar 30, 2018 · Databases

Step‑by‑Step Oracle Multi‑Master Replication Setup with Full SQL Scripts

This guide walks through configuring Oracle multi‑master data replication, covering site creation, group objects, propagator and receiver setup, purge scheduling, database link creation, replication group definition, table registration, conflict handling, and finally resuming replication, all illustrated with complete SQL code examples.

OracleSQLdatabase
0 likes · 7 min read
Step‑by‑Step Oracle Multi‑Master Replication Setup with Full SQL Scripts
Architecture Digest
Architecture Digest
Feb 15, 2018 · Databases

Design and Architecture of Zeppelin Distributed Block Storage System

This article presents an in‑depth overview of Zeppelin, a high‑availability, high‑performance block storage service, covering its motivation, online vs offline storage distinctions, data distribution strategies, centralized meta‑server design, replication policies, RocksDB‑based storage engine, Raft‑based consistency protocol, threading model, client request flow, and fault‑handling mechanisms.

Distributed storageHash PartitioningRaft
0 likes · 19 min read
Design and Architecture of Zeppelin Distributed Block Storage System
ITPUB
ITPUB
Feb 2, 2018 · Databases

Mastering Redis: Essential Commands and Practical Examples

This guide introduces Redis as an advanced key‑value store, explains how to start the server and use its CLI tools, and provides detailed command references and demos for strings, lists, sets, sorted sets, hashes, transactions, replication, and pub/sub.

CLIDatabase CommandsKey-Value Store
0 likes · 15 min read
Mastering Redis: Essential Commands and Practical Examples
dbaplus Community
dbaplus Community
Jan 31, 2018 · Databases

How to Systematically Diagnose and Fix MySQL Master‑Slave Replication Lag

This article walks through a real‑world case of MySQL 5.7 replication delay after switching to TokuDB, presenting a step‑by‑step methodology that examines network, hardware, large transactions, locks, configuration parameters, and multi‑threaded replication to identify and resolve the root cause.

DBALagParallelReplication
0 likes · 12 min read
How to Systematically Diagnose and Fix MySQL Master‑Slave Replication Lag
MaGe Linux Operations
MaGe Linux Operations
Jan 25, 2018 · Databases

Master Redis: Data Structures, Commands, and Performance Tuning Explained

This comprehensive guide introduces Redis fundamentals, covering its core data structures and essential commands, then delves into performance optimization, high‑availability setups with replication and Sentinel, and scaling strategies using Redis Cluster, providing practical examples and best‑practice recommendations for robust in‑memory data management.

ClusteringData StructuresPerformance Tuning
0 likes · 29 min read
Master Redis: Data Structures, Commands, and Performance Tuning Explained
UCloud Tech
UCloud Tech
Jan 12, 2018 · Databases

How to Diagnose and Resolve MySQL Replication Errors in High‑Availability Environments

This article explains step‑by‑step how to collect replication status, examine MySQL error logs and binary logs, understand common replication failures such as duplicate databases or missing binlog files, and apply GTID and configuration best practices to troubleshoot and fix MySQL replication problems in high‑availability setups.

Error TroubleshootingGTIDdatabase
0 likes · 25 min read
How to Diagnose and Resolve MySQL Replication Errors in High‑Availability Environments
dbaplus Community
dbaplus Community
Dec 18, 2017 · Databases

How Aurora Redefines Cloud‑Native Relational Databases: Architecture, Benefits, and Limits

This article interprets the 2017 SIGMOD paper on Amazon Aurora, explaining its cloud‑native architecture, key advantages such as self‑healing storage and reduced network I/O, the challenges it introduces, a comparison with traditional databases and TiDB, and insights into deployment, replication, and recovery mechanisms.

Amazon AuroraDatabase ArchitectureNewSQL
0 likes · 26 min read
How Aurora Redefines Cloud‑Native Relational Databases: Architecture, Benefits, and Limits
Qunar Tech Salon
Qunar Tech Salon
Nov 16, 2017 · Databases

Why Upgrade PostgreSQL and How to Perform a Major Version Upgrade Using PGQ

This article explains the importance of upgrading PostgreSQL to benefit from new features and security fixes, compares traditional upgrade methods, introduces the PGQ replication system, and provides a detailed step‑by‑step guide for performing a major version upgrade with minimal downtime.

ConfigurationDatabase UpgradePGQ
0 likes · 11 min read
Why Upgrade PostgreSQL and How to Perform a Major Version Upgrade Using PGQ