database synchronization

Aikesheng Open Source Community

Aug 22, 2024 · Databases

ActionOMS: Intelligent Performance Diagnosis for OceanBase Data Migration

The article introduces ActionOMS, a customized version of OceanBase Migration Service that adds automated performance and fault diagnosis, explains its architecture, showcases a real‑world case of Oracle‑to‑OceanBase synchronization, and demonstrates how the tool improves migration throughput and reduces latency.

ActionOMSOceanBasePerformance Diagnosis

0 likes · 11 min read

ActionOMS: Intelligent Performance Diagnosis for OceanBase Data Migration

vivo Internet Technology

Jul 3, 2024 · Databases

End-to-End Data Consistency Verification for MySQL in DTS

The Vivo Internet Storage R&D team's article describes an end‑to‑end MySQL data‑consistency verification tool for DTS that uses fixed‑size chunking and CRC32/MD5 fingerprint aggregation to quickly compare source and target tables, pinpoint mismatched rows, and enable automated or manual correction while minimizing impact on replication.

CRC32ChunkingDTS

0 likes · 13 min read

End-to-End Data Consistency Verification for MySQL in DTS

Sanyou's Java Diary

Jun 17, 2024 · Backend Development

How to Keep Cache and Database Consistent? Proven Strategies and Common Pitfalls

This article explains why cache‑DB consistency is a long‑standing challenge, compares naive full‑load and delete‑cache approaches, analyzes concurrency and failure scenarios, and presents reliable solutions such as updating the database first followed by cache deletion using message queues or binlog subscriptions.

Cache ConsistencyMessage QueueRedis

0 likes · 19 min read

How to Keep Cache and Database Consistent? Proven Strategies and Common Pitfalls

Architecture & Thinking

Aug 30, 2023 · Backend Development

How to Ensure Cache‑Database Consistency: Strategies, Pitfalls, and Best Practices

This article examines data consistency between Redis cache and MySQL database, explains common cache execution strategies such as Cache‑Aside, Read‑Through, Write‑Through, and Write‑Behind, analyzes four update sequences for consistency risks, and proposes solutions like delayed double‑delete, transactional guarantees, retry mechanisms, and binlog‑based cache invalidation.

Cache ConsistencyRediscache aside

0 likes · 18 min read

How to Ensure Cache‑Database Consistency: Strategies, Pitfalls, and Best Practices

Aikesheng Open Source Community

Mar 21, 2022 · Databases

MySQL‑to‑DBLE Data Synchronization Using DTLE: Full and GTID‑Based Incremental Sync Guide

This article provides a step‑by‑step tutorial on deploying a DBLE cluster, configuring sharding.xml, db.xml and user.xml, creating test tables, installing DTLE, performing full MySQL‑to‑DBLE data migration, then switching to GTID‑based incremental synchronization with detailed troubleshooting tips and best‑practice recommendations.

DBLEDTLEGTID

0 likes · 15 min read

MySQL‑to‑DBLE Data Synchronization Using DTLE: Full and GTID‑Based Incremental Sync Guide

360 Smart Cloud

Apr 1, 2021 · Databases

Using TiDB Data Migration (DM) for MySQL‑to‑TiDB Sync: Architecture, Features, Tuning and Troubleshooting

This article shares practical experience with TiDB Data Migration (DM), covering its background, architecture, key features, online DDL support, common error handling such as duplicate‑key issues, large‑scale import tuning, configuration limits, and cleanup recommendations for reliable MySQL‑to‑TiDB synchronization.

DMMySQLPerformance Tuning

0 likes · 16 min read

Using TiDB Data Migration (DM) for MySQL‑to‑TiDB Sync: Architecture, Features, Tuning and Troubleshooting

Top Architect

Sep 25, 2020 · Databases

Introduction to ClickHouse: Installation, MySQL Migration, Performance Testing, and Best Practices

This article introduces ClickHouse, a column‑store OLAP database, explains its advantages over row‑store systems, guides installation on macOS, details migration strategies from MySQL, presents performance benchmarks showing 200‑fold speedups, and discusses synchronization methods, pitfalls, and practical tips.

ClickHouseColumnar DatabaseMySQL

0 likes · 6 min read

Introduction to ClickHouse: Installation, MySQL Migration, Performance Testing, and Best Practices

Qunar Tech Salon

Mar 29, 2018 · Databases

Automating Test Environment Data Synchronization with Alibaba DataX and QDataManager

This article describes how a testing team replaced manual SQL updates with an automated solution using Alibaba's open‑source DataX framework and a custom QDataManager system to synchronize baseline database tables across multiple test environments, improving efficiency and reliability.

Configuration ManagementDataXTest Environment

0 likes · 6 min read

Automating Test Environment Data Synchronization with Alibaba DataX and QDataManager

Alibaba Cloud Infrastructure

Dec 29, 2015 · Databases

The Evolution and Architecture of Alibaba's Data Replication Center (DRC)

This article chronicles the development, design decisions, and technical achievements of Alibaba's Data Replication Center (DRC), a real‑time heterogeneous database synchronization platform that has become a core infrastructure for multi‑active data centers, large‑scale e‑commerce, and cloud services.

AlibabaDRCdata replication

0 likes · 19 min read

The Evolution and Architecture of Alibaba's Data Replication Center (DRC)