Tagged articles
7 articles
Page 1 of 1
Top Architect
Top Architect
Aug 6, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article explains various methods for synchronizing MySQL data to Elasticsearch, including synchronous and asynchronous double‑write, Logstash pipelines, binlog‑based real‑time sync, Canal, and Alibaba Cloud DTS, comparing their advantages, disadvantages, and suitable scenarios.

BinlogCanalDTS
0 likes · 16 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
dbaplus Community
dbaplus Community
Jun 25, 2024 · Databases

How Didi Scales Elasticsearch: Architecture, Performance Tuning, and Cost Optimization

This article details Didi’s use of Elasticsearch 7.6, covering its architecture on physical machines, gateway and control layers, user console features, deployment models, data synchronization strategies, engine iterations such as fine‑grained tiered protection, multi‑active replication, JDK 17/ZGC performance upgrades, cost reductions, multi‑tenant isolation, security enhancements, and future migration to ES 8.13.

DataSyncElasticsearchMultitenant
0 likes · 17 min read
How Didi Scales Elasticsearch: Architecture, Performance Tuning, and Cost Optimization
Su San Talks Tech
Su San Talks Tech
Mar 26, 2023 · Backend Development

Unlock Real-Time MySQL Data Sync with Alibaba Canal: A Hands‑On Guide

This article introduces Alibaba's open‑source Canal middleware, explains its architecture and high‑availability design, walks through MySQL binlog configuration, Canal setup, and provides a complete Java client example for real‑time data synchronization, cache refresh, and task dispatch scenarios.

BackendBinlogCanal
0 likes · 18 min read
Unlock Real-Time MySQL Data Sync with Alibaba Canal: A Hands‑On Guide
dbaplus Community
dbaplus Community
Jun 9, 2021 · Databases

How to Enable Multi‑Data‑Center Active‑Active Redis with Bidirectional Sync and rLog

This article explains how a company extended native Redis to support bidirectional synchronization across multiple data‑center sites, addressing issues such as lack of master‑master replication, data loops, idempotency, write conflicts, and providing a custom rLog design for efficient breakpoint‑resume and performance.

Active-ActiveDataSyncReplication
0 likes · 16 min read
How to Enable Multi‑Data‑Center Active‑Active Redis with Bidirectional Sync and rLog
Top Architect
Top Architect
Aug 14, 2020 · Big Data

Billion‑Row MySQL to HBase Synchronization: Load Data, Kafka‑Thrift, and Flink Solutions

This article presents a comprehensive guide for transferring massive MySQL datasets to HBase, covering environment setup on Ubuntu, three synchronization methods—MySQL LOAD DATA, a Kafka‑Thrift pipeline using Maxwell, and real‑time Flink processing—along with performance comparisons and practical tips for Hadoop, HBase, Kafka, Zookeeper, Phoenix, and related tools.

DataSyncFlinkHBase
0 likes · 24 min read
Billion‑Row MySQL to HBase Synchronization: Load Data, Kafka‑Thrift, and Flink Solutions