Boost Multi-Cloud Redis Migration with RedisSyncer

Project Background

With over a decade of rapid cloud computing development, multi‑cloud adoption is accelerating, making data migration between clouds commonplace. Cache Redis has become the standard for speeding data access in high‑concurrency scenarios.

Large systems heavily rely on caching, leading to slow data access, high database pressure, and risks of cache breakdown and avalanche when cache data is insufficient. Redis reduces database load and improves access speed.

Solution Overview

RedisSyncer, a JD Cloud product, enables data synchronization between Redis instances across versions and heterogeneous clusters. It emulates Redis replication, converts commands when RDB versions differ, and ensures idempotent handling of non‑idempotent commands like INCR/DECR, supporting cloud‑on‑premise, native and managed scenarios.

Project Background (Financial Institution)

A financial institution needed to migrate its native Redis cluster to a self‑developed upRedis cluster while ensuring smooth business transition and data security compliance.

Project Challenges

Version differences

Downgrade migrations

Inconsistent cluster node counts

Rapid rollback requirements

Final Customer Benefits

Complete 256 GB+ data migration within 15 minutes

System cut‑over completed in 20 minutes

Migration process described as “silky smooth”

RedisSyncer Hands‑On

Required environment: Docker, docker‑compose.

git clone https://github.com/TraceNature/redissyncer.git
cd redissyncer
docker-compose up -d

Download and configure the CLI client:

wget https://github.com/TraceNature/redissyncercli/releases/download/v0.1.0/redissyncer-cli-0.1.0-linux-amd64.tar.gz

Example configuration (config.yaml):

syncserver: http://10.0.1.20:8080
token: 379F5E2BD55A4608B6A7557F0583CFC5

Task definition (JSON):

{
  "sourcePassword": "redistest0102",
  "sourceRedisAddress": "10.0.1.101:6379",
  "targetRedisAddress": "10.0.1.102:6379",
  "targetPassword": "redistest0102",
  "taskName": "testtask",
  "targetRedisVersion": 4.0,
  "autostart": true,
  "afresh": true,
  "batchSize": 100
}

Start the task and verify data:

redissyncer-cli -i
redissyncer-cli > task create source ./task.json
# data validation using rediscompare
wget https://github.com/TraceNature/rediscompare/releases/download/v1.0.0/rediscompare-1.0.0-linux-amd64.tar.gz
rediscompare compare single2single --saddr "10.0.1.101:6479" --spassword "redistest0102" --taddr "10.0.1.102:6479" --tpassword "redistest0102" --comparetimes 3

GitHub repository: https://github.com/TraceNature/redissyncer-server