How DBSyncer Simplifies Multi‑Source Data Synchronization Across Databases

The article introduces the open‑source DBSyncer middleware that enables full‑stack data synchronization across MySQL, Oracle, SQL Server, PostgreSQL, Elasticsearch and Kafka, outlines its visual composition, full‑ and incremental sync, real‑time monitoring, and provides step‑by‑step installation instructions while also mentioning related Java learning projects.

Java Architect Handbook
Java Architect Handbook
Java Architect Handbook
How DBSyncer Simplifies Multi‑Source Data Synchronization Across Databases

Introduction

In large‑scale data and multi‑cloud environments, enterprise data often resides in heterogeneous databases such as Oracle, MySQL, SQL Server, PostgreSQL, and Elasticsearch, creating data silos. Traditional ETL tools are complex and commercial solutions are expensive, while building a custom synchronization component is time‑consuming and fragile. DBSyncer (referred to as dbs ) is an open‑source middleware that provides unified data‑synchronization capabilities across these sources.

Core Capabilities

Supported data sources

MySQL 5.7.19+

Oracle 10g+

SQL Server 2008+

PostgreSQL 9.5.25+

Elasticsearch 6.x+

Kafka (in development) and file formats (.txt, .unl)

Composition‑driven architecture

Relational → Relational (e.g., MySQL → Oracle)

Relational → Non‑relational (e.g., SQL Server → Elasticsearch)

Non‑relational → Relational (e.g., File → PostgreSQL)

Full‑plus‑incremental synchronization

Full sync for initial migration or periodic whole‑database copy.

Incremental sync based on log capture (e.g., MySQL Binlog, SQL Server CDC) for real‑time data changes.

Real‑time monitoring and alerting

Visual dashboard shows task status, data flow, and latency statistics.

Performance warning mechanisms ensure synchronization stability.

Installation Guide

Recommended machine configuration : 8 GB RAM, 4 CPU cores, 60 GB disk (SSD preferred).

1. Install JDK 8u202

2. Download community edition package

Download URL: https://gitee.com/ghi/dbsyncer/releases

3. Start the service

Unzip the package and run the startup script:

Windows: bin/startup.bat Linux/macOS: bin/startup.sh Open a browser and visit http://localhost:18686. Default credentials are admin/admin.

Changing configuration storage : By default DBSyncer stores configuration on disk. To switch to MySQL storage, edit conf/application.properties and restart the service.

Open‑Source Repository

Project source code: https://gitee.com/ghi/dbsyncer

open-sourceData SynchronizationETLDatabase IntegrationInstallation GuideDBSyncer
Java Architect Handbook
Written by

Java Architect Handbook

Focused on Java interview questions and practical article sharing, covering algorithms, databases, Spring Boot, microservices, high concurrency, JVM, Docker containers, and ELK-related knowledge. Looking forward to progressing together with you.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.