How DBSyncer Enables Seamless Multi-Database Synchronization

DBSyncer is an open‑source data‑synchronization middleware that supports MySQL, Oracle, SqlServer, PostgreSQL, Elasticsearch, Kafka, File, SQL and other scenarios.

It allows custom plug‑in development, provides real‑time monitoring of full and incremental sync, and offers performance alerts.

Features

Combination‑driven : custom source‑to‑target mappings, relational‑to‑non‑relational combos.

Real‑time monitoring : tracks sync status, results, logs.

Plug‑in development : custom transformation logic.

Design

Architecture diagram:

Application Scenarios

Supported connectors include MySQL, Oracle, SqlServer, PostgreSQL, Elasticsearch (ES), Kafka, File and generic SQL, each with specific source‑target compatibility and version requirements.

Usage Tutorial

Start the agent and database services.

Prepare a test account (e.g., test).

Assign the sysadmin role.

Grant the required database permissions.

PostgreSQL

Uses logical replication via pgoutput and test_decoding plugins to parse WAL logs.

1. Modify postgresql.conf and restart the service: wal_level=logical 2. Grant LOGIN and REPLICATION privileges to the account.

File

Monitors file modification time to detect changed files and reads new data using file offsets.

Elasticsearch

Periodically fetch incremental data.

Account must have access permission.

Logs

It is recommended to use binlog (or equivalent) for MySQL, SqlServer, and PostgreSQL.

Scheduling

Assumes a source table data format (illustrated in accompanying diagrams).

Preview

Driver management, driver details, field‑mapping configuration, monitoring, and plug‑in upload are demonstrated in the following screenshots.

Open‑Source Repository

https://gitee.com/ghi/dbsyncer