BestHub
Sign in
Tagged articles
57 articles
Page 1 of 1
IT Services Circle
IT Services Circle
Oct 25, 2024 · Databases

Database Management Challenges in the Cloud Era and How Apache ShardingSphere Addresses Them

The article outlines the growing difficulties of managing diverse databases in cloud-native environments, introduces Apache ShardingSphere as a comprehensive open‑source solution with three core capabilities—connectivity, enhancement, and pluggability—and guides readers through a three‑step learning path from fundamentals to deployment and testing.

Cloud NativeDatabase ManagementDatabase Middleware
0 likes · 9 min read
Database Management Challenges in the Cloud Era and How Apache ShardingSphere Addresses Them
Architecture & Thinking
Architecture & Thinking
Aug 1, 2024 · Databases

Choosing the Right Sharding Middleware: ShardingSphere vs MyCAT vs Vitess

This article explains why sharding is needed for high‑traffic databases, outlines vertical and horizontal partitioning, and compares three popular sharding middleware—ShardingSphere, MyCAT, and Vitess—detailing their architectures, advantages, and ideal use cases to help engineers select the right solution.

Database MiddlewareScalabilitydistributed architecture
0 likes · 9 min read
Choosing the Right Sharding Middleware: ShardingSphere vs MyCAT vs Vitess
vivo Internet Technology
vivo Internet Technology
Mar 6, 2024 · Databases

Sharding-JDBC Source Code Analysis and Custom Development

The article dissects Sharding‑JDBC’s five core engines—parsing, routing, rewriting, execution, and merging—highlights production pain points, and details custom extensions such as skipping sharding for specific tables, forcing master routing, runtime configuration refresh, batch‑update handling, sharding‑condition deduplication, full‑route validation, and a simplified component wrapper to ease integration and improve performance.

Custom DevelopmentDatabase MiddlewareExecution Engine
0 likes · 55 min read
Sharding-JDBC Source Code Analysis and Custom Development
dbaplus Community
dbaplus Community
May 4, 2023 · Databases

How HuoLa La Built a Hybrid‑Cloud Database Middleware for Massive MySQL Scale

This article details HuoLa La's journey of designing, implementing, and evolving a hybrid‑cloud self‑built database middleware that unifies multi‑cloud environments, achieves up to 1024× MySQL horizontal scaling, and addresses challenges such as multi‑language stacks, high availability, SQL governance, and multi‑AZ deployment.

Cloud NativeDatabase MiddlewareMulti‑AZ
0 likes · 17 min read
How HuoLa La Built a Hybrid‑Cloud Database Middleware for Massive MySQL Scale
ITPUB
ITPUB
Nov 6, 2022 · Databases

Why Can’t You Read Your Recent Write? Understanding Master‑Slave Lag and Fixes in MySQL

The article explains why a recent write may be invisible when reading from a MySQL replica, analyzes the replication threads and latency causes, and presents practical solutions such as forcing master reads, lag detection, semi‑sync mode, and GTID‑based waiting, with examples from Sharding‑JDBC, MyCat and MaxScale.

Database MiddlewareGTIDMaster‑Slave
0 likes · 10 min read
Why Can’t You Read Your Recent Write? Understanding Master‑Slave Lag and Fixes in MySQL
Java Backend Technology
Java Backend Technology
Oct 13, 2022 · Databases

Choosing Between Driver‑Level and Proxy‑Level Database Middleware for Sharding

This article explains the different layers—encoding, framework, driver, proxy, and implementation—through which database sharding can be introduced, compares driver‑level and proxy‑level middleware, outlines their characteristics, common constraints, and provides a step‑by‑step process for planning, preparing, and executing a sharding project.

Database MiddlewareJavadriver layer
0 likes · 13 min read
Choosing Between Driver‑Level and Proxy‑Level Database Middleware for Sharding
Huolala Tech
Huolala Tech
Sep 8, 2022 · Databases

Why Build Your Own Database Middleware in the Multi‑Cloud Era?

The article explains why, contrary to common belief, the rise of multi‑cloud environments actually demands self‑built database middleware to ensure seamless adaptation, vendor neutrality, high availability, and cost‑effective scalability for growing enterprise workloads.

Database MiddlewareOperationsScalability
0 likes · 18 min read
Why Build Your Own Database Middleware in the Multi‑Cloud Era?
Aikesheng Open Source Community
Aikesheng Open Source Community
Jul 28, 2022 · Databases

Understanding Dble Startup Configuration Validation and Common Failure Cases (Version 3.22.01.0)

This article explains how Dble validates its configuration files during startup, lists the main configuration file types, and walks through typical startup failure examples—such as port conflicts, syntax errors, and backend MySQL connectivity issues—providing step‑by‑step troubleshooting guidance for new users.

ConfigurationDatabase Middlewaremysql
0 likes · 9 min read
Understanding Dble Startup Configuration Validation and Common Failure Cases (Version 3.22.01.0)
Aikesheng Open Source Community
Aikesheng Open Source Community
Jun 28, 2022 · Databases

Quick Guide to Enabling Read‑Write Splitting in Dble (v3.20.10+)

This article explains how to configure Dble's read‑write splitting feature by preparing MySQL master‑slave instances, defining dbGroup and rwSplitUser in XML configuration files, reloading the settings, and verifying that write statements go to the primary node while reads are load‑balanced across replicas.

ConfigurationDatabase Middlewareload balancing
0 likes · 6 min read
Quick Guide to Enabling Read‑Write Splitting in Dble (v3.20.10+)
DeWu Technology
DeWu Technology
Jun 22, 2022 · Databases

Rainbow Bridge: A ShardingSphere‑Based Database Middleware for Scalability and Reliability

To support the rapidly growing DeWu App, the team created Rainbow Bridge—a ShardingSphere‑based middleware that unifies horizontal sharding, read‑write separation, shadow‑DB routing, rate limiting, and active‑active traffic correction, while adding a graphical console, stability enhancements, fine‑grained observability, hybrid JDBC/Proxy switching, and ongoing open‑source contributions.

Database MiddlewarePerformance OptimizationShardingSphere
0 likes · 18 min read
Rainbow Bridge: A ShardingSphere‑Based Database Middleware for Scalability and Reliability
Aikesheng Open Source Community
Aikesheng Open Source Community
May 24, 2022 · Databases

Read SQL Routed to Master Despite rwSplitMode=3 Configuration

The article investigates why read queries are sent to the master node when Dble is configured with rwSplitMode=3, analyzes reproductions on standard replication and MySQL Group Replication, identifies heartbeat and replication status issues, and provides troubleshooting steps and recommendations.

Database MiddlewareGroup Replicationmysql
0 likes · 7 min read
Read SQL Routed to Master Despite rwSplitMode=3 Configuration
dbaplus Community
dbaplus Community
Mar 31, 2022 · Databases

Why Build Your Own Database Middleware in a Multi‑Cloud Era?

The article explains why, despite cloud services, enterprises still need to develop their own database middleware to ensure multi‑cloud compatibility, vendor neutrality, high availability, and scalable performance, detailing the challenges, design principles, core features, technical metrics, and operational benefits of such a solution.

Database MiddlewareOperationscloud infrastructure
0 likes · 20 min read
Why Build Your Own Database Middleware in a Multi‑Cloud Era?
Aikesheng Open Source Community
Aikesheng Open Source Community
Jan 6, 2022 · Databases

Dynamic Adjustment of DBLE Thread Pools Without Restart

This article explains how DBLE version 3.21.06.* enables runtime, non‑restart adjustments of various thread‑pool parameters such as processors and backendProcessors, describes the underlying reactor and JDK thread‑pool mechanisms, and provides practical guidance and precautions for safely scaling thread pools in production environments.

DBLEDatabase MiddlewareDynamic Scaling
0 likes · 11 min read
Dynamic Adjustment of DBLE Thread Pools Without Restart
Aikesheng Open Source Community
Aikesheng Open Source Community
Aug 13, 2021 · Databases

DBLE 3.21.06.0 Release Notes Overview

The article provides a comprehensive overview of DBLE version 3.21.06.0, detailing project background, eight new or refactored features, numerous bug fixes, incompatibility changes, LTS patch updates, and links to official resources and tutorials.

Bug FixesDBLEDatabase Middleware
0 likes · 7 min read
DBLE 3.21.06.0 Release Notes Overview
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Jul 6, 2021 · Databases

Inside Cobar’s SQL Parser: AST Structure, Traversal, and Real‑World Uses

This article explains how Cobar’s SQL parser converts SQL statements into an abstract syntax tree (AST), details the parser’s implementation options, demonstrates AST node definitions and visitor‑based traversal in Java, and explores practical applications such as sharding, feature extraction, and dangerous‑SQL interception.

ASTCobarDatabase Middleware
0 likes · 8 min read
Inside Cobar’s SQL Parser: AST Structure, Traversal, and Real‑World Uses
Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 20, 2021 · Databases

DBLE 3.21.02.0 Release Notes Overview

The DBLE 3.21.02.0 release introduces ten new or refactored features, fixes over ten bugs, adds general logging, batch load data mode, fine‑grained SQL statistics, and other enhancements, while also detailing LTS updates, project overview, download links, and community acknowledgments.

DBLEDatabase MiddlewareLOAD DATA
0 likes · 9 min read
DBLE 3.21.02.0 Release Notes Overview
JD Cloud Developers
JD Cloud Developers
Mar 5, 2021 · Databases

How Transparent Sharding Middleware Powers NewSQL: Core Functions Explained

This article explains the fundamentals of transparent sharding middleware in NewSQL systems, covering data partitioning strategies, read/write separation, the complete SQL processing pipeline, protocol adaptation for MySQL/PostgreSQL, distributed transaction models such as XA, Saga and TCC, and essential database governance and online scaling techniques.

Database GovernanceDatabase MiddlewareDistributed Transactions
0 likes · 28 min read
How Transparent Sharding Middleware Powers NewSQL: Core Functions Explained
Aikesheng Open Source Community
Aikesheng Open Source Community
Dec 3, 2020 · Databases

DBLE 3.20.10.0 Release Notes – New Features, Improvements, and Bug Fixes

The DBLE 3.20.10.0 release notes detail the open‑source distributed middleware's project overview, major enhancements such as management‑port metadata access and read/write splitting, a comprehensive list of new features, bug fixes, backward‑compatibility changes, and references to past versions and documentation.

Bug FixesDBLEDatabase Middleware
0 likes · 10 min read
DBLE 3.20.10.0 Release Notes – New Features, Improvements, and Bug Fixes
Aikesheng Open Source Community
Aikesheng Open Source Community
Jun 2, 2020 · Databases

Using Distributed Timestamp Global Sequence in Dble: Environment Setup and Verification

This article explains the distributed‑timestamp global sequence in Dble, detailing its 63‑bit ID structure, the required Zookeeper and configuration file settings, schema and server adjustments, and step‑by‑step commands to create a table, insert data, and verify that the generated IDs correctly encode instance, cluster, and timestamp information.

Database MiddlewareDistributed TimestampID generation
0 likes · 7 min read
Using Distributed Timestamp Global Sequence in Dble: Environment Setup and Verification
ITPUB
ITPUB
May 28, 2020 · Databases

How UPSQL Proxy Implements MySQL Streaming to Boost Performance

This article explains the MySQL communication protocol, result‑set structure, client library interfaces, and the difference between store‑result and streaming modes, then details how UPSQL Proxy 2.4.0 adopts streaming to reduce latency and memory usage in distributed database environments.

Database MiddlewareResultSetStreaming
0 likes · 6 min read
How UPSQL Proxy Implements MySQL Streaming to Boost Performance
Ctrip Technology
Ctrip Technology
May 28, 2020 · Databases

Design and Implementation of Ctrip's Data Replicate Center (DRC) for MySQL Multi‑Active Replication

The article describes Ctrip's Data Replicate Center (DRC), a MySQL middleware that enables real‑time bidirectional replication across data‑center clusters, detailing its architecture, low‑latency optimizations, consistency mechanisms, DDL handling, monitoring, and future high‑availability improvements.

DRCDatabase MiddlewareGTID
0 likes · 16 min read
Design and Implementation of Ctrip's Data Replicate Center (DRC) for MySQL Multi‑Active Replication
Aikesheng Open Source Community
Aikesheng Open Source Community
May 19, 2020 · Databases

DBLE 2.20.04.0 Release Notes and Detailed Analysis

The article presents a comprehensive overview of DBLE version 2.20.04.0, including project background, new features such as larger MySQL packet support and redesigned failover, a full list of enhancements, bug fixes, backward‑compatibility changes, and links to official documentation and source repositories.

DBLEDatabase MiddlewareFeature Updates
0 likes · 11 min read
DBLE 2.20.04.0 Release Notes and Detailed Analysis
Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 13, 2020 · Databases

How DBLE Implements MySQL View Functionality

This article explains how DBLE, a PaaS middleware, implements MySQL view capabilities by first describing MySQL view concepts and the MERGE and TEMPTABLE algorithms, then detailing DBLE's push‑down and non‑push‑down approaches, the criteria for each, and providing illustrative diagrams.

DBLEDatabase MiddlewareSQL
0 likes · 5 min read
How DBLE Implements MySQL View Functionality
Aikesheng Open Source Community
Aikesheng Open Source Community
Mar 12, 2020 · Databases

DBLE LOAD DATA: Design Overview and Source Code Walkthrough

This article explains how DBLE implements the MySQL LOAD DATA large‑scale data import feature, covering the overall design, key classes such as ServerLoadDataInfileHandler and LoadDataUtil, and detailed Java source code handling client‑server interactions, file routing, and backend MySQL communication.

DBLEDatabase MiddlewareJava
0 likes · 9 min read
DBLE LOAD DATA: Design Overview and Source Code Walkthrough
Aikesheng Open Source Community
Aikesheng Open Source Community
Feb 25, 2020 · Databases

DBLE 2.19.11.0 Release Notes and Feature Overview

The DBLE 2.19.11.0 release introduces 13 new features, 28 bug fixes, and backward‑compatibility changes, providing detailed explanations of global table checks, new commands, and performance improvements for this enterprise‑grade open‑source distributed middleware to enhance.

DBLEDatabase MiddlewareDistributed Systems
0 likes · 10 min read
DBLE 2.19.11.0 Release Notes and Feature Overview
dbaplus Community
dbaplus Community
Jan 9, 2020 · Databases

Mastering Vitess: Scaling MySQL with Cloud‑Native Sharding and Resharding

This article introduces Vitess, a cloud‑native MySQL sharding middleware, explains its key features, architecture, core concepts such as cells, keyspaces, shards and vindexes, and provides a step‑by‑step guide to performing a reshard from two to four shards while highlighting operational challenges and practical recommendations.

Cloud NativeDatabase MiddlewareResharding
0 likes · 13 min read
Mastering Vitess: Scaling MySQL with Cloud‑Native Sharding and Resharding
ITPUB
ITPUB
Oct 24, 2019 · Databases

How JDTX Achieves High‑Performance Distributed Transactions with MVCC and WAL

This article explains the design and implementation of JDTX, a distributed transaction middleware that combines MVCC, WAL, and a one‑phase commit model to provide strong ACID guarantees, high performance, and multi‑database support while outlining its challenges and future roadmap.

Database MiddlewareDistributed TransactionsJDTX
0 likes · 17 min read
How JDTX Achieves High‑Performance Distributed Transactions with MVCC and WAL
JD Tech Talk
JD Tech Talk
Oct 24, 2019 · Databases

JDTX Distributed Transaction Solution: Design Principles, Features, and Implementation Challenges

This article introduces JDTX, a high‑performance, ACID‑compliant distributed transaction middleware, explains its architecture based on WAL and MVCC, compares rigid two‑phase commit and flexible BASE‑based approaches, and discusses the technical difficulties and future roadmap for integrating JDTX with Apache ShardingSphere and cloud‑native platforms.

ACIDDatabase MiddlewareDistributed Transactions
0 likes · 15 min read
JDTX Distributed Transaction Solution: Design Principles, Features, and Implementation Challenges
Aikesheng Open Source Community
Aikesheng Open Source Community
Jun 4, 2019 · Databases

How DBLE Maps Logical Shards to Physical Partitions Using a Hash Modulo

This article explains DBLE's hash‑based sharding algorithm that first computes a modulo to obtain a logical shard number and then directly maps it to a physical shard via a mapping table derived from partitionLength and partitionCount arrays, including configuration steps, development tips, operational guidance, and a comparison with MyCat.

DBLEDatabase MiddlewareMycat
0 likes · 7 min read
How DBLE Maps Logical Shards to Physical Partitions Using a Hash Modulo
dbaplus Community
dbaplus Community
Mar 31, 2019 · Databases

Unlocking Distributed Databases with Apache ShardingSphere: Features and JD.com Case Study

This article introduces Apache ShardingSphere’s ecosystem, core sharding and governance capabilities, access endpoints such as Sharding-JDBC, Sharding-Proxy and Sharding-Sidecar, and details JD.com’s real‑world implementation, including data‑sharding strategies, distributed primary keys, hint routing, performance optimizations, and future roadmap.

Apache ShardingSphereDatabase MiddlewareJD.com
0 likes · 18 min read
Unlocking Distributed Databases with Apache ShardingSphere: Features and JD.com Case Study
JD Tech Talk
JD Tech Talk
Nov 1, 2018 · Databases

The Evolution and Release of ShardingSphere 3.0.0: From Sharding‑JDBC to Sharding‑Proxy

This article chronicles the eight‑month development of ShardingSphere 3.0.0, detailing its origins from Sharding‑JDBC, the addition of Sharding‑Proxy and Sidecar, core feature enhancements, distributed transaction redesign, community growth, and future roadmap for the open‑source database middleware ecosystem.

Database MiddlewareDistributed TransactionsJava
0 likes · 12 min read
The Evolution and Release of ShardingSphere 3.0.0: From Sharding‑JDBC to Sharding‑Proxy
Java Backend Technology
Java Backend Technology
May 8, 2018 · Databases

How MyCat Simplifies Database Sharding and Read/Write Routing

This article explains MyCat's role as a database middleware, tracing the evolution from single‑database setups through distributed deployment, caching, master‑slave, vertical and horizontal sharding, and shows how MyCat automates data‑source and shard selection to reduce code complexity.

Database MiddlewareMaster‑SlaveMycat
0 likes · 11 min read
How MyCat Simplifies Database Sharding and Read/Write Routing
ITPUB
ITPUB
Nov 20, 2017 · Databases

Core Business Object Sharding Explained with the mysqlda MySQL Middleware

This article examines the challenges of traditional database sharding, introduces core business object‑based partitioning, and details the design, architecture, and operation of the mysqlda MySQL middleware, including its benefits, limitations, and a practical deployment example.

Data PartitioningDatabase Middlewaremysql
0 likes · 12 min read
Core Business Object Sharding Explained with the mysqlda MySQL Middleware
Qunar Tech Salon
Qunar Tech Salon
Jul 31, 2017 · Databases

Core Functions of Relational Database Middleware and an In‑Depth Look at Sharding‑JDBC Architecture

This article explains why relational database middleware is essential for scaling internet‑level workloads, describes the principles of horizontal sharding and distributed primary‑key generation, and provides a comprehensive overview of Sharding‑JDBC’s architecture, core modules, performance benchmarks, and future roadmap.

Database MiddlewareJavaSQL
0 likes · 18 min read
Core Functions of Relational Database Middleware and an In‑Depth Look at Sharding‑JDBC Architecture
dbaplus Community
dbaplus Community
Jul 27, 2017 · Databases

How Sharding-JDBC Transforms Relational Databases for Scalable Cloud‑Native Applications

This article explains the core functions of relational‑database middleware, dives into Sharding-JDBC’s architecture, performance characteristics, and implementation details such as sharding rules, SQL parsing, routing, rewrite, execution, result merging, and distributed primary‑key generation, and outlines its future roadmap.

Database MiddlewareDistributed TransactionsJava
0 likes · 21 min read
How Sharding-JDBC Transforms Relational Databases for Scalable Cloud‑Native Applications
Meituan Technology Team
Meituan Technology Team
Jan 5, 2017 · Databases

Inside DBProxy: Open‑Source High‑Availability Database Middleware and Its Key Enhancements

DBProxy, an open‑source MySQL middleware derived from Atlas, offers horizontal scaling, read/write separation, load balancing, advanced blacklist filtering, dynamic configuration, and numerous bug fixes, positioning it as a mature, high‑availability solution for enterprise database environments.

DBProxyDatabase Middlewarehigh availability
0 likes · 12 min read
Inside DBProxy: Open‑Source High‑Availability Database Middleware and Its Key Enhancements
Architecture Digest
Architecture Digest
May 21, 2016 · Databases

An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Technical Features

The article introduces MyCat, an open‑source distributed database middleware that provides transparent sharding, multi‑backend support, AI‑driven catlet extensions, and advanced read‑write splitting to enable low‑cost migration of single‑node databases to cloud environments while addressing performance and scalability challenges.

Database MiddlewareMycatSQL Routing
0 likes · 9 min read
An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Technical Features
Architecture Digest
Architecture Digest
Mar 16, 2016 · Databases

An Overview of Mycat Distributed Database Middleware: Architecture, Deployment, Sharding, and High Availability

This article introduces Mycat, an open‑source distributed database middleware that implements the MySQL protocol, explains its core concepts such as sharding, read/write separation, high availability, deployment architectures, optimization strategies, and provides practical configuration examples for schema, rule, and server files.

Database Middlewaremysqlsharding
0 likes · 13 min read
An Overview of Mycat Distributed Database Middleware: Architecture, Deployment, Sharding, and High Availability
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Aug 6, 2015 · Databases

An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Core Features

MyCat is an open‑source distributed database middleware that transparently shreds tables across multiple backend databases, solves connection overload, provides ER‑based sharding, global partitioning, AI‑driven catlets, and advanced read‑write separation, enabling low‑cost migration of single‑node databases to the cloud.

AI catletDatabase MiddlewareMycat
0 likes · 9 min read
An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Core Features