Tagged articles
Database Middleware
57 articles · Page 1 of 1
The article outlines the growing difficulties of managing diverse databases in cloud-native environments, introduces Apache ShardingSphere as a comprehensive open‑source solution with three core capabilities—connectivity, enhancement, and pluggability—and guides readers through a three‑step learning path from fundamentals to deployment and testing.
Database MiddlewareSQLShardingSphere
0 likes · 9 min read

This article explains the limitations of MySQL's built‑in query cache, how the InnoDB buffer pool works and can be tuned, and introduces ReadySet as an external caching middleware to improve query performance after a major product upgrade.
Buffer PoolDatabase MiddlewareInnoDB
0 likes · 5 min read

This article explains why sharding is needed for high‑traffic databases, outlines vertical and horizontal partitioning, and compares three popular sharding middleware—ShardingSphere, MyCAT, and Vitess—detailing their architectures, advantages, and ideal use cases to help engineers select the right solution.
Database MiddlewareMySQLdistributed architecture
0 likes · 9 min read

The article dissects Sharding‑JDBC’s five core engines—parsing, routing, rewriting, execution, and merging—highlights production pain points, and details custom extensions such as skipping sharding for specific tables, forcing master routing, runtime configuration refresh, batch‑update handling, sharding‑condition deduplication, full‑route validation, and a simplified component wrapper to ease integration and improve performance.
Database MiddlewareExecution EngineRouting Engine
0 likes · 55 min read

This article introduces database middleware, explains why it’s needed for scaling and performance, and provides a detailed overview of six popular middleware solutions—including ShardingSphere, MyCat, MySQL‑Proxy, DRDS, Atlas, and Zebra—highlighting their core features and use cases.
DRDSDatabase MiddlewareMycat
0 likes · 8 min read

This article explains what database middleware is, why it’s needed for scaling large data workloads, and provides detailed overviews of six popular middleware solutions—including MyCat, MySQL‑Proxy, DRDS, Atlas, Zebra, and ShardingSphere—highlighting their key features and use cases.
DRDSDatabase MiddlewareMySQL-Proxy
0 likes · 7 min read

The DBLE 3.23.08.0 release notes detail the project's overview, introduce five major feature enhancements—including hybrid OLAP/OLTP load support and internal thread hang detection—list numerous bug fixes, incompatibility adjustments, and summarize LTS version patches across several minor releases.
DBLEDatabase MiddlewareOLAP
0 likes · 9 min read

The DBLE 3.23.04.0 release introduces six new or refactored features, fixes over five critical community issues and more than a hundred bugs, adjusts TCP keep‑alive parameters, adds experimental configuration support, and provides detailed LTS version updates and incompatibility notes for users.
DBLEDatabase MiddlewareSharding
0 likes · 8 min read

This article details HuoLa La's journey of designing, implementing, and evolving a hybrid‑cloud self‑built database middleware that unifies multi‑cloud environments, achieves up to 1024× MySQL horizontal scaling, and addresses challenges such as multi‑language stacks, high availability, SQL governance, and multi‑AZ deployment.
Database MiddlewareHigh AvailabilityMulti‑AZ
0 likes · 17 min read

The article provides a detailed overview of DBLE version 3.22.11.0, covering project background, major new functionalities such as master‑slave delay detection and audit logs, a full list of release notes, bug fixes, incompatibility changes, and subsequent LTS patch updates.
DBLEDatabase MiddlewareLTS
0 likes · 7 min read


ITPUBNov 6, 2022 · Databases
The article explains why a recent write may be invisible when reading from a MySQL replica, analyzes the replication threads and latency causes, and presents practical solutions such as forcing master reads, lag detection, semi‑sync mode, and GTID‑based waiting, with examples from Sharding‑JDBC, MyCat and MaxScale.
Database MiddlewareGTIDMaster‑Slave
0 likes · 10 min read

This article explains the different layers—encoding, framework, driver, proxy, and implementation—through which database sharding can be introduced, compares driver‑level and proxy‑level middleware, outlines their characteristics, common constraints, and provides a step‑by‑step process for planning, preparing, and executing a sharding project.
Database MiddlewareJavaMySQL
0 likes · 13 min read

The article explains why, contrary to common belief, the rise of multi‑cloud environments actually demands self‑built database middleware to ensure seamless adaptation, vendor neutrality, high availability, and cost‑effective scalability for growing enterprise workloads.
Database MiddlewareHigh AvailabilityMulti-cloud
0 likes · 18 min read

This article explains how Dble validates its configuration files during startup, lists the main configuration file types, and walks through typical startup failure examples—such as port conflicts, syntax errors, and backend MySQL connectivity issues—providing step‑by‑step troubleshooting guidance for new users.
ConfigurationDatabase MiddlewareMySQL
0 likes · 9 min read

This article explains how to configure Dble's read‑write splitting feature by preparing MySQL master‑slave instances, defining dbGroup and rwSplitUser in XML configuration files, reloading the settings, and verifying that write statements go to the primary node while reads are load‑balanced across replicas.
ConfigurationDatabase MiddlewareMySQL
0 likes · 6 min read

To support the rapidly growing DeWu App, the team created Rainbow Bridge—a ShardingSphere‑based middleware that unifies horizontal sharding, read‑write separation, shadow‑DB routing, rate limiting, and active‑active traffic correction, while adding a graphical console, stability enhancements, fine‑grained observability, hybrid JDBC/Proxy switching, and ongoing open‑source contributions.
Data ShardingDatabase MiddlewareShardingSphere
0 likes · 18 min read

This guide walks through troubleshooting DBLE container deployment by adjusting Docker network subnets, correcting DBLE configuration IPs, and granting the necessary database permissions to ensure the logical schema is created without errors.
ConfigurationDBLEDatabase Middleware
0 likes · 10 min read

The article investigates why read queries are sent to the master node when Dble is configured with rwSplitMode=3, analyzes reproductions on standard replication and MySQL Group Replication, identifies heartbeat and replication status issues, and provides troubleshooting steps and recommendations.
Database MiddlewareGroup ReplicationMySQL
0 likes · 7 min read

This weekly community newsletter curates the latest technical news and open‑source progress, covering MySQL and Mycat issues, a ClickHouse distributed DDL block case, a MySQL MDL lock analysis, the new SQLE release, and updates on DBLE, DTLE, and SQLE middleware projects.
ClickHouseDatabase MiddlewareMySQL
0 likes · 3 min read

The DBLE 3.22.01.0 release introduces seven new or refactored features—including enhanced read/write separation, ClickHouse support, and hint‑based query planning—while fixing over a hundred bugs, addressing critical community issues, and providing a complete list of changes and incompatibilities.
ClickHouseDBLEDatabase Middleware
0 likes · 5 min read

The article explains why, despite cloud services, enterprises still need to develop their own database middleware to ensure multi‑cloud compatibility, vendor neutrality, high availability, and scalable performance, detailing the challenges, design principles, core features, technical metrics, and operational benefits of such a solution.
Database MiddlewareMulti-cloudOperations
0 likes · 20 min read

This weekly community bulletin summarizes recent MySQL problem reports, new features and bug fixes in the DBLE distributed middleware, DTLE data‑transfer component, and SQLE SQL audit tool, while also highlighting upcoming development plans and inviting community feedback.
DBLEDatabase MiddlewareMySQL
0 likes · 4 min read

This article explains how DBLE version 3.21.06.* enables runtime, non‑restart adjustments of various thread‑pool parameters such as processors and backendProcessors, describes the underlying reactor and JDK thread‑pool mechanisms, and provides practical guidance and precautions for safely scaling thread pools in production environments.
DBLEDatabase MiddlewareDynamic Scaling
0 likes · 11 min read

This article explains the new DBLE v3.20.10.0 feature that enables read/write splitting independently of sharding, detailing environment setup, configuration files, SQL testing, and log verification for both sharded and pure read/write split scenarios.
ConfigurationDBLEDatabase Middleware
0 likes · 10 min read

The article provides a comprehensive overview of DBLE version 3.21.06.0, detailing project background, eight new or refactored features, numerous bug fixes, incompatibility changes, LTS patch updates, and links to official resources and tutorials.
DBLEDatabase MiddlewareFeature Updates
0 likes · 7 min read

This article explains how Cobar’s SQL parser converts SQL statements into an abstract syntax tree (AST), details the parser’s implementation options, demonstrates AST node definitions and visitor‑based traversal in Java, and explores practical applications such as sharding, feature extraction, and dangerous‑SQL interception.
ASTCobarDatabase Middleware
0 likes · 8 min read

This weekly roundup presents community news, technical articles, video courses, and open‑source middleware updates, including MySQL and TiDB issue discussions, index design insights, and the latest DBLE and DTLE development progress, bug fixes, and upcoming plans.
DBLEDTLEDatabase Middleware
0 likes · 5 min read

The DBLE 3.21.02.0 release introduces ten new or refactored features, fixes over ten bugs, adds general logging, batch load data mode, fine‑grained SQL statistics, and other enhancements, while also detailing LTS updates, project overview, download links, and community acknowledgments.
DBLEDatabase MiddlewareLOAD DATA
0 likes · 9 min read

This article explains the fundamentals of transparent sharding middleware in NewSQL systems, covering data partitioning strategies, read/write separation, the complete SQL processing pipeline, protocol adaptation for MySQL/PostgreSQL, distributed transaction models such as XA, Saga and TCC, and essential database governance and online scaling techniques.
Database GovernanceDatabase MiddlewareNewSQL
0 likes · 28 min read

This article introduces Atlas, a MySQL‑protocol data middle‑layer developed by Qihoo 360, and provides step‑by‑step instructions for downloading, installing, configuring, testing read/write operations, creating production users, and managing backends using its admin interface.
AtlasConfigurationDatabase Middleware
0 likes · 5 min read

The DBLE 3.20.10.0 release notes detail the open‑source distributed middleware's project overview, major enhancements such as management‑port metadata access and read/write splitting, a comprehensive list of new features, bug fixes, backward‑compatibility changes, and references to past versions and documentation.
DBLEDatabase MiddlewareRead/Write Splitting
0 likes · 10 min read

This article explains the distributed‑timestamp global sequence in Dble, detailing its 63‑bit ID structure, the required Zookeeper and configuration file settings, schema and server adjustments, and step‑by‑step commands to create a table, insert data, and verify that the generated IDs correctly encode instance, cluster, and timestamp information.
Database MiddlewareDistributed Timestampglobal sequence
0 likes · 7 min read


ITPUBMay 28, 2020 · Databases
This article explains the MySQL communication protocol, result‑set structure, client library interfaces, and the difference between store‑result and streaming modes, then details how UPSQL Proxy 2.4.0 adopts streaming to reduce latency and memory usage in distributed database environments.
Database MiddlewareMySQLResultSet
0 likes · 6 min read

The article describes Ctrip's Data Replicate Center (DRC), a MySQL middleware that enables real‑time bidirectional replication across data‑center clusters, detailing its architecture, low‑latency optimizations, consistency mechanisms, DDL handling, monitoring, and future high‑availability improvements.
DRCDatabase MiddlewareGTID
0 likes · 16 min read

This article outlines a systematic approach to diagnosing and resolving DDL execution hangs in Dble, covering log inspection, context analysis, identifying problematic data nodes and MySQL connections, and confirming lock contention as the root cause.
DDLDatabase Middlewarelock contention
0 likes · 4 min read

The article presents a comprehensive overview of DBLE version 2.20.04.0, including project background, new features such as larger MySQL packet support and redesigned failover, a full list of enhancements, bug fixes, backward‑compatibility changes, and links to official documentation and source repositories.
DBLEDatabase MiddlewareFeature Updates
0 likes · 11 min read

This article explains how DBLE, a PaaS middleware, implements MySQL view capabilities by first describing MySQL view concepts and the MERGE and TEMPTABLE algorithms, then detailing DBLE's push‑down and non‑push‑down approaches, the criteria for each, and providing illustrative diagrams.
DBLEDatabase MiddlewareMySQL
0 likes · 5 min read

This weekly community roundup presents the latest DBLE and TXLE open‑source developments, highlights new MySQL features and diagnostic tools, shares bug‑fixes and upcoming plans, and invites readers to contribute feedback and questions about the distributed database middleware ecosystem.
DBLEDatabase MiddlewareMySQL
0 likes · 5 min read

This article explains how DBLE implements the MySQL LOAD DATA large‑scale data import feature, covering the overall design, key classes such as ServerLoadDataInfileHandler and LoadDataUtil, and detailed Java source code handling client‑server interactions, file routing, and backend MySQL communication.
DBLEDatabase MiddlewareJava
0 likes · 9 min read

The DBLE 2.19.11.0 release introduces 13 new features, 28 bug fixes, and backward‑compatibility changes, providing detailed explanations of global table checks, new commands, and performance improvements for this enterprise‑grade open‑source distributed middleware to enhance.
DBLEDatabase MiddlewareFeature Updates
0 likes · 10 min read

This article introduces Vitess, a cloud‑native MySQL sharding middleware, explains its key features, architecture, core concepts such as cells, keyspaces, shards and vindexes, and provides a step‑by‑step guide to performing a reshard from two to four shards while highlighting operational challenges and practical recommendations.
Database MiddlewareMySQLResharding
0 likes · 13 min read

This article explains a second method for implementing ER tables in DBLE that avoids configuring child_table, demonstrates how tables with identical split columns, distribution nodes, and algorithms can act as ER tables, and shows practical JOIN and EXPLAIN query examples.
DBLEDatabase MiddlewareER tables
0 likes · 5 min read


ITPUBOct 24, 2019 · Databases
This article explains the design and implementation of JDTX, a distributed transaction middleware that combines MVCC, WAL, and a one‑phase commit model to provide strong ACID guarantees, high performance, and multi‑database support while outlining its challenges and future roadmap.
Database MiddlewareJDTXMVCC
0 likes · 17 min read

This article introduces JDTX, a high‑performance, ACID‑compliant distributed transaction middleware, explains its architecture based on WAL and MVCC, compares rigid two‑phase commit and flexible BASE‑based approaches, and discusses the technical difficulties and future roadmap for integrating JDTX with Apache ShardingSphere and cloud‑native platforms.
ACIDDatabase MiddlewareJDTX
0 likes · 15 min read

This article explains DBLE's hash‑based sharding algorithm that first computes a modulo to obtain a logical shard number and then directly maps it to a physical shard via a mapping table derived from partitionLength and partitionCount arrays, including configuration steps, development tips, operational guidance, and a comparison with MyCat.
DBLEDatabase MiddlewareMycat
0 likes · 7 min read

This article introduces Apache ShardingSphere’s ecosystem, core sharding and governance capabilities, access endpoints such as Sharding-JDBC, Sharding-Proxy and Sharding-Sidecar, and details JD.com’s real‑world implementation, including data‑sharding strategies, distributed primary keys, hint routing, performance optimizations, and future roadmap.
Apache ShardingSphereData ShardingDatabase Middleware
0 likes · 18 min read

This article chronicles the eight‑month development of ShardingSphere 3.0.0, detailing its origins from Sharding‑JDBC, the addition of Sharding‑Proxy and Sidecar, core feature enhancements, distributed transaction redesign, community growth, and future roadmap for the open‑source database middleware ecosystem.
Database MiddlewareJavaProxy
0 likes · 12 min read

This article explains MyCat's role as a database middleware, tracing the evolution from single‑database setups through distributed deployment, caching, master‑slave, vertical and horizontal sharding, and shows how MyCat automates data‑source and shard selection to reduce code complexity.
Database MiddlewareHorizontal ShardingMaster‑Slave
0 likes · 11 min read


ITPUBNov 20, 2017 · Databases
This article examines the challenges of traditional database sharding, introduces core business object‑based partitioning, and details the design, architecture, and operation of the mysqlda MySQL middleware, including its benefits, limitations, and a practical deployment example.
Data PartitioningDatabase MiddlewareMySQL
0 likes · 12 min read

This guide walks you through downloading MyCat, setting up the MySQL environment, configuring server.xml, schema.xml, and rule.xml for sharding, and starting MyCat on Windows, including connection details and sample c3p0 pool configuration, with screenshots for each step.
ConfigurationDatabase MiddlewareMySQL
0 likes · 7 min read

This article explains why relational database middleware is essential for scaling internet‑level workloads, describes the principles of horizontal sharding and distributed primary‑key generation, and provides a comprehensive overview of Sharding‑JDBC’s architecture, core modules, performance benchmarks, and future roadmap.
Database MiddlewareJavaSQL
0 likes · 18 min read

This article explains the core functions of relational‑database middleware, dives into Sharding-JDBC’s architecture, performance characteristics, and implementation details such as sharding rules, SQL parsing, routing, rewrite, execution, result merging, and distributed primary‑key generation, and outlines its future roadmap.
Database MiddlewareJavaSQL routing
0 likes · 21 min read

DBProxy, an open‑source MySQL middleware derived from Atlas, offers horizontal scaling, read/write separation, load balancing, advanced blacklist filtering, dynamic configuration, and numerous bug fixes, positioning it as a mature, high‑availability solution for enterprise database environments.
DBProxyDatabase MiddlewareHigh Availability
0 likes · 12 min read

This tutorial walks through setting up a Mycat environment, creating required databases and users, installing JDK7 and Mycat, configuring environment variables and MySQL settings, defining sharding rules, and verifying both read/write separation and automatic failover in a master‑slave MySQL cluster.
Database MiddlewareMySQL replicationMycat
0 likes · 9 min read

The article introduces MyCat, an open‑source distributed database middleware that provides transparent sharding, multi‑backend support, AI‑driven catlet extensions, and advanced read‑write splitting to enable low‑cost migration of single‑node databases to cloud environments while addressing performance and scalability challenges.
Database MiddlewareDistributed DatabaseMycat
0 likes · 9 min read

This article introduces Mycat, an open‑source distributed database middleware that implements the MySQL protocol, explains its core concepts such as sharding, read/write separation, high availability, deployment architectures, optimization strategies, and provides practical configuration examples for schema, rule, and server files.
Database MiddlewareMySQLSharding
0 likes · 13 min read

MyCat is an open‑source distributed database middleware that transparently shreds tables across multiple backend databases, solves connection overload, provides ER‑based sharding, global partitioning, AI‑driven catlets, and advanced read‑write separation, enabling low‑cost migration of single‑node databases to the cloud.
AI catletCloud MigrationDatabase Middleware
0 likes · 9 min read
