BestHub
Sign in
Tagged articles
33 articles
Page 1 of 1
Java Architect Handbook
Java Architect Handbook
Nov 30, 2025 · Databases

When Sharding Fails: Debugging Pagination Bugs and Optimizing MySQL for Massive Tables

The article recounts a real‑world case where a massive device table (over 500 million rows) suffered from sharding and Elasticsearch integration issues, describes a pagination bug caused by Sharding‑JDBC, and presents a comprehensive set of hardware, software, and SQL optimization techniques—including MySQL configuration examples—to improve performance.

Database OptimizationElasticsearchSharding-JDBC
0 likes · 13 min read
When Sharding Fails: Debugging Pagination Bugs and Optimizing MySQL for Massive Tables
Java Backend Full-Stack
Java Backend Full-Stack
Mar 27, 2025 · Databases

Hands‑On Sharding: Implementing Database and Table Partitioning with Spring Boot and Sharding‑JDBC

This article walks through a complete sharding implementation that splits a user table across four MySQL databases and sixteen tables, discusses challenges such as distributed IDs, transactions, data migration and pagination, and provides full Spring Boot, Sharding‑JDBC, Elasticsearch and Redis configurations with code examples.

ElasticsearchSharding-JDBCSpring Boot
0 likes · 10 min read
Hands‑On Sharding: Implementing Database and Table Partitioning with Spring Boot and Sharding‑JDBC
Su San Talks Tech
Su San Talks Tech
Mar 29, 2024 · Databases

Master ShardingSphere: Hands‑On Sharding‑JDBC Sharding & Partitioning Guide

This article provides a comprehensive, step‑by‑step tutorial on using Apache ShardingSphere and Sharding‑JDBC to implement horizontal, vertical, and broadcast sharding, covering core concepts, sharding strategies, configuration examples, and practical code snippets for real‑world database partitioning.

Broadcast TableSharding-JDBCShardingSphere
0 likes · 22 min read
Master ShardingSphere: Hands‑On Sharding‑JDBC Sharding & Partitioning Guide
vivo Internet Technology
vivo Internet Technology
Mar 6, 2024 · Databases

Sharding-JDBC Source Code Analysis and Custom Development

The article dissects Sharding‑JDBC’s five core engines—parsing, routing, rewriting, execution, and merging—highlights production pain points, and details custom extensions such as skipping sharding for specific tables, forcing master routing, runtime configuration refresh, batch‑update handling, sharding‑condition deduplication, full‑route validation, and a simplified component wrapper to ease integration and improve performance.

Custom DevelopmentDatabase MiddlewareExecution Engine
0 likes · 55 min read
Sharding-JDBC Source Code Analysis and Custom Development
政采云技术
政采云技术
Nov 7, 2023 · Databases

Sharding-JDBC Startup Optimization: Analyzing and Tuning max.connections.size.per.query

This article investigates why Sharding-JDBC takes over half of the application startup time to load metadata, explains the role of the max.connections.size.per.query setting, demonstrates how adjusting it speeds up startup, and discusses the trade‑offs and potential dead‑lock risks of increasing the value.

Connection PoolDatabase ConfigurationSharding-JDBC
0 likes · 7 min read
Sharding-JDBC Startup Optimization: Analyzing and Tuning max.connections.size.per.query
JD Tech
JD Tech
Aug 25, 2023 · Databases

Reducing Sharding-JDBC Database Connection Count: Analysis and Custom Partitioning Optimization

This article examines the high connection‑count problem of Sharding-JDBC in JD Logistics, explains sharding concepts, compares four mitigation strategies, and presents a custom table‑partitioning algorithm with configuration changes that dramatically lowers MySQL instance connections while maintaining performance.

Connection PoolingSharding-JDBCcustom sharding algorithm
0 likes · 16 min read
Reducing Sharding-JDBC Database Connection Count: Analysis and Custom Partitioning Optimization
JD Cloud Developers
JD Cloud Developers
Jul 27, 2023 · Databases

Scaling MySQL at JD Logistics with ShardingSphere: Refactoring Sharding-JDBC

This article examines how JD Logistics tackled MySQL connection limits by redesigning its sharding strategy using ShardingSphere's Sharding-JDBC, detailing the background, concepts of database and table sharding, analysis of bottlenecks, and step‑by‑step refactoring to reduce connections and improve scalability.

Sharding-JDBCShardingSpheredatabase sharding
0 likes · 16 min read
Scaling MySQL at JD Logistics with ShardingSphere: Refactoring Sharding-JDBC
dbaplus Community
dbaplus Community
Jun 11, 2023 · Databases

Splitting a 500‑Million‑Row MySQL Table: Practical Sharding‑JDBC Lessons

Facing a MySQL transaction table exceeding 50 million rows and growing rapidly, a finance team redesigned the schema using sharding‑jdbc, chose transaction time as the shard key, tackled multi‑data‑source transactions and cross‑shard pagination, and executed a phased migration to ensure stability and performance.

Data MigrationLarge TablesSharding-JDBC
0 likes · 11 min read
Splitting a 500‑Million‑Row MySQL Table: Practical Sharding‑JDBC Lessons
政采云技术
政采云技术
Nov 15, 2022 · Databases

Introduction to Sharding-JDBC and ShardingSphere: Architecture, Sharding Strategies, and Quick Integration

This article introduces Sharding-JDBC and ShardingSphere, explains their history, core architecture, vertical and horizontal sharding concepts, sharding rule configuration, SQL parsing and rewriting, routing and result merging, and provides a quick‑start guide with Maven dependencies and Spring Boot configuration for Java applications.

JavaSQLSharding-JDBC
0 likes · 12 min read
Introduction to Sharding-JDBC and ShardingSphere: Architecture, Sharding Strategies, and Quick Integration
Java High-Performance Architecture
Java High-Performance Architecture
Sep 4, 2022 · Databases

Unlock Sharding-JDBC: Guide to Sharding, Replication & Distributed Databases

This comprehensive tutorial walks through the evolution of Sharding-JDBC into ShardingSphere, explains core concepts like sharding, data nodes, and algorithms, demonstrates MySQL master‑slave setup with Docker, and provides step‑by‑step code examples for implementing read‑write separation, horizontal and vertical sharding, and distributed primary keys.

MySQL replicationSharding-JDBCSpring Boot
0 likes · 39 min read
Unlock Sharding-JDBC: Guide to Sharding, Replication & Distributed Databases
Top Architect
Top Architect
Jun 30, 2022 · Databases

Database Sharding and Partitioning Strategies with Practical Implementation

This article explains why high‑traffic systems need database sharding, compares table‑level and database‑level partitioning methods, presents concrete MySQL table‑creation scripts and Java service code, and discusses the advantages, drawbacks, and common middleware solutions such as Sharding‑JDBC and Mycat.

MycatSharding-JDBCTable Partitioning
0 likes · 12 min read
Database Sharding and Partitioning Strategies with Practical Implementation
Code Ape Tech Column
Code Ape Tech Column
Jun 17, 2022 · Databases

Understanding Local Transactions in Sharding-JDBC and Their Limits for Distributed Transactions

This article explains why the @Transactional annotation in Sharding-JDBC can roll back across multiple databases in some scenarios, clarifies the cases it truly supports, details the internal rollback implementation, and outlines the situations where local transactions cannot guarantee distributed consistency.

JavaLocal TransactionSharding-JDBC
0 likes · 8 min read
Understanding Local Transactions in Sharding-JDBC and Their Limits for Distributed Transactions
Code Ape Tech Column
Code Ape Tech Column
May 16, 2022 · Information Security

Data Masking with Sharding-JDBC: Concepts, Configuration, and Custom Encryptors

This article explains how Sharding-JDBC can perform data masking at the persistence layer, detailing key concepts, configuration of data sources, encryptors, and tables, demonstrating practical examples with built‑in MD5 and AES encryptors, and showing how to implement custom encryptors and query‑assisted encryption for enhanced security.

Custom EncryptorDatabase SecuritySharding-JDBC
0 likes · 20 min read
Data Masking with Sharding-JDBC: Concepts, Configuration, and Custom Encryptors
Code Ape Tech Column
Code Ape Tech Column
May 9, 2022 · Databases

Sharding-JDBC Advanced Guide: Configuration and Practical Implementation

This article provides a comprehensive guide to Sharding-JDBC, covering the challenges of database sharding such as distributed transactions, cross‑node joins, pagination, global key collisions, and demonstrates practical configuration and code examples for vertical and horizontal partitioning using Spring Boot.

Distributed TransactionsSharding-JDBCSpring Boot
0 likes · 18 min read
Sharding-JDBC Advanced Guide: Configuration and Practical Implementation
Code Ape Tech Column
Code Ape Tech Column
Sep 9, 2021 · Databases

Sharding-JDBC Introduction and Practical Guide to Database Sharding with ShardingSphere

This article introduces Sharding-JDBC (now ShardingSphere), explains core sharding concepts such as shards, data nodes, logical and physical tables, sharding keys, algorithms and strategies, shows how it extends JDBC, and provides a step‑by‑step Spring Boot + MyBatis‑Plus example for building a sharded database application.

Sharding-JDBCShardingSphereSpring Boot
0 likes · 30 min read
Sharding-JDBC Introduction and Practical Guide to Database Sharding with ShardingSphere
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 29, 2021 · Databases

Quick Integration of ShardingSphere for Database Sharding in Spring Boot

This article explains how to use Spring Boot to quickly integrate ShardingSphere for database sharding, covering the background of massive data storage challenges, the advantages of ShardingSphere, step‑by‑step project setup, configuration of data sources and sharding strategies, and a complete test example.

Inline Sharding StrategyMyBatisSharding-JDBC
0 likes · 13 min read
Quick Integration of ShardingSphere for Database Sharding in Spring Boot
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Nov 13, 2020 · Databases

Sharding-JDBC: Basic Usage and Core Principles

This article introduces Sharding-JDBC, explaining its basic usage, core concepts, sharding strategies, SQL processing workflow, configuration examples, and code snippets, while emphasizing the importance of understanding its underlying principles for effective database horizontal partitioning in Java applications.

JavaSQL RoutingSharding-JDBC
0 likes · 70 min read
Sharding-JDBC: Basic Usage and Core Principles
Java Architect Essentials
Java Architect Essentials
Oct 12, 2020 · Databases

Sharding-JDBC Demo with Spring Boot: Database and Table Sharding Guide

This article provides a step‑by‑step tutorial on using Sharding-JDBC with Spring Boot to implement horizontal database and table sharding across multiple MySQL instances, including project setup, Maven dependencies, entity and controller code, sharding configuration, and testing via Postman.

Sharding-JDBCSpring Bootdatabase sharding
0 likes · 12 min read
Sharding-JDBC Demo with Spring Boot: Database and Table Sharding Guide
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 28, 2020 · Databases

Understanding Master/Slave Read‑Write Splitting and Data Consistency with Sharding‑JDBC

This article explains the data‑delay problem inherent in asynchronous MySQL master‑slave replication, demonstrates how Sharding‑JDBC provides read‑write splitting and forced‑master routing via HintManager, and offers configuration and code examples as well as alternative async‑query strategies for real‑time consistency.

Data ConsistencyHintManagerJava
0 likes · 8 min read
Understanding Master/Slave Read‑Write Splitting and Data Consistency with Sharding‑JDBC
Top Architect
Top Architect
Jun 30, 2020 · Databases

Sharding-JDBC Demo: Implementing Database Sharding with Spring Boot

This article demonstrates how to set up Sharding-JDBC in a Spring Boot project, covering project structure, Maven configuration, entity, controller, service, mapper code, database DDL for multiple shards, sharding rules in application.properties, and API testing with Postman.

JavaORMSharding-JDBC
0 likes · 14 min read
Sharding-JDBC Demo: Implementing Database Sharding with Spring Boot
dbaplus Community
dbaplus Community
Aug 4, 2018 · Databases

Mastering Database Sharding: Strategies, Pitfalls, and Practical Tips

This article reviews the background, side effects, sharding strategies, and key considerations of database partitioning, illustrating challenges such as merge‑sort pagination, deep‑paging performance, hash‑based routing, and integration issues with Sharding‑JDBC, while offering practical solutions and best‑practice recommendations.

Deep PagingHash RoutingMerge Sort Pagination
0 likes · 15 min read
Mastering Database Sharding: Strategies, Pitfalls, and Practical Tips
Programmer DD
Programmer DD
May 1, 2018 · Databases

Which Database Connection Pool Reigns Supreme? A Deep Dive into HikariCP, Druid, and Beyond

This article reviews mainstream Java database connection pools—including C3P0, DBCP, Tomcat JDBC, BoneCP, Druid, and HikariCP—compares their features and performance, explores an even faster Scala async pool, discusses future middleware trends, and examines Sharding-JDBC's evolution toward a Database Mesh architecture.

Database Connection PoolDruidHikariCP
0 likes · 11 min read
Which Database Connection Pool Reigns Supreme? A Deep Dive into HikariCP, Druid, and Beyond
Qunar Tech Salon
Qunar Tech Salon
Jul 31, 2017 · Databases

Core Functions of Relational Database Middleware and an In‑Depth Look at Sharding‑JDBC Architecture

This article explains why relational database middleware is essential for scaling internet‑level workloads, describes the principles of horizontal sharding and distributed primary‑key generation, and provides a comprehensive overview of Sharding‑JDBC’s architecture, core modules, performance benchmarks, and future roadmap.

Database MiddlewareJavaSQL
0 likes · 18 min read
Core Functions of Relational Database Middleware and an In‑Depth Look at Sharding‑JDBC Architecture
dbaplus Community
dbaplus Community
Jul 27, 2017 · Databases

How Sharding-JDBC Transforms Relational Databases for Scalable Cloud‑Native Applications

This article explains the core functions of relational‑database middleware, dives into Sharding-JDBC’s architecture, performance characteristics, and implementation details such as sharding rules, SQL parsing, routing, rewrite, execution, result merging, and distributed primary‑key generation, and outlines its future roadmap.

Database MiddlewareDistributed TransactionsJava
0 likes · 21 min read
How Sharding-JDBC Transforms Relational Databases for Scalable Cloud‑Native Applications
Architecture Digest
Architecture Digest
Feb 15, 2016 · Databases

Sharding-JDBC: A Lightweight Java Database Sharding Framework

Sharding-JDBC is a client‑side Java framework that provides transparent horizontal sharding for relational databases, offering flexible sharding strategies, SQL parsing and rewriting, multi‑threaded execution, result merging, and high performance while requiring no additional deployment or proxy layers.

JDBCJavaSharding-JDBC
0 likes · 14 min read
Sharding-JDBC: A Lightweight Java Database Sharding Framework