BestHub
Sign in
Tag

database sharding

0 views collected around this technical thread.

Java Captain
Java Captain
May 14, 2025 · Databases

Guide to Setting Up ShardingSphere with Docker for Database Sharding, Read‑Write Splitting, and SpringBoot Integration

This guide demonstrates how to set up Docker‑based MySQL instances, configure ShardingSphere‑Proxy for database sharding and read‑write splitting, and integrate ShardingSphere‑JDBC with SpringBoot 2.x using YAML configurations and Maven dependencies, providing complete code snippets and default connection details.

DockerMySQLRead-Write Splitting
0 likes · 11 min read
Guide to Setting Up ShardingSphere with Docker for Database Sharding, Read‑Write Splitting, and SpringBoot Integration
Selected Java Interview Questions
Selected Java Interview Questions
Feb 14, 2025 · Databases

ShardingSphere Overview and Spring Boot Integration for Database Sharding, Proxy, and Sidecar

This article introduces ShardingSphere's three components—Sharding-JDBC, Sharding-Proxy, and the upcoming Sharding-Sidecar—explains why sharding is needed for relational databases, demonstrates horizontal data sharding concepts, and provides a complete Spring Boot example with configuration, code, and asynchronous batch insertion.

Async ProcessingMySQLShardingSphere
0 likes · 17 min read
ShardingSphere Overview and Spring Boot Integration for Database Sharding, Proxy, and Sidecar
Architect's Guide
Architect's Guide
Jan 24, 2025 · Backend Development

How to Design a High-Concurrency System: Key Architectural Strategies for Interviews

This article explains how to answer interview questions about designing high‑concurrency systems by outlining essential architectural techniques such as system decomposition, caching, message queues, database sharding, read‑write separation, and Elasticsearch, while emphasizing practical considerations and real‑world complexity.

CachingHigh ConcurrencyMessage Queue
0 likes · 9 min read
How to Design a High-Concurrency System: Key Architectural Strategies for Interviews
Top Architect
Top Architect
Oct 4, 2024 · Databases

Design and Implementation of Table Sharding for Loan and Repayment Applications Using ShardingSphere and Spring Boot

The article describes a year‑long development experience where a senior architect designs, plans, and implements a sharding solution for loan and repayment tables using ShardingSphere, Spring Boot 3, MySQL, and custom synchronization code to migrate billions of rows while ensuring data consistency and operational continuity.

JavaMySQLShardingSphere
0 likes · 25 min read
Design and Implementation of Table Sharding for Loan and Repayment Applications Using ShardingSphere and Spring Boot
Selected Java Interview Questions
Selected Java Interview Questions
Jun 25, 2024 · Databases

Design and Implementation of Table Sharding for Cash Repayment Applications Using ShardingSphere and Spring Boot

This article details the end‑to‑end design, configuration, and code implementation of a 50‑table sharding solution for cash repayment and loan application data, covering database schema planning, historical data migration, backend query adaptation, dynamic switches, scheduled consistency checks, and practical pitfalls encountered with Spring Boot 3 and ShardingSphere.

JavaMySQLShardingSphere
0 likes · 22 min read
Design and Implementation of Table Sharding for Cash Repayment Applications Using ShardingSphere and Spring Boot
Top Architect
Top Architect
Jun 10, 2024 · Databases

Understanding Database Sharding: When and How to Split Databases and Tables

The article explains why and when to apply database sharding and table partitioning, illustrates real‑world growth scenarios, compares horizontal and vertical splitting methods, reviews common sharding middleware such as Cobar, TDDL, Atlas, Sharding‑jdbc (ShardingSphere) and Mycat, and offers practical recommendations for different company sizes.

MySQLdatabase shardinghorizontal partitioning
0 likes · 14 min read
Understanding Database Sharding: When and How to Split Databases and Tables
Lobster Programming
Lobster Programming
Apr 24, 2024 · Backend Development

Boost Your System’s Concurrency: Proven Strategies from Load Balancing to CDN

Learn practical ways to enhance a system’s concurrent handling capacity, including traffic distribution via load balancers, database sharding and clustering, message queues, caching layers, CDNs, code and database optimizations, and scaling hardware resources such as servers, CPUs, and memory.

Cachingconcurrencydatabase sharding
0 likes · 4 min read
Boost Your System’s Concurrency: Proven Strategies from Load Balancing to CDN
Sohu Tech Products
Sohu Tech Products
Apr 10, 2024 · Databases

ShardingSphere-JDBC Database Sharding Tutorial Project

The tutorial project showcases how to implement database sharding with ShardingSphere-JDBC (versions 4 and 5) in a SpringBoot O2O order service, providing modules for sharding, a gRPC ID generator, detailed configuration of four data sources, sharding algorithms, and Swagger-based testing of order creation and queries.

Database ScalingDistributed DatabaseHigh Concurrency
0 likes · 5 min read
ShardingSphere-JDBC Database Sharding Tutorial Project
Architect
Architect
Mar 29, 2024 · Databases

Understanding Database Sharding and Partitioning with ShardingSphere

This article explains the fundamentals of database sharding and partitioning, why they are needed for massive data volumes, various vertical and horizontal splitting strategies, routing algorithms, client vs. proxy deployment models, and the practical challenges and solutions when using ShardingSphere 5.x.

Horizontal SplittingMySQLShardingSphere
0 likes · 17 min read
Understanding Database Sharding and Partitioning with ShardingSphere
Sanyou's Java Diary
Sanyou's Java Diary
Feb 22, 2024 · Backend Development

10 Proven Techniques to Supercharge Backend API Performance

This article presents a comprehensive guide for backend developers, covering ten practical techniques—including local and distributed caching, parallel execution, asynchronous processing, connection pooling, sharding, SQL tuning, pre‑computation, batch operations, lock granularity, and context propagation—to dramatically improve API performance.

CachingPerformance OptimizationSQL Tuning
0 likes · 13 min read
10 Proven Techniques to Supercharge Backend API Performance
macrozheng
macrozheng
Dec 6, 2023 · Databases

When and How to Implement Database Sharding and Partitioning for High‑Scale Systems

This article explains why database sharding and partitioning become necessary, outlines performance bottlenecks, presents software and hardware optimization techniques, details horizontal and vertical splitting strategies, and discusses the added complexity such as cross‑database joins, distributed transactions, and ID generation.

SQL Optimizationdatabase shardingdistributed transactions
0 likes · 13 min read
When and How to Implement Database Sharding and Partitioning for High‑Scale Systems
Top Architect
Top Architect
Oct 17, 2023 · Backend Development

Evolution of E‑commerce System Architecture: From Monolithic to Unitized Design

This article outlines the progressive architectural evolution of an e‑commerce platform, describing how increasing traffic drives the transition from a single‑module monolith through horizontal scaling, read/write separation, sharding, CDN caching, dual‑datacenter deployment, and finally to a unit‑based micro‑service architecture.

MicroservicesSystem Architecturebackend development
0 likes · 9 min read
Evolution of E‑commerce System Architecture: From Monolithic to Unitized Design
Top Architect
Top Architect
Oct 7, 2023 · Backend Development

Evolution of E-commerce System Architecture

This article outlines the progressive evolution of e‑commerce system architecture from a monolithic 1.0 design through layered scaling, read/write separation, CDN caching, sharding, and finally unit‑based modularization, highlighting the performance bottlenecks and solutions at each stage.

CDNSystem Architecturebackend scaling
0 likes · 9 min read
Evolution of E-commerce System Architecture
Tencent Cloud Developer
Tencent Cloud Developer
Sep 20, 2023 · Operations

Storage Governance and Optimization Practices for Meeting Control Systems

The article explains how a meeting control system tackled severe storage pressure from high concurrent traffic by introducing a proxy layer, multi‑active disaster‑recovery, identity‑based data isolation, dynamic‑static key separation, multi‑level caching, overload protection, sharding with dual‑write migration, and extensive monitoring to meet 100k QPS and ensure reliability.

Performance OptimizationStorage Optimizationdatabase sharding
0 likes · 49 min read
Storage Governance and Optimization Practices for Meeting Control Systems
JD Tech
JD Tech
Aug 25, 2023 · Databases

Reducing Sharding-JDBC Database Connection Count: Analysis and Custom Partitioning Optimization

This article examines the high connection‑count problem of Sharding-JDBC in JD Logistics, explains sharding concepts, compares four mitigation strategies, and presents a custom table‑partitioning algorithm with configuration changes that dramatically lowers MySQL instance connections while maintaining performance.

MySQLPerformance OptimizationSharding-JDBC
0 likes · 16 min read
Reducing Sharding-JDBC Database Connection Count: Analysis and Custom Partitioning Optimization
Architect's Guide
Architect's Guide
Jun 20, 2023 · Databases

Why and How to Perform Database Sharding and Table Partitioning

Database sharding and table partitioning are essential scaling techniques that separate data across multiple databases and tables to handle growing user volume, data size, and concurrency, with explanations of when to split, methods (horizontal vs vertical), and a comparison of popular middleware solutions.

database shardinghorizontal scalingmiddleware
0 likes · 14 min read
Why and How to Perform Database Sharding and Table Partitioning
JD Tech
JD Tech
May 19, 2023 · Databases

Evolution and Architecture of JD VOP Message Warehouse: From V1.0 to V3.0

This article details the design, scaling challenges, and successive upgrades of JD's VOP message warehouse—from early V1.0 bottlenecks through V2.0 sharding to the current V3.0 MongoDB‑based architecture—highlighting performance improvements, traffic governance, cost reduction, and future outlook for handling billions of daily messages.

High ThroughputMessage QueueMongoDB
0 likes · 16 min read
Evolution and Architecture of JD VOP Message Warehouse: From V1.0 to V3.0
vivo Internet Technology
vivo Internet Technology
Apr 12, 2023 · Backend Development

vivo Transaction Platform: Architecture Design and Key Technical Solutions

The article details vivo’s transition from a monolithic mall to a micro‑service transaction platform, outlining a multi‑tenant architecture with ShardingSphere‑sharded MySQL, Snowflake IDs, Elasticsearch search, configurable state machines, generic delayed tasks, Seata and local‑message distributed transactions, plus high‑availability safeguards, emphasizing pragmatic solution selection.

High AvailabilityMulti-Tenant ArchitectureState Machine
0 likes · 11 min read
vivo Transaction Platform: Architecture Design and Key Technical Solutions
Code Ape Tech Column
Code Ape Tech Column
Mar 27, 2023 · Databases

Horizontal Database Scaling Strategies and Practical Implementation with MariaDB, Keepalived, and ShardingJDBC

This article explains how to expand a sharded database from three to four nodes, compares five migration schemes—including stop‑service, stop‑write, log‑based, dual‑write, and smooth 2N approaches—and provides step‑by‑step instructions for MariaDB installation, master‑slave configuration, Keepalived high‑availability setup, and dynamic data‑source integration using ShardingJDBC.

High AvailabilityKeepalivedMariaDB
0 likes · 33 min read
Horizontal Database Scaling Strategies and Practical Implementation with MariaDB, Keepalived, and ShardingJDBC