BestHub
Sign in
Tagged articles

database sharding

232 articles · Page 1 of 3
ITPUB
ITPUB
Aug 12, 2026 · Backend Development

How Dingdang Kuaike Achieves 28‑Minute Drug Delivery: The Underlying Tech Architecture

In this interview, Dingdang Kuaike’s R&D head Song Zilong explains how the company transformed a tightly coupled monolith into a micro‑service system, built intelligent real‑time scheduling, migrated Oracle to sharded MySQL across hybrid‑cloud IDC, and leveraged AI to sustain a 28‑minute drug‑delivery promise.

AI integrationR&D Managementdatabase sharding
0 likes · 17 min read
How Dingdang Kuaike Achieves 28‑Minute Drug Delivery: The Underlying Tech Architecture
Top Architect
Top Architect
Jul 23, 2026 · Backend Development

How Taobao’s Backend Architecture Evolved Over a Decade

The article walks through Taobao’s backend architecture transformation from a single‑server setup to a cloud‑native, micro‑service ecosystem, detailing fourteen evolutionary stages—including separate Tomcat and DB, caching, load balancing, sharding, NoSQL, ESB, containerization, and cloud deployment—while highlighting key concepts, challenges, and design principles.

Backend ArchitectureCloud NativeLoad Balancing
0 likes · 23 min read
How Taobao’s Backend Architecture Evolved Over a Decade
Niu Liu
Niu Liu
Jun 24, 2026 · Databases

Splitting an Order Database into Hot and Cold Stores: Our Practical Approach

The article details how an e‑commerce platform re‑architected its order database by separating recent data into a hot store and historical data into a cold store, describing the motivations, design principles, write and read routing, downstream impacts, consistency safeguards, risks, and observed performance improvements.

backend scalabilitybinlogconsistency
0 likes · 8 min read
Splitting an Order Database into Hot and Cold Stores: Our Practical Approach
Java Tech Workshop
Java Tech Workshop
Jun 6, 2026 · Backend Development

Advanced SpringBoot Database Sharding with ShardingSphere

This article explains why single‑database, single‑table architectures hit performance limits at millions of rows, introduces ShardingSphere as the preferred zero‑deployment sharding solution for SpringBoot, and walks through vertical and horizontal splitting, configuration, custom algorithms, read/write splitting, and distributed transactions with practical code examples.

Custom Sharding AlgorithmReadWrite SplittingSeata
0 likes · 14 min read
Advanced SpringBoot Database Sharding with ShardingSphere
Java Tech Workshop
Java Tech Workshop
Apr 19, 2026 · Backend Development

Getting Started with Sharding-JDBC in SpringBoot: A Practical Guide to Database Sharding

When a single database table grows to millions of rows, query performance and storage become bottlenecks, and this article explains why sharding is needed, introduces Sharding-JDBC as a lightweight solution, and walks through the complete setup, configuration, code implementation, testing, and advanced concepts such as sharding strategies, key generation, binding tables, and broadcast tables for SpringBoot projects.

Horizontal PartitioningMyBatisMySQL
0 likes · 33 min read
Getting Started with Sharding-JDBC in SpringBoot: A Practical Guide to Database Sharding
LuTiao Programming
LuTiao Programming
Apr 10, 2026 · Backend Development

Master Payment Gateway Design: Multi‑Channel Aggregation, Smart Routing, and End‑to‑End Merchant Onboarding

The article explains how to build an enterprise‑grade payment gateway that unifies over 50 providers, performs millisecond‑level smart routing, handles failover, dynamic fee calculation, automated merchant onboarding, sharded storage, and comprehensive monitoring to sustain millions of transactions per day.

FailoverSmart routingdatabase sharding
0 likes · 10 min read
Master Payment Gateway Design: Multi‑Channel Aggregation, Smart Routing, and End‑to‑End Merchant Onboarding
Top Architect
Top Architect
Feb 23, 2026 · Backend Development

How Taobao Scaled: 14 Evolution Steps of a Massive Backend Architecture

This article walks through the step‑by‑step evolution of a large‑scale e‑commerce backend—from a single‑server setup to microservices, containerization, and cloud platforms—highlighting the technical challenges, key technologies, and design principles that enable millions of concurrent users.

Backend ArchitectureCloud ComputingLoad Balancing
0 likes · 24 min read
How Taobao Scaled: 14 Evolution Steps of a Massive Backend Architecture
dbaplus Community
dbaplus Community
Jan 15, 2026 · Backend Development

How to Design a High‑Throughput Database Architecture for a Billion‑Row Daily Log System

This guide breaks down a real‑world interview scenario where a backend engineer must design a scalable database solution for a billing‑log or feed system handling 100 million daily inserts and 100 k QPS reads, covering partitioning vs sharding, sharding key selection, shard count, read‑write separation, multi‑level caching, consistency patterns, hot‑key mitigation, and online schema changes.

Backend ArchitectureCaching StrategiesRead-Write Separation
0 likes · 10 min read
How to Design a High‑Throughput Database Architecture for a Billion‑Row Daily Log System
Architect's Guide
Architect's Guide
Jan 5, 2026 · Backend Development

Beyond Sharding: How Unitization Solves Unlimited Service Scaling

The article traces the evolution from monolithic Java apps to RPC services, explains why sharding and database partitioning cannot alone achieve limitless scaling due to connection limits, and introduces unitization—assigning each application to a specific database shard—to overcome the bottleneck.

Backend ArchitectureRPCdatabase sharding
0 likes · 7 min read
Beyond Sharding: How Unitization Solves Unlimited Service Scaling
Bilibili Tech
Bilibili Tech
Nov 21, 2025 · Backend Development

How Bilibili Scaled Its Private Messaging System to Handle 10× Traffic

This article analyzes the current bottlenecks of Bilibili's private messaging service, explains the technical challenges of massive data volume and traffic spikes, and presents a comprehensive multi‑layer architecture upgrade—including cache strategies, BFF refactoring, database sharding, and consistency mechanisms—to ensure scalability and reliability.

BFFconsistencydatabase sharding
0 likes · 16 min read
How Bilibili Scaled Its Private Messaging System to Handle 10× Traffic
vivo Internet Technology
vivo Internet Technology
Sep 24, 2025 · Backend Development

How Vivo Browser Scaled to Millions: Architecture Upgrade for High‑Performance Coin Incentive System

This article details how Vivo Browser's welfare center was re‑engineered—splitting services, sharding databases, adding arbitration and soft‑transaction mechanisms—to overcome traffic, I/O, and data‑consistency challenges, enabling stable operation at tens of millions of daily active users while reducing storage costs.

Backend ArchitectureData Consistencydatabase sharding
0 likes · 11 min read
How Vivo Browser Scaled to Millions: Architecture Upgrade for High‑Performance Coin Incentive System
macrozheng
macrozheng
Sep 19, 2025 · Databases

Master Database Sharding: Solving Read Diffusion with Range and Modulo Strategies

This article explains why large MySQL tables degrade performance, introduces vertical and horizontal sharding techniques—including range‑based and modulo‑based partitioning—covers the read‑diffusion problem caused by non‑sharding keys, and presents practical solutions such as auxiliary index tables, Elasticsearch integration, and TiDB as a distributed alternative.

ElasticsearchHorizontal PartitioningRange Sharding
0 likes · 15 min read
Master Database Sharding: Solving Read Diffusion with Range and Modulo Strategies
Cognitive Technology Team
Cognitive Technology Team
Sep 15, 2025 · Databases

Avoid Common Pitfalls When Combining MyBatis‑Plus with ShardingSphere‑JDBC

Learn how to seamlessly integrate MyBatis‑Plus with ShardingSphere‑JDBC for high‑performance sharding, covering core principles, step‑by‑step workflow, and detailed solutions to typical pitfalls such as SQL parsing, pagination conflicts, key generation, query routing, transaction handling, broadcast tables, injection risks, and shard algorithm design.

ShardingSphere-JDBCdatabase shardingjava
0 likes · 19 min read
Avoid Common Pitfalls When Combining MyBatis‑Plus with ShardingSphere‑JDBC
Cognitive Technology Team
Cognitive Technology Team
Sep 14, 2025 · Databases

Avoid Common Pitfalls When Combining MyBatis‑Plus with ShardingSphere‑JDBC

This article explains how MyBatis‑Plus and ShardingSphere‑JDBC work together for sharding and scaling, outlines their core responsibilities, details the step‑by‑step SQL processing flow, and provides practical solutions to typical issues such as SQL parsing errors, pagination conflicts, primary‑key generation clashes, missing sharding keys, distributed transaction complexities, broadcast‑table misconfigurations, injection risks, and uneven sharding algorithms.

Java ORMShardingSphere-JDBCdatabase sharding
0 likes · 18 min read
Avoid Common Pitfalls When Combining MyBatis‑Plus with ShardingSphere‑JDBC
Architect's Guide
Architect's Guide
Sep 10, 2025 · Databases

Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices

This article explains why database sharding becomes essential as user growth and data volume surge, describes horizontal and vertical partitioning methods, compares range and hash routing, and reviews popular sharding middleware with their advantages and drawbacks to help you choose the right solution.

Horizontal PartitioningVertical Partitioningdatabase sharding
0 likes · 12 min read
Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices
Architect
Architect
Aug 17, 2025 · Databases

Mastering Database Sharding in Spring Boot: A Complete Guide with ShardingSphere

This comprehensive tutorial explains database sharding concepts, types, strategies, and implementation in Spring Boot using ShardingSphere, covering configuration, entity and repository code, service and controller layers, integration with pagination, Swagger, ActiveMQ, security, batch processing, FreeMarker, WebSockets, AOP, performance testing, FAQs, real‑world cases, and future trends.

ShardingSphereSpring Bootdatabase sharding
0 likes · 32 min read
Mastering Database Sharding in Spring Boot: A Complete Guide with ShardingSphere
Open Source Linux
Open Source Linux
Jun 30, 2025 · Backend Development

How to Split Nginx Architecture into a Scalable Cluster: Database, Web Nodes, and Session Sharing

This guide explains how to break a monolithic LNMP stack into separate components—dedicated MySQL servers, multiple Nginx/PHP web nodes, shared static storage, and session persistence using Redis—while providing step‑by‑step commands, configuration snippets, and best‑practice recommendations for building a reliable, high‑performance Nginx cluster.

ClusterLoad BalancingNginx
0 likes · 18 min read
How to Split Nginx Architecture into a Scalable Cluster: Database, Web Nodes, and Session Sharing
ITFLY8 Architecture Home
ITFLY8 Architecture Home
May 28, 2025 · Databases

Mastering Database Sharding: Design Strategies and Practical Cases

This article introduces the fundamentals of database sharding, outlines architectural evolution, explains vertical and horizontal splitting dimensions and strategies, discusses middleware choices, and presents real‑world case studies while addressing common challenges such as ID generation, join queries, pagination, and distributed transactions.

MiddlewareTransaction Managementdatabase sharding
0 likes · 8 min read
Mastering Database Sharding: Design Strategies and Practical Cases
Java Captain
Java Captain
May 14, 2025 · Databases

Guide to Setting Up ShardingSphere with Docker for Database Sharding, Read‑Write Splitting, and SpringBoot Integration

This guide demonstrates how to set up Docker‑based MySQL instances, configure ShardingSphere‑Proxy for database sharding and read‑write splitting, and integrate ShardingSphere‑JDBC with SpringBoot 2.x using YAML configurations and Maven dependencies, providing complete code snippets and default connection details.

DockerMySQLShardingSphere
0 likes · 11 min read
Guide to Setting Up ShardingSphere with Docker for Database Sharding, Read‑Write Splitting, and SpringBoot Integration
Selected Java Interview Questions
Selected Java Interview Questions
Feb 14, 2025 · Databases

ShardingSphere Overview and Spring Boot Integration for Database Sharding, Proxy, and Sidecar

This article introduces ShardingSphere's three components—Sharding-JDBC, Sharding-Proxy, and the upcoming Sharding-Sidecar—explains why sharding is needed for relational databases, demonstrates horizontal data sharding concepts, and provides a complete Spring Boot example with configuration, code, and asynchronous batch insertion.

Async ProcessingMySQLShardingSphere
0 likes · 17 min read
ShardingSphere Overview and Spring Boot Integration for Database Sharding, Proxy, and Sidecar
Su San Talks Tech
Su San Talks Tech
Feb 13, 2025 · Databases

Master ShardingSphere: 12 Sharding Strategies & Algorithms Explained

This comprehensive guide walks through ShardingSphere's core sharding strategies and the twelve built‑in sharding algorithms, showing how to configure each with YAML, illustrating their behavior with code examples, and highlighting practical tips for choosing the right approach in real‑world database partitioning scenarios.

Sharding AlgorithmsShardingSphereSpring Boot
0 likes · 29 min read
Master ShardingSphere: 12 Sharding Strategies & Algorithms Explained
21CTO
21CTO
Feb 9, 2025 · Databases

How Notion Scaled PostgreSQL with Database Sharding

Notion tackled severe PostgreSQL performance limits by sharding its Block table and related tables across 480 logical shards on 32 physical databases, using workspace IDs as shard keys, a dual‑write migration, and rigorous validation to achieve near‑zero downtime and faster response times.

Backend ArchitectureMigrationPostgreSQL
0 likes · 7 min read
How Notion Scaled PostgreSQL with Database Sharding
Architect's Guide
Architect's Guide
Jan 24, 2025 · Backend Development

How to Design a High-Concurrency System: Key Architectural Strategies for Interviews

This article explains how to answer interview questions about designing high‑concurrency systems by outlining essential architectural techniques such as system decomposition, caching, message queues, database sharding, read‑write separation, and Elasticsearch, while emphasizing practical considerations and real‑world complexity.

System Designdatabase shardinghigh concurrency
0 likes · 9 min read
How to Design a High-Concurrency System: Key Architectural Strategies for Interviews
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 30, 2024 · Backend Development

How to Define and Tackle High Concurrency: Strategies and Code Samples

This article explains what constitutes high concurrency, categorizes load levels, and presents practical solutions such as load balancing, database sharding, query optimization, caching, message queues, and rate‑limiting, complete with code examples for implementing these techniques in backend systems.

Load BalancingQuery Optimizationdatabase sharding
0 likes · 7 min read
How to Define and Tackle High Concurrency: Strategies and Code Samples
Top Architect
Top Architect
Oct 4, 2024 · Databases

Design and Implementation of Table Sharding for Loan and Repayment Applications Using ShardingSphere and Spring Boot

The article describes a year‑long development experience where a senior architect designs, plans, and implements a sharding solution for loan and repayment tables using ShardingSphere, Spring Boot 3, MySQL, and custom synchronization code to migrate billions of rows while ensuring data consistency and operational continuity.

MySQLShardingSphereSpringBoot
0 likes · 25 min read
Design and Implementation of Table Sharding for Loan and Repayment Applications Using ShardingSphere and Spring Boot
Selected Java Interview Questions
Selected Java Interview Questions
Jun 25, 2024 · Databases

Design and Implementation of Table Sharding for Cash Repayment Applications Using ShardingSphere and Spring Boot

This article details the end‑to‑end design, configuration, and code implementation of a 50‑table sharding solution for cash repayment and loan application data, covering database schema planning, historical data migration, backend query adaptation, dynamic switches, scheduled consistency checks, and practical pitfalls encountered with Spring Boot 3 and ShardingSphere.

MySQLShardingSphereSpringBoot
0 likes · 22 min read
Design and Implementation of Table Sharding for Cash Repayment Applications Using ShardingSphere and Spring Boot
ITPUB
ITPUB
Jun 16, 2024 · Databases

When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas

This article explains why database sharding is needed, how to identify performance bottlenecks, and provides step‑by‑step guidance on SQL tuning, table redesign, architectural changes, and practical horizontal and vertical sharding techniques with real‑world e‑commerce examples.

MySQLVertical Shardingarchitecture
0 likes · 13 min read
When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas
Architect
Architect
Jun 12, 2024 · Backend Development

Scaling a Consumer‑Goods Business Platform to 10M Daily Calls with SpringBoot, Kong, and K8s

The article details a real‑world case study of building and operating a high‑traffic business middle‑platform for a leading consumer‑goods company, covering business and technical architecture, API gateway selection, SpringBoot microservices, custom MyBatis, logging, SSL, Docker, MyCat sharding, K8s deployment, CI/CD pipeline, and monitoring solutions.

DevOpsDockerKong
0 likes · 19 min read
Scaling a Consumer‑Goods Business Platform to 10M Daily Calls with SpringBoot, Kong, and K8s
Top Architect
Top Architect
Jun 10, 2024 · Databases

Understanding Database Sharding: When and How to Split Databases and Tables

The article explains why and when to apply database sharding and table partitioning, illustrates real‑world growth scenarios, compares horizontal and vertical splitting methods, reviews common sharding middleware such as Cobar, TDDL, Atlas, Sharding‑jdbc (ShardingSphere) and Mycat, and offers practical recommendations for different company sizes.

Horizontal PartitioningMiddlewaredatabase sharding
0 likes · 14 min read
Understanding Database Sharding: When and How to Split Databases and Tables
dbaplus Community
dbaplus Community
Jun 6, 2024 · Backend Development

Designing a Billion-User Social Platform: Architecture, Scaling, and Reliability Strategies

This article presents a comprehensive, step‑by‑step guide to building large‑scale backend systems—including microservice decomposition, CDN and cache layers, message queues, database sharding, read/write splitting, Elasticsearch search, distributed transaction handling, multithreaded data migration, and massive counting services—illustrated with real‑world examples and practical metrics.

System Designcachingcounting service
0 likes · 16 min read
Designing a Billion-User Social Platform: Architecture, Scaling, and Reliability Strategies
Su San Talks Tech
Su San Talks Tech
Apr 19, 2024 · Backend Development

Distributed Primary Keys in ShardingSphere: Strategies & Custom Implementations

This article explores why distributed primary keys are essential for sharding, compares built‑in ShardingSphere ID generation strategies such as UUID, NanoID, Snowflake, CosId and custom algorithms, details their configuration, performance trade‑offs, and provides code examples for implementing and registering custom key generators.

ShardingSpherecustom algorithmdatabase sharding
0 likes · 17 min read
Distributed Primary Keys in ShardingSphere: Strategies & Custom Implementations
Sohu Tech Products
Sohu Tech Products
Apr 10, 2024 · Databases

ShardingSphere-JDBC Database Sharding Tutorial Project

The tutorial project showcases how to implement database sharding with ShardingSphere-JDBC (versions 4 and 5) in a SpringBoot O2O order service, providing modules for sharding, a gRPC ID generator, detailed configuration of four data sources, sharding algorithms, and Swagger-based testing of order creation and queries.

Database ScalingShardingSphere-JDBCSpringBoot
0 likes · 5 min read
ShardingSphere-JDBC Database Sharding Tutorial Project
Architect
Architect
Mar 29, 2024 · Databases

Understanding Database Sharding and Partitioning with ShardingSphere

This article explains the fundamentals of database sharding and partitioning, why they are needed for massive data volumes, various vertical and horizontal splitting strategies, routing algorithms, client vs. proxy deployment models, and the practical challenges and solutions when using ShardingSphere 5.x.

MySQLPartitioningShardingSphere
0 likes · 17 min read
Understanding Database Sharding and Partitioning with ShardingSphere
Sanyou's Java Diary
Sanyou's Java Diary
Feb 22, 2024 · Backend Development

10 Proven Techniques to Supercharge Backend API Performance

This article presents a comprehensive guide for backend developers, covering ten practical techniques—including local and distributed caching, parallel execution, asynchronous processing, connection pooling, sharding, SQL tuning, pre‑computation, batch operations, lock granularity, and context propagation—to dramatically improve API performance.

SQL Tuningbackendcaching
0 likes · 13 min read
10 Proven Techniques to Supercharge Backend API Performance
Su San Talks Tech
Su San Talks Tech
Dec 30, 2023 · Backend Development

How to Build a Scalable Dating App Backend: Architecture, Algorithms, and Performance Tips

This article explores the end‑to‑end design of a modern dating platform, covering requirement analysis, micro‑service architecture, gateway routing, sharded MySQL, CDN caching, matchmaking, recommendation scoring, high‑concurrency strategies, load balancing, database optimization, message queues, and spatial proximity algorithms such as grid, quadtree, and GeoHash.

Load Balancingcachingdatabase sharding
0 likes · 18 min read
How to Build a Scalable Dating App Backend: Architecture, Algorithms, and Performance Tips
macrozheng
macrozheng
Dec 6, 2023 · Databases

When and How to Implement Database Sharding and Partitioning for High‑Scale Systems

This article explains why database sharding and partitioning become necessary, outlines performance bottlenecks, presents software and hardware optimization techniques, details horizontal and vertical splitting strategies, and discusses the added complexity such as cross‑database joins, distributed transactions, and ID generation.

SQL OptimizationTable Partitioningdatabase sharding
0 likes · 13 min read
When and How to Implement Database Sharding and Partitioning for High‑Scale Systems
dbaplus Community
dbaplus Community
Nov 2, 2023 · Databases

Scaling a Ride‑Hailing Order System: From Single SQLServer to Sharded MySQL

This article recounts the step‑by‑step evolution of a ride‑hailing order service’s data layer—from a single SQLServer database through SQL optimization, read‑write splitting, business‑domain sharding, caching and MQ integration, to a custom sharding component and smooth migration to MySQL—highlighting challenges, solutions, and lessons learned.

Data MigrationMessage QueueMySQL
0 likes · 15 min read
Scaling a Ride‑Hailing Order System: From Single SQLServer to Sharded MySQL
Open Source Linux
Open Source Linux
Oct 25, 2023 · Operations

Scaling Servers for Millions: Load Balancing, Sharding, CDN Strategies

This guide explains how to design and expand server infrastructure to handle millions of concurrent users by using load balancers, database sharding, caching, CDNs, hardware selection criteria, and redundancy techniques, ensuring high availability and performance 24/7.

CDNLoad Balancingdatabase sharding
0 likes · 11 min read
Scaling Servers for Millions: Load Balancing, Sharding, CDN Strategies
Top Architect
Top Architect
Oct 17, 2023 · Backend Development

Evolution of E‑commerce System Architecture: From Monolithic to Unitized Design

This article outlines the progressive architectural evolution of an e‑commerce platform, describing how increasing traffic drives the transition from a single‑module monolith through horizontal scaling, read/write separation, sharding, CDN caching, dual‑datacenter deployment, and finally to a unit‑based micro‑service architecture.

backend developmentdatabase shardinge-commerce
0 likes · 9 min read
Evolution of E‑commerce System Architecture: From Monolithic to Unitized Design
Top Architect
Top Architect
Oct 7, 2023 · Backend Development

Evolution of E-commerce System Architecture

This article outlines the progressive evolution of e‑commerce system architecture from a monolithic 1.0 design through layered scaling, read/write separation, CDN caching, sharding, and finally unit‑based modularization, highlighting the performance bottlenecks and solutions at each stage.

CDNbackend scalingdatabase sharding
0 likes · 9 min read
Evolution of E-commerce System Architecture
Tencent Cloud Developer
Tencent Cloud Developer
Sep 20, 2023 · Operations

Storage Governance and Optimization Practices for Meeting Control Systems

The article explains how a meeting control system tackled severe storage pressure from high concurrent traffic by introducing a proxy layer, multi‑active disaster‑recovery, identity‑based data isolation, dynamic‑static key separation, multi‑level caching, overload protection, sharding with dual‑write migration, and extensive monitoring to meet 100k QPS and ensure reliability.

Disaster RecoveryRedisdatabase sharding
0 likes · 49 min read
Storage Governance and Optimization Practices for Meeting Control Systems
JD Tech
JD Tech
Aug 25, 2023 · Databases

Reducing Sharding-JDBC Database Connection Count: Analysis and Custom Partitioning Optimization

This article examines the high connection‑count problem of Sharding-JDBC in JD Logistics, explains sharding concepts, compares four mitigation strategies, and presents a custom table‑partitioning algorithm with configuration changes that dramatically lowers MySQL instance connections while maintaining performance.

Connection PoolingCustom Sharding AlgorithmMySQL
0 likes · 16 min read
Reducing Sharding-JDBC Database Connection Count: Analysis and Custom Partitioning Optimization
JD Cloud Developers
JD Cloud Developers
Jul 27, 2023 · Databases

Scaling MySQL at JD Logistics with ShardingSphere: Refactoring Sharding-JDBC

This article examines how JD Logistics tackled MySQL connection limits by redesigning its sharding strategy using ShardingSphere's Sharding-JDBC, detailing the background, concepts of database and table sharding, analysis of bottlenecks, and step‑by‑step refactoring to reduce connections and improve scalability.

MySQLSharding-JDBCShardingSphere
0 likes · 16 min read
Scaling MySQL at JD Logistics with ShardingSphere: Refactoring Sharding-JDBC
Su San Talks Tech
Su San Talks Tech
Jul 6, 2023 · Databases

Master ShardingSphere: Quick Sharding with Spring Boot and YML

This tutorial walks through the fundamentals and architecture of ShardingSphere, compares it with other sharding tools, and demonstrates how to implement database sharding in a Spring Boot project using both YML configuration and pure Java code, including detailed code snippets and deployment tips.

ShardingShardingSphereSpring Boot
0 likes · 22 min read
Master ShardingSphere: Quick Sharding with Spring Boot and YML
Architect's Guide
Architect's Guide
Jun 20, 2023 · Databases

Why and How to Perform Database Sharding and Table Partitioning

Database sharding and table partitioning are essential scaling techniques that separate data across multiple databases and tables to handle growing user volume, data size, and concurrency, with explanations of when to split, methods (horizontal vs vertical), and a comparison of popular middleware solutions.

MiddlewareTable Partitioningdatabase sharding
0 likes · 14 min read
Why and How to Perform Database Sharding and Table Partitioning
dbaplus Community
dbaplus Community
Jun 11, 2023 · Databases

Splitting a 500‑Million‑Row MySQL Table: Practical Sharding‑JDBC Lessons

Facing a MySQL transaction table exceeding 50 million rows and growing rapidly, a finance team redesigned the schema using sharding‑jdbc, chose transaction time as the shard key, tackled multi‑data‑source transactions and cross‑shard pagination, and executed a phased migration to ensure stability and performance.

Data MigrationLarge TablesMySQL
0 likes · 11 min read
Splitting a 500‑Million‑Row MySQL Table: Practical Sharding‑JDBC Lessons
ITPUB
ITPUB
Jun 4, 2023 · Databases

When to Shard Databases and How to Do It Effectively

This article explains why database sharding is needed when performance bottlenecks appear, outlines the criteria and timing for adopting sharding, and provides detailed step‑by‑step guidance on both database‑level and table‑level partitioning, including common pitfalls and solutions.

Horizontal Partitioningdatabase shardingid generation
0 likes · 13 min read
When to Shard Databases and How to Do It Effectively
ITPUB
ITPUB
May 21, 2023 · Databases

Mastering Database Sharding: When, How, and Pitfalls of Partitioning

This article explains the concept, motivations, design methods, common patterns, and trade‑offs of database sharding (both table and database level), offering practical code examples, scalability criteria, and guidance on avoiding over‑engineering while considering alternatives like TiDB.

Hash ShardingPartitioningRange Sharding
0 likes · 19 min read
Mastering Database Sharding: When, How, and Pitfalls of Partitioning
vivo Internet Technology
vivo Internet Technology
Apr 12, 2023 · Backend Development

vivo Transaction Platform: Architecture Design and Key Technical Solutions

The article details vivo’s transition from a monolithic mall to a micro‑service transaction platform, outlining a multi‑tenant architecture with ShardingSphere‑sharded MySQL, Snowflake IDs, Elasticsearch search, configurable state machines, generic delayed tasks, Seata and local‑message distributed transactions, plus high‑availability safeguards, emphasizing pragmatic solution selection.

High AvailabilityMulti-Tenant ArchitectureSeata
0 likes · 11 min read
vivo Transaction Platform: Architecture Design and Key Technical Solutions
ITPUB
ITPUB
Apr 1, 2023 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

Learn why large-scale internet applications need database sharding, understand the evolution from single databases to split databases and tables, and follow practical steps for assessing, planning, and implementing horizontal and vertical sharding, including sizing calculations, key selection, and query challenges.

Data PartitioningHorizontal ShardingVertical Sharding
0 likes · 14 min read
Mastering Database Sharding: When and How to Split Databases and Tables
Code Ape Tech Column
Code Ape Tech Column
Mar 27, 2023 · Databases

Horizontal Database Scaling Strategies and Practical Implementation with MariaDB, Keepalived, and ShardingJDBC

This article explains how to expand a sharded database from three to four nodes, compares five migration schemes—including stop‑service, stop‑write, log‑based, dual‑write, and smooth 2N approaches—and provides step‑by‑step instructions for MariaDB installation, master‑slave configuration, Keepalived high‑availability setup, and dynamic data‑source integration using ShardingJDBC.

High AvailabilityKeepalivedMariaDB
0 likes · 33 min read
Horizontal Database Scaling Strategies and Practical Implementation with MariaDB, Keepalived, and ShardingJDBC
dbaplus Community
dbaplus Community
Mar 22, 2023 · Databases

Scaling an Airline Ticket Order Database: From Monolith to 64‑Shard Sharding

The article details how a rapidly growing airline ticket order system was re‑architected by identifying performance bottlenecks, applying vertical and horizontal sharding, optimizing cache layers, implementing dual‑write mechanisms, and planning a phased migration to achieve ten‑fold QPS growth while reducing resource usage and operational risk.

Cache OptimizationMySQLdatabase sharding
0 likes · 38 min read
Scaling an Airline Ticket Order Database: From Monolith to 64‑Shard Sharding
21CTO
21CTO
Mar 12, 2023 · Databases

Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices

Database sharding—splitting data across multiple databases and tables—is essential as applications scale, and this article explains the motivations, differences between sharding and partitioning, horizontal and vertical splits, common middleware options like Cobar, TDDL, Atlas, ShardingSphere, and Mycat, and how to choose the right solution.

Horizontal PartitioningMiddlewareMySQL
0 likes · 12 min read
Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices
JD Retail Technology
JD Retail Technology
Mar 2, 2023 · Databases

Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization

This article details the architectural evolution of JD's VOP message warehouse, describing the challenges of massive data volumes, the transition from V1.0 to V3.0+ through database sharding, MongoDB adoption, traffic governance, stability improvements, and cost reduction strategies, while presenting performance metrics and future outlook.

Message QueueMongoDBbackend systems
0 likes · 17 min read
Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization
Architect
Architect
Dec 30, 2022 · Databases

Database Sharding and Partitioning Strategy for High‑Volume Order Systems

The article explains how to handle billions of daily orders by classifying data into hot and cold segments, storing them in MySQL, Elasticsearch, and Hive, and applying sharding and partitioning techniques at both table and database levels to achieve scalable performance.

Data PartitioningElasticsearchHive
0 likes · 9 min read
Database Sharding and Partitioning Strategy for High‑Volume Order Systems
macrozheng
macrozheng
Nov 25, 2022 · Databases

How We Scaled a Ride‑Hailing Order System: From Single DB to Sharded MySQL

This article chronicles the step‑by‑step evolution of a ride‑hailing order service's data layer, covering the shift from a single SQLServer database to read‑write separation, business‑domain sharding, caching, message queues, a self‑built sharding component, and a data exchange platform for smooth migration and ongoing scalability.

Distributed ArchitectureMySQL Migrationdatabase sharding
0 likes · 14 min read
How We Scaled a Ride‑Hailing Order System: From Single DB to Sharded MySQL
IT Architects Alliance
IT Architects Alliance
Nov 16, 2022 · Backend Development

How to Transform a Simple Blog into a Scalable High‑Traffic System

This article walks through turning a basic personal‑blog architecture—single server, MySQL, and Node.js—into a high‑concurrency system by adding Redis caching, Nginx load balancing, horizontal scaling, read‑write splitting, sharding, NewSQL databases, and message‑queue techniques.

Load BalancingNewSQLbackend
0 likes · 15 min read
How to Transform a Simple Blog into a Scalable High‑Traffic System
政采云技术
政采云技术
Nov 15, 2022 · Databases

Introduction to Sharding-JDBC and ShardingSphere: Architecture, Sharding Strategies, and Quick Integration

This article introduces Sharding-JDBC and ShardingSphere, explains their history, core architecture, vertical and horizontal sharding concepts, sharding rule configuration, SQL parsing and rewriting, routing and result merging, and provides a quick‑start guide with Maven dependencies and Spring Boot configuration for Java applications.

SQLSharding-JDBCShardingSphere
0 likes · 12 min read
Introduction to Sharding-JDBC and ShardingSphere: Architecture, Sharding Strategies, and Quick Integration
IT Architects Alliance
IT Architects Alliance
Oct 7, 2022 · Fundamentals

Eight Common Software Architecture Design Patterns and Their Advantages and Disadvantages

The article introduces eight widely used software architecture design patterns—including single‑database single‑application, content distribution, query separation, microservices, multi‑level caching, sharding, elastic scaling, and multi‑data‑center modes—explaining their structures, typical use cases, and the pros and cons of each.

Design Patternscachingdatabase sharding
0 likes · 20 min read
Eight Common Software Architecture Design Patterns and Their Advantages and Disadvantages
MaGe Linux Operations
MaGe Linux Operations
Oct 3, 2022 · Backend Development

8 Essential Software Architecture Patterns Every Engineer Should Master

This article introduces eight core software architecture design patterns—including single‑database single‑app, content distribution, query separation, microservices, multi‑level caching, sharding, elastic scaling, and multi‑datacenter deployment—explaining their structures, typical use cases, advantages, and drawbacks to help developers choose the right architecture for their systems.

Design Patternsdatabase shardingmicroservices
0 likes · 21 min read
8 Essential Software Architecture Patterns Every Engineer Should Master
Python Programming Learning Circle
Python Programming Learning Circle
Sep 30, 2022 · Databases

Understanding Database Sharding: Reasons, Methods, and Common Challenges

This article explains why database sharding (both vertical and horizontal) is needed to overcome performance bottlenecks, outlines practical thresholds for splitting tables, describes vertical and horizontal partitioning techniques, and discusses key issues such as distributed transactions, cross‑node queries, global primary keys, and scaling strategies.

Horizontal PartitioningVertical Partitioningdatabase sharding
0 likes · 9 min read
Understanding Database Sharding: Reasons, Methods, and Common Challenges
Baidu Geek Talk
Baidu Geek Talk
Sep 21, 2022 · Industry Insights

How Baidu’s Transaction Middle‑Platform Asset System Enables C2C Payments and Guarantees Consistency

This article details the design and implementation of Baidu's transaction middle‑platform asset system, covering its C2C payment model, core asset management capabilities, consistency guarantees, double‑entry accounting, hot‑account handling, sharding and archiving strategies, and compliance with national financial regulations.

Asset ManagementC2C paymentsTransaction Platform
0 likes · 15 min read
How Baidu’s Transaction Middle‑Platform Asset System Enables C2C Payments and Guarantees Consistency
IT Services Circle
IT Services Circle
Sep 5, 2022 · Backend Development

From Chengdu COVID Testing System Crash to High‑Concurrency Architecture: Lessons for Backend Engineers

The article examines the Chengdu COVID‑19 testing system failure, analyzes its root causes such as oversized MySQL tables and insufficient load handling, and then presents a step‑by‑step high‑concurrency roadmap—including single‑machine, service‑database separation, caching, load balancing, read/write splitting, sharding, hardware and DNS load balancing—to help backend developers design scalable systems.

Backend ArchitectureLoad BalancingMySQL
0 likes · 7 min read
From Chengdu COVID Testing System Crash to High‑Concurrency Architecture: Lessons for Backend Engineers
IT Architects Alliance
IT Architects Alliance
Jul 25, 2022 · Backend Development

System Splitting and Architectural Evolution: Strategies for Scaling and Decoupling

To improve capacity and robustness as business complexity grows, this article explains system splitting—including horizontal, vertical, business, and database sharding—and architectural evolution techniques such as caching, indexing, microservices, and service governance, illustrating practical strategies for scalable, resilient backend architectures.

cachingdatabase shardingmicroservices
0 likes · 10 min read
System Splitting and Architectural Evolution: Strategies for Scaling and Decoupling
Top Architect
Top Architect
Jun 30, 2022 · Databases

Database Sharding and Partitioning Strategies with Practical Implementation

This article explains why high‑traffic systems need database sharding, compares table‑level and database‑level partitioning methods, presents concrete MySQL table‑creation scripts and Java service code, and discusses the advantages, drawbacks, and common middleware solutions such as Sharding‑JDBC and Mycat.

MySQLMycatSharding-JDBC
0 likes · 12 min read
Database Sharding and Partitioning Strategies with Practical Implementation
Architecture & Thinking
Architecture & Thinking
Jun 25, 2022 · Databases

Why and How to Split Databases: Vertical & Horizontal Sharding Explained

This article explains the reasons for database sharding, compares vertical (scale‑up) and horizontal (scale‑out) partitioning methods, illustrates vertical database/table splits and horizontal partition strategies such as HASH, RANGE, LIST, KEY and composite, and discusses the challenges like distributed transactions, cross‑database joins and increased management overhead.

Horizontal PartitioningMySQLPartitioning
0 likes · 14 min read
Why and How to Split Databases: Vertical & Horizontal Sharding Explained
Architect's Guide
Architect's Guide
Jun 22, 2022 · Fundamentals

Evolution and Key Concepts of Distributed Architecture

This article traces the historical development of computer architecture from the ENIAC era through mainframes, the rise of distributed systems, and modern scaling techniques such as clustering, replication, middleware, read‑write separation, caching, and service decomposition, illustrating each stage with clear examples and diagrams.

Middlewaredatabase shardingscalability
0 likes · 10 min read
Evolution and Key Concepts of Distributed Architecture
Ctrip Technology
Ctrip Technology
Jun 9, 2022 · Databases

Ctrip Order Database Architecture Optimization and Sharding Case Study

This article details Ctrip's comprehensive redesign of its airline ticket order database, covering the background performance bottlenecks, vertical and hot‑cold data splitting, sharding key selection, multi‑level caching, cross‑shard query optimization, dual‑write mechanisms, fault‑tolerance strategies, project planning, and the resulting improvements in scalability and cost.

Fault Tolerancedatabase shardingdual write
0 likes · 37 min read
Ctrip Order Database Architecture Optimization and Sharding Case Study
macrozheng
macrozheng
May 11, 2022 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

This article explains the concepts of database and table sharding, why they are needed, various vertical and horizontal splitting strategies, range and hash partitioning methods, their advantages and drawbacks, timing considerations, common challenges such as transactions and distributed IDs, and introduces popular sharding middleware.

Horizontal PartitioningVertical Partitioningdatabase sharding
0 likes · 12 min read
Mastering Database Sharding: When and How to Split Databases and Tables
Code Ape Tech Column
Code Ape Tech Column
May 9, 2022 · Databases

Sharding-JDBC Advanced Guide: Configuration and Practical Implementation

This article provides a comprehensive guide to Sharding-JDBC, covering the challenges of database sharding such as distributed transactions, cross‑node joins, pagination, global key collisions, and demonstrates practical configuration and code examples for vertical and horizontal partitioning using Spring Boot.

Horizontal PartitioningSharding-JDBCSpring Boot
0 likes · 18 min read
Sharding-JDBC Advanced Guide: Configuration and Practical Implementation
IT Architects Alliance
IT Architects Alliance
Apr 11, 2022 · Backend Development

Evolution of Server‑Side Architecture: From Single‑Machine Deployment to Cloud‑Native Microservices

This article uses Taobao as a case study to trace the step‑by‑step evolution of a high‑traffic backend system—from a single‑machine setup through caching, load balancing, database sharding, microservices, ESB, containerization, and finally cloud‑native deployment—while highlighting the key technologies and design principles at each stage.

architecturecachingcloud
0 likes · 20 min read
Evolution of Server‑Side Architecture: From Single‑Machine Deployment to Cloud‑Native Microservices
IT Architects Alliance
IT Architects Alliance
Mar 27, 2022 · Backend Development

From a Simple MVP Monolith to a Complex Distributed Architecture: Taobao Case Study

This article walks through the step‑by‑step evolution of a basic single‑server e‑commerce system into a large‑scale, distributed architecture, explaining core concepts, each architectural upgrade, the technologies involved, and key design principles for building scalable, high‑availability services.

Cloud Computingarchitecturedatabase sharding
0 likes · 20 min read
From a Simple MVP Monolith to a Complex Distributed Architecture: Taobao Case Study
Top Architect
Top Architect
Mar 25, 2022 · Backend Development

Design and Architecture of Baidu Transaction Middleware Order System

This article explains the business model, capabilities, service types, order lifecycle, and detailed architectural evolution of Baidu's transaction middle‑platform order system, covering instruction orchestration, performance optimizations such as caching, async execution, ThreadLocal handling, and database sharding for high‑throughput scenarios.

Backend Architecturedatabase shardingdistributed systems
0 likes · 15 min read
Design and Architecture of Baidu Transaction Middleware Order System
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Mar 19, 2022 · Backend Development

How Taobao Scaled to Millions of Concurrent Users: Architecture Evolution

This article walks through Taobao’s journey from a single‑server setup to a cloud‑native, micro‑service architecture capable of handling tens of millions of concurrent requests, explaining each scaling step, the technologies involved, and key design principles for high‑availability systems.

Cloud ComputingLoad Balancingdatabase sharding
0 likes · 20 min read
How Taobao Scaled to Millions of Concurrent Users: Architecture Evolution
IT Architects Alliance
IT Architects Alliance
Mar 2, 2022 · Operations

Designing a Scalable Architecture for Million‑to‑Billion‑Level DAU Systems

The article outlines a comprehensive, multi‑layer architecture—including DNS routing, L4/L7 load balancing, micro‑service or monolithic deployment, caching, database sharding, hybrid‑cloud deployment, elastic scaling, and tiered degradation—to reliably support systems handling from millions to billions of daily active users under sudden traffic spikes.

cachingdatabase shardinghigh‑traffic
0 likes · 12 min read
Designing a Scalable Architecture for Million‑to‑Billion‑Level DAU Systems
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Feb 26, 2022 · Backend Development

How to Build a Scalable Million‑DAU Backend Architecture with Hybrid Cloud

This article outlines a comprehensive architecture for handling millions of daily active users, covering DNS routing, four‑layer and seven‑layer load balancing, monolithic versus microservice deployment, caching, database sharding, hybrid‑cloud strategies, full‑link elastic scaling, and a three‑tier degradation mechanism to ensure resilience under sudden traffic spikes.

Load BalancingScalable Systemsdatabase sharding
0 likes · 11 min read
How to Build a Scalable Million‑DAU Backend Architecture with Hybrid Cloud
HelloTech
HelloTech
Feb 21, 2022 · Databases

Database Sharding: Partitioning Strategies, Consistent Hashing, SQL Rewrite, and Merge Engine

Database sharding improves performance by partitioning tables vertically or horizontally and routing rows with consistent hashing, while ShardingJDBC rewrites SQL for physical tables, adds missing columns, corrects pagination, splits batch inserts, and merges results using sorting, grouping, aggregation, and pagination engines.

Horizontal PartitioningMERGE engineSQL Rewrite
0 likes · 15 min read
Database Sharding: Partitioning Strategies, Consistent Hashing, SQL Rewrite, and Merge Engine
IT Architects Alliance
IT Architects Alliance
Feb 4, 2022 · Backend Development

Designing a Scalable Architecture for Million‑Level DAU Systems

The article outlines a comprehensive backend architecture for handling million‑to‑tens‑of‑million daily active users, covering DNS routing, L4/L7 load balancing, monolithic versus microservice deployment, caching, database sharding, hybrid‑cloud strategies, elastic scaling, and multi‑level degradation mechanisms.

Elastic ScalingLoad Balancingdatabase sharding
0 likes · 11 min read
Designing a Scalable Architecture for Million‑Level DAU Systems
IT Architects Alliance
IT Architects Alliance
Jan 8, 2022 · Backend Development

From a Simple MVP Monolith to a Complex Distributed Architecture: Taobao Case Study

This article walks through the step‑by‑step evolution of a basic single‑server MVP architecture into a large‑scale distributed system, using a simulated Taobao example to illustrate ten‑plus architectural stages, key technologies, design principles, and the eventual shift to cloud‑native microservices.

Cloud Computingarchitecturedatabase sharding
0 likes · 20 min read
From a Simple MVP Monolith to a Complex Distributed Architecture: Taobao Case Study
Architecture Digest
Architecture Digest
Dec 3, 2021 · Backend Development

Design Practices for a Billion‑Scale User Center

This article presents a comprehensive set of design practices for building a highly available, high‑performance, and secure user‑center system that can handle hundreds of millions of users, covering service architecture, API design, token degradation, data sharding, security, asynchronous processing, and monitoring.

Monitoringdatabase shardingscalability
0 likes · 15 min read
Design Practices for a Billion‑Scale User Center
dbaplus Community
dbaplus Community
Nov 29, 2021 · Backend Development

How to Build a High‑Concurrency System: Real‑World Practices from a Delivery Platform

This article shares practical experience on designing and operating a high‑concurrency order‑delivery system, covering infrastructure choices, database scaling techniques such as read‑write separation and sharding, architectural patterns like caching, message queues and service governance, as well as application‑level optimizations including compensation, idempotency, async processing and warm‑up strategies.

IdempotencyService Governancecaching
0 likes · 34 min read
How to Build a High‑Concurrency System: Real‑World Practices from a Delivery Platform
IT Architects Alliance
IT Architects Alliance
Nov 26, 2021 · Operations

Large-Scale Distributed Website Architecture: Principles, Patterns, and Practices

This article provides a comprehensive technical summary of large‑scale distributed website architecture, covering characteristics, goals, architectural patterns, performance, high‑availability, scalability, extensibility, security, agility, and a detailed evolution roadmap with practical examples and recommendations.

High AvailabilityLoad Balancingarchitecture
0 likes · 22 min read
Large-Scale Distributed Website Architecture: Principles, Patterns, and Practices
IT Architects Alliance
IT Architects Alliance
Nov 19, 2021 · Backend Development

Technical Summary of Large‑Scale Distributed Website Architecture

This article provides a comprehensive overview of the design principles, architectural patterns, performance, availability, scalability, security, and operational considerations for building large distributed web sites, illustrated with a step‑by‑step evolution from a single‑server setup to a multi‑layer, cloud‑native architecture.

High AvailabilityLoad Balancingcaching
0 likes · 22 min read
Technical Summary of Large‑Scale Distributed Website Architecture
Laravel Tech Community
Laravel Tech Community
Oct 26, 2021 · Databases

Understanding Ant Financial’s LDC Architecture: Unitization, CAP Analysis, and OceanBase Design

The article explains how Ant Financial scales Double‑11 payment traffic to hundreds of thousands of TPS by employing logical data centers (LDC), unit‑based system design (RZone, GZone, CZone), database sharding, CAP theorem analysis, Paxos‑based consensus, and the OceanBase distributed database, while also detailing disaster‑recovery and traffic‑shifting mechanisms.

CAP theoremHigh TPSOceanBase
0 likes · 35 min read
Understanding Ant Financial’s LDC Architecture: Unitization, CAP Analysis, and OceanBase Design