BestHub
Sign in
Tagged articles
60 articles
Page 1 of 1
Su San Talks Tech
Su San Talks Tech
Dec 11, 2025 · Databases

How to Scale a 900 M‑Row Message Table to 60 B Rows Without Downtime

This article details a comprehensive sharding strategy for a high‑traffic message table, explaining why early partitioning is essential, how to design language‑based vertical shards combined with hash‑based horizontal shards, calculate table counts and virtual nodes, and execute a zero‑downtime migration using dual‑writes and gradual traffic rollout.

horizontal partitioningmysqlperformance optimization
0 likes · 16 min read
How to Scale a 900 M‑Row Message Table to 60 B Rows Without Downtime
macrozheng
macrozheng
Sep 19, 2025 · Databases

Master Database Sharding: Solving Read Diffusion with Range and Modulo Strategies

This article explains why large MySQL tables degrade performance, introduces vertical and horizontal sharding techniques—including range‑based and modulo‑based partitioning—covers the read‑diffusion problem caused by non‑sharding keys, and presents practical solutions such as auxiliary index tables, Elasticsearch integration, and TiDB as a distributed alternative.

ElasticsearchRange ShardingTiDB
0 likes · 15 min read
Master Database Sharding: Solving Read Diffusion with Range and Modulo Strategies
Architect's Guide
Architect's Guide
Sep 10, 2025 · Databases

Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices

This article explains why database sharding becomes essential as user growth and data volume surge, describes horizontal and vertical partitioning methods, compares range and hash routing, and reviews popular sharding middleware with their advantages and drawbacks to help you choose the right solution.

ScalabilityVertical Partitioningdatabase sharding
0 likes · 12 min read
Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 13, 2025 · Databases

Mastering Data Sharding: Vertical & Horizontal Splitting Strategies for Scalable Systems

This article explains essential data sharding techniques for large-scale architectures, emphasizing the priority of vertical splitting by business modules, followed by horizontal partitioning of hot tables, and outlines stable sharding rules, hotspot avoidance, and minimizing cross‑shard transactions to ensure optimal performance.

Database designdata shardinghorizontal partitioning
0 likes · 4 min read
Mastering Data Sharding: Vertical & Horizontal Splitting Strategies for Scalable Systems
Top Architect
Top Architect
Jun 10, 2024 · Databases

Understanding Database Sharding: When and How to Split Databases and Tables

The article explains why and when to apply database sharding and table partitioning, illustrates real‑world growth scenarios, compares horizontal and vertical splitting methods, reviews common sharding middleware such as Cobar, TDDL, Atlas, Sharding‑jdbc (ShardingSphere) and Mycat, and offers practical recommendations for different company sizes.

database shardinghorizontal partitioningmiddleware
0 likes · 14 min read
Understanding Database Sharding: When and How to Split Databases and Tables
Su San Talks Tech
Su San Talks Tech
Mar 29, 2024 · Databases

Master ShardingSphere: Hands‑On Sharding‑JDBC Sharding & Partitioning Guide

This article provides a comprehensive, step‑by‑step tutorial on using Apache ShardingSphere and Sharding‑JDBC to implement horizontal, vertical, and broadcast sharding, covering core concepts, sharding strategies, configuration examples, and practical code snippets for real‑world database partitioning.

Broadcast TableSharding-JDBCShardingSphere
0 likes · 22 min read
Master ShardingSphere: Hands‑On Sharding‑JDBC Sharding & Partitioning Guide
ITPUB
ITPUB
Jun 4, 2023 · Databases

When to Shard Databases and How to Do It Effectively

This article explains why database sharding is needed when performance bottlenecks appear, outlines the criteria and timing for adopting sharding, and provides detailed step‑by‑step guidance on both database‑level and table‑level partitioning, including common pitfalls and solutions.

ID generationdatabase shardinghorizontal partitioning
0 likes · 13 min read
When to Shard Databases and How to Do It Effectively
Su San Talks Tech
Su San Talks Tech
Mar 14, 2023 · Databases

How to Solve Read‑Amplification in MySQL Sharding: Strategies & Tips

This article explains the concepts of database sharding, compares vertical and horizontal partitioning, discusses ID‑range and modulo sharding methods, analyzes the read‑amplification problem caused by non‑sharding keys, and presents practical solutions such as auxiliary index tables, Elasticsearch integration, and TiDB adoption.

ElasticsearchTiDBdatabase scaling
0 likes · 14 min read
How to Solve Read‑Amplification in MySQL Sharding: Strategies & Tips
21CTO
21CTO
Mar 12, 2023 · Databases

Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices

Database sharding—splitting data across multiple databases and tables—is essential as applications scale, and this article explains the motivations, differences between sharding and partitioning, horizontal and vertical splits, common middleware options like Cobar, TDDL, Atlas, ShardingSphere, and Mycat, and how to choose the right solution.

Scalabilitydatabase shardinghorizontal partitioning
0 likes · 12 min read
Why and How to Implement Database Sharding: Strategies, Middleware, and Best Practices
MaGe Linux Operations
MaGe Linux Operations
Feb 22, 2023 · Databases

Mastering MySQL Sharding: When and How to Use Database Partitioning

This article explains the concepts, strategies, and practical scenarios for MySQL database partitioning, covering both table splitting (vertical and horizontal) and database splitting (vertical and horizontal), with examples, advantages, and when to apply each technique to handle large-scale data workloads.

ScalabilityVertical Partitioningdatabase partitioning
0 likes · 9 min read
Mastering MySQL Sharding: When and How to Use Database Partitioning
ITPUB
ITPUB
Nov 29, 2022 · Databases

When MySQL Hits Its Limits: Scaling with Horizontal and Vertical Sharding

This article explains MySQL's theoretical row limits, why performance degrades long before reaching them, and how horizontal and vertical database sharding can distribute massive datasets across multiple instances to improve load handling and enable seamless scaling.

Vertical Partitioninghorizontal partitioningmysql
0 likes · 7 min read
When MySQL Hits Its Limits: Scaling with Horizontal and Vertical Sharding
Python Programming Learning Circle
Python Programming Learning Circle
Sep 30, 2022 · Databases

Understanding Database Sharding: Reasons, Methods, and Common Challenges

This article explains why database sharding (both vertical and horizontal) is needed to overcome performance bottlenecks, outlines practical thresholds for splitting tables, describes vertical and horizontal partitioning techniques, and discusses key issues such as distributed transactions, cross‑node queries, global primary keys, and scaling strategies.

Distributed TransactionsScalabilityVertical Partitioning
0 likes · 9 min read
Understanding Database Sharding: Reasons, Methods, and Common Challenges
Architecture & Thinking
Architecture & Thinking
Jun 25, 2022 · Databases

Why and How to Split Databases: Vertical & Horizontal Sharding Explained

This article explains the reasons for database sharding, compares vertical (scale‑up) and horizontal (scale‑out) partitioning methods, illustrates vertical database/table splits and horizontal partition strategies such as HASH, RANGE, LIST, KEY and composite, and discusses the challenges like distributed transactions, cross‑database joins and increased management overhead.

PartitioningVertical Partitioningdatabase sharding
0 likes · 14 min read
Why and How to Split Databases: Vertical & Horizontal Sharding Explained
macrozheng
macrozheng
May 11, 2022 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

This article explains the concepts of database and table sharding, why they are needed, various vertical and horizontal splitting strategies, range and hash partitioning methods, their advantages and drawbacks, timing considerations, common challenges such as transactions and distributed IDs, and introduces popular sharding middleware.

Distributed TransactionsVertical Partitioningdatabase sharding
0 likes · 12 min read
Mastering Database Sharding: When and How to Split Databases and Tables
Code Ape Tech Column
Code Ape Tech Column
May 9, 2022 · Databases

Sharding-JDBC Advanced Guide: Configuration and Practical Implementation

This article provides a comprehensive guide to Sharding-JDBC, covering the challenges of database sharding such as distributed transactions, cross‑node joins, pagination, global key collisions, and demonstrates practical configuration and code examples for vertical and horizontal partitioning using Spring Boot.

Distributed TransactionsSharding-JDBCSpring Boot
0 likes · 18 min read
Sharding-JDBC Advanced Guide: Configuration and Practical Implementation
HelloTech
HelloTech
Feb 21, 2022 · Databases

Database Sharding: Partitioning Strategies, Consistent Hashing, SQL Rewrite, and Merge Engine

Database sharding improves performance by partitioning tables vertically or horizontally and routing rows with consistent hashing, while ShardingJDBC rewrites SQL for physical tables, adds missing columns, corrects pagination, splits batch inserts, and merges results using sorting, grouping, aggregation, and pagination engines.

MERGE engineSQL RewriteVertical Partitioning
0 likes · 15 min read
Database Sharding: Partitioning Strategies, Consistent Hashing, SQL Rewrite, and Merge Engine
dbaplus Community
dbaplus Community
Nov 18, 2021 · Databases

When Should You Split Your Database Tables? Practical Guidelines and Real‑World Cases

This article examines the signs that a database table has reached its limits, explains why vertical and horizontal sharding are needed, offers concrete sizing formulas, compares hash, range and consistent‑hash partitioning, and shares large‑scale case studies from Suning, JD, Meituan, Ant Financial and Taobao.

Distributed Transactionshorizontal partitioninglarge-scale systems
0 likes · 14 min read
When Should You Split Your Database Tables? Practical Guidelines and Real‑World Cases
Wukong Talks Architecture
Wukong Talks Architecture
Nov 10, 2021 · Databases

Understanding Database Sharding: Vertical and Horizontal Partitioning Strategies

This article explains why and how to apply vertical (business‑oriented) and horizontal (data‑oriented) sharding, covering single‑database, table splitting, database splitting, combined sharding, read‑write separation, routing algorithms, and real‑world case studies to improve scalability and performance.

Read-Write SeparationScalabilityVertical Partitioning
0 likes · 14 min read
Understanding Database Sharding: Vertical and Horizontal Partitioning Strategies
Top Architect
Top Architect
Nov 6, 2021 · Databases

Understanding Database Sharding: Partitioning Strategies and When to Use Them

This article explains the concepts, characteristics, and practical scenarios of database sharding—including vertical and horizontal table partitioning as well as vertical and horizontal database partitioning—helping developers decide when and how to apply each strategy to improve scalability and performance.

Vertical Partitioningdatabase partitioninghorizontal partitioning
0 likes · 10 min read
Understanding Database Sharding: Partitioning Strategies and When to Use Them
High Availability Architecture
High Availability Architecture
Oct 26, 2021 · Databases

Practical Guide to Horizontal Database Sharding: Design Principles, Common Schemes, and Expansion Strategies

This article explains the background, design criteria, and practical implementations of horizontal database sharding—including range, hash, gene, routing‑table, and consistent‑hash methods—while discussing common pitfalls, data‑skew mitigation, and both doubling and consistent‑hash expansion techniques for MySQL clusters.

consistent hashingdatabase scalinghash algorithm
0 likes · 24 min read
Practical Guide to Horizontal Database Sharding: Design Principles, Common Schemes, and Expansion Strategies
Architect
Architect
Sep 28, 2021 · Databases

Database Sharding Strategies: When to Use Vertical, Horizontal, and Range Partitioning

This article explains how to decide between database and table sharding, describes vertical, horizontal, and range partitioning techniques, discusses their trade‑offs and implementation details, and offers practical guidance for solving query challenges in high‑traffic, write‑intensive systems.

Interview PreparationRange ShardingScalability
0 likes · 10 min read
Database Sharding Strategies: When to Use Vertical, Horizontal, and Range Partitioning
Top Architect
Top Architect
Jun 22, 2021 · Databases

Database Sharding: Strategies, Bottlenecks, and Best Practices

This article explains the performance bottlenecks of relational databases, introduces sharding concepts such as horizontal, vertical, and table partitioning, discusses associated challenges like distributed transactions and global primary keys, and provides practical solutions and tool recommendations for implementing effective database partitioning.

Distributed TransactionsGlobal ID GenerationVertical Partitioning
0 likes · 18 min read
Database Sharding: Strategies, Bottlenecks, and Best Practices
dbaplus Community
dbaplus Community
Apr 5, 2021 · Databases

When and How to Apply Database Sharding: Practical Guidelines and Pitfalls

This article explains why database performance bottlenecks arise, outlines criteria for deciding when to shard databases and tables, and provides detailed strategies for SQL tuning, table restructuring, horizontal and vertical splitting, single‑ versus multi‑database sharding, as well as handling cross‑database joins, distributed transactions, pagination, and ID generation.

Distributed TransactionsID generationSQL Tuning
0 likes · 12 min read
When and How to Apply Database Sharding: Practical Guidelines and Pitfalls
Alibaba Cloud Developer
Alibaba Cloud Developer
Mar 21, 2021 · Databases

Mastering Database Sharding: Theory, Design, and TDDL Implementation

This article explains what database sharding (splitting databases and tables) is, why it improves performance and availability, how to choose between horizontal and vertical partitioning, design ID generation, handle distributed transactions, migrate data smoothly, and configure Alibaba's TDDL middleware with practical code examples.

ID generationTDDLVertical Partitioning
0 likes · 20 min read
Mastering Database Sharding: Theory, Design, and TDDL Implementation
Code Ape Tech Column
Code Ape Tech Column
Dec 19, 2020 · Databases

How to Tackle Database Bottlenecks with Sharding, Horizontal & Vertical Partitioning

This article analyzes common database performance bottlenecks, explains when to apply IO‑ or CPU‑focused optimizations, and provides a detailed guide to horizontal and vertical sharding, partitioning strategies, tooling choices, implementation steps, and practical pitfalls for scalable systems.

Distributed SystemsScalabilityVertical Partitioning
0 likes · 10 min read
How to Tackle Database Bottlenecks with Sharding, Horizontal & Vertical Partitioning
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Nov 13, 2020 · Databases

Sharding-JDBC: Basic Usage and Core Principles

This article introduces Sharding-JDBC, explaining its basic usage, core concepts, sharding strategies, SQL processing workflow, configuration examples, and code snippets, while emphasizing the importance of understanding its underlying principles for effective database horizontal partitioning in Java applications.

JavaSQL RoutingSharding-JDBC
0 likes · 70 min read
Sharding-JDBC: Basic Usage and Core Principles
Top Architect
Top Architect
Oct 20, 2020 · Databases

Database Bottlenecks and Sharding Strategies

This article analyzes common database performance bottlenecks such as I/O and CPU limits, explains how horizontal and vertical sharding (including database and table partitioning) can alleviate these issues, introduces practical tools and step‑by‑step implementation guidance, and discusses related challenges like non‑partition key queries and scaling.

ScalabilityVertical Partitioningdatabases
0 likes · 8 min read
Database Bottlenecks and Sharding Strategies
Programmer DD
Programmer DD
Aug 23, 2020 · Databases

How to Overcome Database Bottlenecks with Sharding: Strategies and Tools

This article explains common I/O and CPU bottlenecks in databases, compares horizontal and vertical sharding techniques, outlines practical partitioning strategies, introduces popular sharding tools, and provides step‑by‑step guidance for implementing and scaling sharded architectures.

Vertical Partitioningdatabase shardinghorizontal partitioning
0 likes · 10 min read
How to Overcome Database Bottlenecks with Sharding: Strategies and Tools
Laravel Tech Community
Laravel Tech Community
May 23, 2020 · Databases

Database Sharding: Principles, Methods, and Tools

The article explains why and when to apply database sharding, describes horizontal and vertical partitioning methods, lists common sharding tools, and discusses challenges such as distributed transactions, join avoidance, pagination, and global primary key generation.

Distributed Transactionsdatabase shardingglobal primary key
0 likes · 14 min read
Database Sharding: Principles, Methods, and Tools
Java Backend Technology
Java Backend Technology
Mar 31, 2020 · Databases

Mastering Database Bottlenecks: When and How to Shard Effectively

This article explains common database performance bottlenecks such as IO and CPU limits, introduces horizontal and vertical sharding concepts, compares sharding tools, outlines practical implementation steps, discusses common pitfalls, and provides scaling strategies to keep your data layer responsive under heavy load.

Vertical Partitioningdatabase shardinghorizontal partitioning
0 likes · 11 min read
Mastering Database Bottlenecks: When and How to Shard Effectively
Java Captain
Java Captain
Mar 22, 2020 · Databases

Database Bottlenecks and Sharding Strategies: Horizontal/Vertical Partitioning, Tools, and Best Practices

This article analyzes common database I/O and CPU bottlenecks, explains horizontal and vertical sharding concepts, presents practical sharding rules, discusses tooling such as Sharding‑Sphere, TDDL and Mycat, and outlines step‑by‑step procedures and common pitfalls for scaling relational databases.

Vertical Partitioningdatabaseshorizontal partitioning
0 likes · 11 min read
Database Bottlenecks and Sharding Strategies: Horizontal/Vertical Partitioning, Tools, and Best Practices
Selected Java Interview Questions
Selected Java Interview Questions
Dec 12, 2019 · Databases

Why Split Databases? An Introduction to Vertical and Horizontal Sharding

This article explains the reasons for splitting databases, describes vertical and horizontal sharding techniques, compares their benefits and drawbacks, and advises performing horizontal sharding before vertical partitioning to improve scalability and performance in large‑scale applications.

Vertical Partitioningdatabase shardinghorizontal partitioning
0 likes · 9 min read
Why Split Databases? An Introduction to Vertical and Horizontal Sharding
Programmer DD
Programmer DD
Dec 12, 2019 · Databases

Mastering Data Sharding: When and How to Split Your Database for Scale

This article explains the concepts, benefits, and challenges of database sharding—including vertical and horizontal partitioning, common splitting strategies, handling distributed transactions, cross‑node joins, pagination, global primary keys, and migration—while offering practical guidelines on when to adopt sharding and which tools can assist.

Distributed TransactionsVertical Partitioningdatabase sharding
0 likes · 26 min read
Mastering Data Sharding: When and How to Split Your Database for Scale
Java Backend Technology
Java Backend Technology
Oct 3, 2019 · Databases

How to Tackle Database Bottlenecks with Sharding and Partitioning

This article examines common database performance bottlenecks such as I/O and CPU limits, explains when to apply horizontal or vertical sharding, partitioning, and scaling techniques, compares tools like ShardingSphere, TDDL, and Mycat, and provides practical steps for implementation, migration, and troubleshooting.

Vertical Partitioningdatabase shardinghorizontal partitioning
0 likes · 9 min read
How to Tackle Database Bottlenecks with Sharding and Partitioning
Programmer DD
Programmer DD
Jul 30, 2019 · Databases

Mastering Database Sharding: When and How to Split Tables and Schemas

This article reviews the complete process of database and table sharding, covering when to shard, range and hash strategies, combining both, data migration challenges, business compatibility, and long‑term archiving to keep MySQL workloads manageable.

Data MigrationHash ShardingRange Sharding
0 likes · 11 min read
Mastering Database Sharding: When and How to Split Tables and Schemas
21CTO
21CTO
May 9, 2019 · Databases

How to Identify Database Bottlenecks and Choose the Right Sharding Strategy

This article explains common I/O and CPU bottlenecks in databases, compares horizontal and vertical sharding techniques, introduces practical tools, outlines migration steps, and discusses typical challenges such as non‑partition‑key queries, cross‑shard pagination, and scaling.

Vertical Partitioningbottleneckdatabases
0 likes · 8 min read
How to Identify Database Bottlenecks and Choose the Right Sharding Strategy
Architecture Digest
Architecture Digest
Apr 26, 2019 · Databases

Database Bottlenecks and Sharding Strategies (Horizontal & Vertical Partitioning)

The article explains common database performance bottlenecks such as I/O and CPU limits, and details horizontal and vertical sharding techniques—including database and table partitioning—along with tools, implementation steps, common issues, scaling strategies, and practical examples for improving scalability and reliability.

ScalabilityVertical Partitioningdatabase
0 likes · 10 min read
Database Bottlenecks and Sharding Strategies (Horizontal & Vertical Partitioning)
ITPUB
ITPUB
May 28, 2018 · Databases

Mastering Database Sharding: When and How to Split Your Data

This article explains why and how relational databases should be sharded, covering vertical and horizontal partitioning techniques, common pitfalls such as distributed transactions and join queries, and practical guidelines for deciding when to split data and which tools to use.

Distributed TransactionsID generationVertical Partitioning
0 likes · 22 min read
Mastering Database Sharding: When and How to Split Your Data
Programmer DD
Programmer DD
May 10, 2018 · Databases

How to Scale MySQL with ShardingJdbc: Vertical vs Horizontal Partitioning

This article examines why large‑scale MySQL deployments encounter CPU, I/O and memory bottlenecks, compares vertical and horizontal data‑sharding strategies, evaluates open‑source middleware ShardingJdbc versus MyCat, and provides a detailed Spring Boot integration design with routing rules and practical use‑case examples.

ShardingJDBCSpring BootVertical Partitioning
0 likes · 16 min read
How to Scale MySQL with ShardingJdbc: Vertical vs Horizontal Partitioning
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jul 24, 2017 · Databases

Mastering Database Sharding: Boost Performance with Horizontal Partitioning

This article explains the fundamentals of database sharding, including horizontal partitioning, routing, load balancing, clustering, and read/write separation, and discusses practical strategies such as range, hash, and mapping partitions to improve scalability, availability, and performance for high‑traffic web applications.

Scalabilitydatabase shardinghorizontal partitioning
0 likes · 17 min read
Mastering Database Sharding: Boost Performance with Horizontal Partitioning
Meituan Technology Team
Meituan Technology Team
Nov 18, 2016 · Databases

Vertical and Horizontal Database Sharding Strategies for Large-Scale Order Systems

Facing a 200 GB order table that strained performance during flash‑sale spikes, Meituan first vertically split the schema, then horizontally sharded orders by user and merchant IDs using a 32 × 32 hash scheme with embedded timestamp‑based IDs, enabling scalable clusters, flexible migration stages, and simplified queries while preserving transaction integrity.

ID generationVertical Partitioningdatabase sharding
0 likes · 11 min read
Vertical and Horizontal Database Sharding Strategies for Large-Scale Order Systems
MaGe Linux Operations
MaGe Linux Operations
May 30, 2016 · Databases

Why and How to Partition MySQL Tables: Sharding, Merge Engine, and Scaling Strategies

Learn why massive MySQL tables need partitioning and how techniques like table splitting, merge storage engine, vertical partitioning, and horizontal sharding—combined with master‑slave replication and proxies such as Amoeba—can reduce load, improve query speed, and enhance scalability.

Table PartitioningVertical Partitioninghorizontal partitioning
0 likes · 6 min read
Why and How to Partition MySQL Tables: Sharding, Merge Engine, and Scaling Strategies
Architecture Digest
Architecture Digest
Apr 27, 2016 · Databases

Database Sharding Strategies: Vertical and Horizontal Partitioning, ID Generation, and Migration Phases

The article outlines a comprehensive database sharding solution for a massive order system, describing vertical and horizontal partitioning, various sharding strategies, a custom ID scheme, transaction handling, complex query constraints, and a three‑stage data migration plan to achieve long‑term scalability.

Data MigrationID generationScalability
0 likes · 10 min read
Database Sharding Strategies: Vertical and Horizontal Partitioning, ID Generation, and Migration Phases
ITPUB
ITPUB
Mar 18, 2016 · Databases

Horizontal Table Partitioning: MD5 Hash vs. Bit‑Shift Sharding

This article explains two practical horizontal sharding techniques for large databases—using an MD5 hash of the user UID to distribute rows across 256 tables, and right‑shifting the UID to create scalable table ranges—while discussing their capacity limits and extensibility.

MD5 hashScalabilitybit shifting
0 likes · 5 min read
Horizontal Table Partitioning: MD5 Hash vs. Bit‑Shift Sharding
21CTO
21CTO
Mar 16, 2016 · Databases

How to Horizontally Partition Tables Using MD5 Hashing and Bit Shifting

This article explains two practical horizontal sharding techniques for large‑scale projects—MD5‑based hashing and bit‑shifting of user IDs—detailing their PHP implementations, scalability limits, and how to extend table counts as data grows.

MD5 hashingPHPbit shifting
0 likes · 5 min read
How to Horizontally Partition Tables Using MD5 Hashing and Bit Shifting