BestHub
Sign in
Tagged articles

database partitioning

66 articles · Page 1 of 1
Java Architect Handbook
Java Architect Handbook
Jul 26, 2026 · Databases

Interview Question: What Problems Arise After Sharding? List the Key Issues

The article outlines six major challenges introduced by database sharding—cross‑database joins, pagination, distributed transactions, global ID generation, data migration, and aggregation—along with practical solutions such as binding tables, cursor pagination, Seata AT mode, Snowflake IDs, dual‑write scaling, and summary tables, providing interview‑ready answers.

SeataShardingdatabase partitioning
0 likes · 17 min read
Interview Question: What Problems Arise After Sharding? List the Key Issues
Architect's Guide
Architect's Guide
Apr 3, 2026 · Databases

How to Diagnose and Solve MySQL Table Size Bottlenecks

This article explains how to assess MySQL table size using table capacity, disk usage, and instance limits, reveals why large tables slow down due to B+‑tree overhead, and presents three practical solutions—partitioning, sharding, and hot‑cold archiving—to restore query performance.

B+TreeHot Cold ArchivingMySQL
0 likes · 17 min read
How to Diagnose and Solve MySQL Table Size Bottlenecks
Top Architect
Top Architect
Jul 24, 2025 · Databases

How to Efficiently Shard Billion‑Row Tables with ShardingSphere and Spring Boot

This article walks through the end‑to‑end design, configuration, and implementation of splitting massive loan and repayment tables into 50 sharded MySQL tables using ShardingSphere, Spring Boot, and a custom suffix algorithm, while covering data migration, DBA coordination, dynamic switches, and scheduled consistency checks.

Data MigrationMySQLSharding
0 likes · 19 min read
How to Efficiently Shard Billion‑Row Tables with ShardingSphere and Spring Boot
Tech Freedom Circle
Tech Freedom Circle
Jul 14, 2025 · Databases

How to Estimate Sharding Capacity: Calculating Required Databases and Tables for an Alibaba Interview

The article walks through why sharding is needed, outlines IO and CPU bottlenecks, presents two design principles, shows how to estimate capacity from existing data and growth trends, compares range, modulo, consistent‑hash and Snowflake sharding schemes, and details migration strategies for expanding nodes without downtime.

Data MigrationShardingcapacity planning
0 likes · 22 min read
How to Estimate Sharding Capacity: Calculating Required Databases and Tables for an Alibaba Interview
Code Ape Tech Column
Code Ape Tech Column
May 28, 2025 · Databases

Evaluating MySQL Table Size and Optimizing Large Tables with Partitioning, Sharding, and Hot‑Cold Archiving

This article explains how to assess MySQL table size from table capacity, disk usage, and instance limits, describes why large tables degrade performance due to B+‑tree depth, and presents three practical solutions—partitioning, sharding, and hot‑cold archiving—to improve query speed and manage growth.

B+TreeHot Cold ArchivingMySQL
0 likes · 16 min read
Evaluating MySQL Table Size and Optimizing Large Tables with Partitioning, Sharding, and Hot‑Cold Archiving
Su San Talks Tech
Su San Talks Tech
Apr 29, 2025 · Databases

Why Split Databases? Master Sharding Concepts, Strategies, and Practical SQL Routing

This article explains the fundamental concepts of database sharding—including data nodes, logical and broadcast tables, sharding keys, strategies, algorithms, SQL parsing, routing, rewriting, execution, result merging, distributed primary keys, data masking, distributed transactions, data migration, and shadow databases—providing clear examples and code snippets for real‑world implementation.

Data MigrationSQL RoutingSharding
0 likes · 21 min read
Why Split Databases? Master Sharding Concepts, Strategies, and Practical SQL Routing
ITPUB
ITPUB
Jan 2, 2025 · Databases

How OceanBase Partitioning Supercharged KPOS Report Performance

This article details the background, challenges, and technical solutions behind the partitioning redesign of the KPOS reporting system on OceanBase, covering deployment choices, parameter tuning, data migration, phased rollout, performance gains, encountered issues, and future scaling plans.

Data MigrationDeployment StrategiesOceanBase
0 likes · 26 min read
How OceanBase Partitioning Supercharged KPOS Report Performance
dbaplus Community
dbaplus Community
Dec 29, 2024 · Databases

How to Speed Up Massive MySQL Tables: Partitioning, Sharding, and Hot/Cold Archiving

When a MySQL table grows to tens of millions of rows, insert and query latency spikes, schema changes become painful, and only a subset of data is needed; this guide explains how to assess table size, why large tables slow down, and three practical solutions—partitioning, sharding, and hot/cold archiving—along with their trade‑offs and implementation steps.

Hot Cold ArchivingMySQLSharding
0 likes · 17 min read
How to Speed Up Massive MySQL Tables: Partitioning, Sharding, and Hot/Cold Archiving
Top Architect
Top Architect
Nov 12, 2024 · Databases

Design and Implementation of Table Sharding for Loan Repayment Applications Using ShardingSphere and Spring Boot

This article describes how a senior architect designed, configured, and implemented a 50‑table sharding solution for loan and repayment request data using ShardingSphere, Spring Boot 3, MySQL, and custom synchronization scripts, while also addressing historical data migration, backend query changes, and operational safeguards.

MySQLShardingShardingSphere
0 likes · 23 min read
Design and Implementation of Table Sharding for Loan Repayment Applications Using ShardingSphere and Spring Boot
dbaplus Community
dbaplus Community
Nov 6, 2024 · Databases

Why Sharding Fails: Hidden Pitfalls of Database Partitioning in E‑commerce

This article examines the fundamental drawbacks of MySQL sharding in large‑scale e‑commerce, highlighting distributed transaction challenges, limited cross‑shard queries, global key constraints, scaling difficulties, operational overhead, and why distributed databases may be a better long‑term solution.

Shardingdatabase partitioningdistributed transactions
0 likes · 11 min read
Why Sharding Fails: Hidden Pitfalls of Database Partitioning in E‑commerce
Architect
Architect
Oct 3, 2024 · Databases

How to Tame Massive MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article walks through evaluating massive MySQL tables, explains why large row counts slow queries, and compares three practical solutions—table partitioning, database sharding, and hot/cold archiving—while highlighting their trade‑offs and offering guidance on selecting the right approach for a given workload.

Hot Cold ArchivingLarge TablesMySQL
0 likes · 18 min read
How to Tame Massive MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Top Architect
Top Architect
Aug 18, 2024 · Databases

Design and Implementation of Database Table Partitioning for Loan and Repayment Systems

This article details the design, planning, and step‑by‑step implementation of a database table‑partitioning solution for loan and repayment request tables, covering schema decisions, sharding strategy, historical data migration, dynamic synchronization, code examples with ShardingSphere, SpringBoot, and operational considerations for seamless migration.

Data MigrationShardingShardingSphere
0 likes · 18 min read
Design and Implementation of Database Table Partitioning for Loan and Repayment Systems
Architect
Architect
Jul 17, 2024 · Databases

Design and Implementation of Table Sharding for Cash Repayment System Using ShardingSphere and SpringBoot

The article describes how a one‑year‑old loan/repayment service was refactored by introducing a 50‑table sharding scheme with ShardingSphere, detailing the design decisions, historical data migration, code changes, configuration files, pitfalls, and runtime synchronization strategies to achieve efficient query performance on billions of rows.

Data MigrationMySQLSharding
0 likes · 23 min read
Design and Implementation of Table Sharding for Cash Repayment System Using ShardingSphere and SpringBoot
Architecture Digest
Architecture Digest
Mar 6, 2024 · Databases

Implementing SaaS Multi‑Tenant Architecture with Shared Database Table Partitioning in MySQL

This article explains how to design a SaaS system that isolates each subsidiary's data by adding a tenant_id column to a shared MySQL table, converting the table to LIST‑partitioned storage, and enforcing tenant‑level access through stored procedures and a MyBatis interceptor, complete with code examples and testing steps.

MyBatisMySQLSaaS
0 likes · 18 min read
Implementing SaaS Multi‑Tenant Architecture with Shared Database Table Partitioning in MySQL
Top Architect
Top Architect
Jan 11, 2024 · Databases

Implementing Multi‑Tenant SaaS Architecture with MySQL Partitioning and MyBatis Interceptor

This article demonstrates how to convert a single‑tenant MySQL application into a multi‑tenant SaaS solution by adding a tenant_id column, using shared‑database partitioning, creating tenant tables, writing stored procedures for dynamic partition management, and implementing a MyBatis interceptor for hierarchical data permissions.

MyBatisMySQLSaaS
0 likes · 19 min read
Implementing Multi‑Tenant SaaS Architecture with MySQL Partitioning and MyBatis Interceptor
Architect
Architect
Jan 9, 2024 · Databases

How to Build a Multi‑Tenant SaaS Architecture with MySQL Partitioning and MyBatis Interceptor

This article walks through converting a single‑tenant MySQL application into a SaaS solution by adding a tenant_id column, using shared‑database table partitioning, creating tenant metadata tables, writing stored procedures to add columns and partitions, and implementing a MyBatis interceptor for automatic data‑permission enforcement.

Data PermissionMyBatisMySQL
0 likes · 22 min read
How to Build a Multi‑Tenant SaaS Architecture with MySQL Partitioning and MyBatis Interceptor
macrozheng
macrozheng
Dec 28, 2023 · Databases

Mastering Sharding: 21 Core Concepts for Scalable Database Design

This article introduces the essential concepts of sharding architecture—including data partitioning, logical and physical tables, sharding keys, routing strategies, SQL rewriting, distributed primary keys, data masking, transactions, migration, and shadow databases—providing a comprehensive guide for building high‑performance, horizontally scaled database systems.

Broadcast TableSQL RoutingSharding
0 likes · 21 min read
Mastering Sharding: 21 Core Concepts for Scalable Database Design
Efficient Ops
Efficient Ops
Nov 1, 2023 · Databases

Why MySQL Single Tables Should Stay Below 20 Million Rows: Theory & Practice

This article explains the technical reasons why a MySQL single table should not exceed about 20 million rows, covering limits from auto‑increment primary keys, data‑page structures, B+‑tree storage calculations, and practical partitioning recommendations for large‑scale applications.

B+TreeMySQLTable Size Limits
0 likes · 9 min read
Why MySQL Single Tables Should Stay Below 20 Million Rows: Theory & Practice
Architect's Guide
Architect's Guide
Oct 21, 2023 · Databases

Implementing Monthly Horizontal Partitioning in MySQL Using Stored Procedures and Dynamic Table Creation

This article details a practical approach to handling massive billing data by dynamically creating monthly tables in MySQL via stored procedures, integrating them with a SpringBoot‑MyBatis backend, and providing APIs for insertion, serial‑number lookup, and time‑range queries, complete with code examples and operational tips.

Dynamic TableMySQLSpringBoot
0 likes · 31 min read
Implementing Monthly Horizontal Partitioning in MySQL Using Stored Procedures and Dynamic Table Creation
dbaplus Community
dbaplus Community
Sep 11, 2023 · Databases

When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas

This article explains why relational databases hit performance bottlenecks at large scale, introduces vertical and horizontal sharding techniques, compares their pros and cons, discusses common challenges such as distributed transactions, joins, pagination and global key generation, and offers practical solutions and middleware options.

Horizontal ShardingShardingVertical Sharding
0 likes · 24 min read
When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas
ITPUB
ITPUB
Jun 23, 2023 · Databases

Seamless Sharding Migration: Dual‑Write, Mapping Keys, and Diff Validation

This article explains how to smoothly migrate a legacy single‑database system to a sharded architecture by using dual‑write, mapping‑key routing, custom transaction handling, and offline/real‑time diff checks, while detailing the underlying MyBatis integration and component‑based design.

MyBatisShardingdatabase partitioning
0 likes · 36 min read
Seamless Sharding Migration: Dual‑Write, Mapping Keys, and Diff Validation
Wukong Talks Architecture
Wukong Talks Architecture
May 16, 2023 · Databases

Understanding Sharding: 21 Common Concepts of Database Partitioning

This article introduces the fundamental concepts of database sharding, including data fragmentation, nodes, logical and physical tables, broadcast and single tables, sharding keys, strategies, algorithms, binding tables, SQL parsing, routing, rewriting, execution, result merging, distributed primary keys, data masking, distributed transactions, migration, and shadow databases, providing a comprehensive guide for designing and operating a sharded architecture.

Broadcast TableSQL RoutingSharding
0 likes · 19 min read
Understanding Sharding: 21 Common Concepts of Database Partitioning
Top Architect
Top Architect
Mar 14, 2023 · Databases

Handling Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article explains how to assess MySQL table size, identify performance issues caused by massive data volumes, and presents three practical solutions—table partitioning, database sharding, and hot‑cold data archiving—along with detailed SQL examples and considerations for implementation.

Data ArchivingMySQLSharding
0 likes · 16 min read
Handling Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Top Architect
Top Architect
Mar 4, 2023 · Databases

How to Handle Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article explains why large MySQL tables cause slow queries, analyzes table size, disk usage, and instance capacity, and presents three practical solutions—table partitioning, database sharding (horizontal/vertical), and hot‑cold data archiving—helping developers choose the appropriate strategy for their workloads.

Data ArchivingMySQLSharding
0 likes · 18 min read
How to Handle Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies
MaGe Linux Operations
MaGe Linux Operations
Feb 22, 2023 · Databases

Mastering MySQL Sharding: When and How to Use Database Partitioning

This article explains the concepts, strategies, and practical scenarios for MySQL database partitioning, covering both table splitting (vertical and horizontal) and database splitting (vertical and horizontal), with examples, advantages, and when to apply each technique to handle large-scale data workloads.

Horizontal PartitioningShardingVertical Partitioning
0 likes · 9 min read
Mastering MySQL Sharding: When and How to Use Database Partitioning
ITPUB
ITPUB
Jan 2, 2023 · Databases

Mastering MySQL Sharding: When and How to Split Databases and Tables

Facing massive user and order data growth, this article examines storage options, compares relational, NoSQL, and NewSQL databases, and provides a detailed guide to implementing MySQL‑based sharding with proxy and client modes, key selection, partition strategies, migration steps, and future scaling considerations.

Data MigrationMySQLdatabase partitioning
0 likes · 12 min read
Mastering MySQL Sharding: When and How to Split Databases and Tables
ITPUB
ITPUB
Dec 9, 2022 · Databases

Mastering Sharding: When and How to Split Databases and Tables with ShardingSphere

This article explains the fundamentals of database sharding, why and when to apply it, various vertical and horizontal splitting strategies, routing algorithms, common pitfalls such as pagination and distributed transactions, and compares client‑side and proxy‑based ShardingSphere deployment patterns.

MySQLShardingSpheredatabase partitioning
0 likes · 19 min read
Mastering Sharding: When and How to Split Databases and Tables with ShardingSphere
Architect's Guide
Architect's Guide
Nov 11, 2022 · Databases

Database Sharding: Table Partitioning, Horizontal and Vertical Splitting, and Implementation with Sharding-JDBC and Mycat

This article explains why high‑concurrency big‑data systems need database sharding, describes table‑level partitioning methods (modulus and range), shows how to implement them with MySQL and Java code, compares vertical and horizontal database splitting, and evaluates middleware solutions such as Sharding‑JDBC and Mycat.

MySQLShardingSpring
0 likes · 11 min read
Database Sharding: Table Partitioning, Horizontal and Vertical Splitting, and Implementation with Sharding-JDBC and Mycat
Top Architect
Top Architect
Nov 10, 2022 · Databases

Database Sharding and Partitioning Strategy for High‑Volume Order Systems

This article explains how to handle billions of order records by classifying data into hot and cold tiers, using MySQL sharding with database‑and‑table partitioning, storing cold data in Elasticsearch and Hive, and outlines combined routing formulas for scalable backend architecture.

MySQLShardingdatabase partitioning
0 likes · 8 min read
Database Sharding and Partitioning Strategy for High‑Volume Order Systems
Java Architect Essentials
Java Architect Essentials
Nov 1, 2022 · Databases

Designing Routing Keys for Sharding in an Order Platform

The article explains how to select and implement routing keys for database sharding in an order platform, covering time‑based and business‑related keys, user and merchant scenarios, hash‑modulo strategies for single and multi‑database environments, and the overall data flow.

HashingRouting KeySharding
0 likes · 5 min read
Designing Routing Keys for Sharding in an Order Platform
Su San Talks Tech
Su San Talks Tech
Jul 21, 2022 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

This article explains the three aspects of database sharding—database‑only, table‑only, and both—detailing when to apply each, how to choose sharding keys, common algorithms, ID generation strategies, available open‑source tools, and the new challenges introduced by sharding.

ShardingVertical Scalingdatabase partitioning
0 likes · 16 min read
Mastering Database Sharding: When and How to Split Databases and Tables
Top Architect
Top Architect
Mar 16, 2022 · Databases

Comprehensive Guide to Database Sharding: Vertical & Horizontal Partitioning, Global ID Generation, and Distributed Transaction Challenges

This article explains the concepts, methods, advantages, and drawbacks of database sharding, covering vertical and horizontal partitioning, sharding rules, global primary key generation, distributed transaction issues, cross‑node queries, pagination, data migration, and practical case studies, with code examples and diagrams.

Global ID GenerationShardingdatabase partitioning
0 likes · 24 min read
Comprehensive Guide to Database Sharding: Vertical & Horizontal Partitioning, Global ID Generation, and Distributed Transaction Challenges
Code Ape Tech Column
Code Ape Tech Column
Jan 24, 2022 · Databases

Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods

The article explains the hot‑cold data separation pattern, describing its purpose, when to use it, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve performance and maintain data consistency in large‑scale systems.

Cold DataHot Datadata lifecycle
0 likes · 10 min read
Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods
Java Interview Crash Guide
Java Interview Crash Guide
Dec 10, 2021 · Databases

Mastering Database Sharding: When and How to Split Your Data

This article explains the concepts, types, advantages, and challenges of database sharding—including vertical and horizontal partitioning—covers when to consider splitting, practical strategies for handling transactions, joins, pagination, global IDs, and lists popular middleware solutions for implementing sharding in production.

Distributed DatabasesGlobal ID GenerationHorizontal Sharding
0 likes · 25 min read
Mastering Database Sharding: When and How to Split Your Data
Top Architect
Top Architect
Nov 6, 2021 · Databases

Understanding Database Sharding: Partitioning Strategies and When to Use Them

This article explains the concepts, characteristics, and practical scenarios of database sharding—including vertical and horizontal table partitioning as well as vertical and horizontal database partitioning—helping developers decide when and how to apply each strategy to improve scalability and performance.

Horizontal PartitioningMySQLSharding
0 likes · 10 min read
Understanding Database Sharding: Partitioning Strategies and When to Use Them
Aikesheng Open Source Community
Aikesheng Open Source Community
Oct 13, 2021 · Databases

MySQL Native Horizontal Sharding with MERGE Tables

This article explains MySQL's native horizontal sharding using MERGE tables, covering the concepts of horizontal versus vertical splitting, table‑level sharding and partitioning, practical examples, advantages, limitations, and suitable use cases for MERGE tables.

Horizontal ShardingMERGE TableMySQL
0 likes · 11 min read
MySQL Native Horizontal Sharding with MERGE Tables
Java Interview Crash Guide
Java Interview Crash Guide
Sep 2, 2021 · Backend Development

Why Split Your Monolith? Practical Steps for Application & DB Partitioning

This article explains why monolithic systems need to be split, outlines how to assess business complexity, define service boundaries, and execute database vertical and horizontal partitioning with global ID generators, migration strategies, cross‑database query refactoring, cut‑over plans, and post‑split stability measures.

application splittingdatabase partitioningmicroservices
0 likes · 18 min read
Why Split Your Monolith? Practical Steps for Application & DB Partitioning
Java Interview Crash Guide
Java Interview Crash Guide
Dec 17, 2020 · Databases

Mastering Data Sharding: When and How to Split Your Database

This article explains the concepts, types, advantages, and drawbacks of vertical and horizontal database sharding, discusses the challenges such as distributed transactions, cross‑node joins, pagination, global primary‑key generation, migration, and provides practical guidelines and case studies for deciding when and how to apply sharding.

Horizontal ShardingShardingVertical Sharding
0 likes · 28 min read
Mastering Data Sharding: When and How to Split Your Database
Senior Brother's Insights
Senior Brother's Insights
Dec 2, 2020 · Databases

Mastering Data Sharding: When, How, and What to Watch Out For

This comprehensive guide explains why and when to split relational databases, details vertical and horizontal sharding techniques, discusses associated challenges such as distributed transactions, cross‑node joins, pagination, global primary keys, and offers practical solutions and middleware options.

Global ID GenerationHorizontal ShardingSharding
0 likes · 24 min read
Mastering Data Sharding: When, How, and What to Watch Out For
macrozheng
macrozheng
Oct 9, 2020 · Databases

How to Implement Database Sharding: Horizontal & Vertical Partitioning with Sharding-JDBC

This article explains the fundamentals of database sharding, covering both vertical and horizontal partitioning concepts, routing algorithms, advantages and drawbacks, practical implementation steps using sharding-jdbc, and discusses related challenges such as distributed transactions, pagination, global IDs, and tool selection.

ShardingVertical Scalingdatabase partitioning
0 likes · 17 min read
How to Implement Database Sharding: Horizontal & Vertical Partitioning with Sharding-JDBC
Java Backend Technology
Java Backend Technology
Aug 30, 2020 · Databases

Mastering Database Sharding: Core Concepts, Middleware, and Common Challenges

Sharding splits a single database into multiple servers to improve performance, covering vertical and horizontal partitioning, middleware options, and key challenges such as distributed transactions, cross‑node joins, ID generation, pagination, routing transparency, and choosing between frameworks or custom solutions.

MiddlewareShardingdatabase partitioning
0 likes · 16 min read
Mastering Database Sharding: Core Concepts, Middleware, and Common Challenges
MaGe Linux Operations
MaGe Linux Operations
Jul 19, 2020 · Databases

Optimizing Zabbix with MySQL: Version Tips, Permissions, and Partitioning Strategies

This guide details recommended MySQL versions for Zabbix, proper grant statements for read/write and read‑only users, essential MySQL configuration tweaks, SQL techniques for item and function updates, read‑write splitting, upgrade procedures, backup strategies, and comprehensive partition maintenance scripts to improve performance and manage data growth.

MySQLSQLZabbix
0 likes · 14 min read
Optimizing Zabbix with MySQL: Version Tips, Permissions, and Partitioning Strategies
Java Architect Essentials
Java Architect Essentials
May 25, 2020 · Databases

MySQL Sharding and Partitioning: Strategies, Tools, and Best Practices

This article explains MySQL performance bottlenecks, compares IO and CPU limits, introduces horizontal and vertical sharding and partitioning concepts, presents practical scenarios, outlines common tools such as Sharding‑Sphere, TDDL and Mycat, and provides step‑by‑step guidance for implementation, troubleshooting and scaling.

MiddlewareMySQLSharding
0 likes · 8 min read
MySQL Sharding and Partitioning: Strategies, Tools, and Best Practices
Architecture Digest
Architecture Digest
Jan 5, 2020 · Databases

Data Sharding, Partitioning, and Distributed ID Strategies for Relational Databases

This article explains why relational databases become bottlenecks at large scale, introduces vertical and horizontal sharding techniques, discusses the challenges of distributed transactions, cross‑shard queries, pagination, and global primary‑key generation, and provides practical guidelines and middleware options for implementing sharding in production systems.

MySQLVertical Partitioningdatabase partitioning
0 likes · 23 min read
Data Sharding, Partitioning, and Distributed ID Strategies for Relational Databases
dbaplus Community
dbaplus Community
Jun 2, 2019 · Databases

Why Sharding (Database Partitioning) Beats Partitioning and NoSQL for Massive Data

The article explains why sharding (splitting databases and tables) is the preferred solution for handling massive user, order, and transaction data in high‑traffic internet applications, comparing it with partitioning and NoSQL/NewSQL alternatives, and detailing practical middleware choices, sharding column selection, and integration with Elasticsearch and HBase.

ElasticsearchHBaseMySQL
0 likes · 14 min read
Why Sharding (Database Partitioning) Beats Partitioning and NoSQL for Massive Data
Programmer DD
Programmer DD
Apr 18, 2019 · Databases

How We Scaled Billion‑Row MySQL Tables with Simple Sharding Strategies

This article shares a practical journey of handling MySQL tables that grew beyond a billion rows, describing a temporary backup‑table fix, a custom hash‑based sharding implementation, data migration tactics, validation steps, and key lessons learned for large‑scale database management.

MySQLShardingdatabase partitioning
0 likes · 12 min read
How We Scaled Billion‑Row MySQL Tables with Simple Sharding Strategies
Programmer DD
Programmer DD
Nov 8, 2018 · Databases

Mastering Sharding: When and How to Use Partitioning, Sharding, and NoSQL

This article explains why modern applications dealing with massive user, order, and transaction data must move beyond single‑table designs, compares partitioning, sharding (分库分表), and NoSQL/NewSQL solutions, and provides practical guidance on choosing middleware, sharding columns, and hybrid architectures such as es + HBase.

MiddlewareShardingdatabase partitioning
0 likes · 15 min read
Mastering Sharding: When and How to Use Partitioning, Sharding, and NoSQL
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 22, 2018 · Databases

Mastering MySQL Sharding: Vertical, Horizontal, and Hybrid Strategies Explained

This article explores MySQL sharding fundamentals, detailing vertical, horizontal, and combined partitioning methods, their advantages and drawbacks, and surveys various open‑source implementations such as MySQL Proxy, HSCALE, Amoeba, HiveDB, and PL/Proxy, while offering practical guidance on configuration, transaction handling, and common pitfalls.

AmoebaHorizontal ShardingMySQL
0 likes · 22 min read
Mastering MySQL Sharding: Vertical, Horizontal, and Hybrid Strategies Explained
dbaplus Community
dbaplus Community
Apr 19, 2017 · Databases

How to Use MariaDB Spider for Horizontal & Vertical Sharding

This article explains what MariaDB Spider is, its role as a pluggable storage engine for MySQL/MariaDB sharding, demonstrates vertical and horizontal partitioning with real‑world Tencent game case, provides installation steps, configuration commands, performance considerations, tunable parameters, and load‑balancing architecture.

MariaDBShardingSpider
0 likes · 8 min read
How to Use MariaDB Spider for Horizontal & Vertical Sharding
ITPUB
ITPUB
Aug 18, 2016 · Databases

Cut Oracle Data Extraction from 20 Hours to 1 Hour: Proven DBA Tuning Tricks

An experienced DBA shares a real-world case of optimizing a nightly Oracle reporting pipeline, detailing how partitioned tables, truncate operations, table compression, disabling logging, and parallel execution reduced a 20‑hour data extraction to under one hour, and compiles community‑sourced tuning tips for large‑scale data warehouses.

Data WarehousingOracleSQL Optimization
0 likes · 14 min read
Cut Oracle Data Extraction from 20 Hours to 1 Hour: Proven DBA Tuning Tricks
MaGe Linux Operations
MaGe Linux Operations
Feb 4, 2016 · Databases

Mastering Database Sharding: Vertical & Horizontal Partitioning Strategies

This article explains the core concepts of database sharding, detailing vertical and horizontal partitioning methods, strategies for combining them, handling shared data, and addressing challenges such as distributed transactions, cross‑node joins, and aggregation queries, with practical insights for scalable system design.

Horizontal ShardingShardingVertical Sharding
0 likes · 9 min read
Mastering Database Sharding: Vertical & Horizontal Partitioning Strategies