Tagged articles
20 articles
Page 1 of 1
ITPUB
ITPUB
Jun 16, 2024 · Databases

When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas

This article explains why database sharding is needed, how to identify performance bottlenecks, and provides step‑by‑step guidance on SQL tuning, table redesign, architectural changes, and practical horizontal and vertical sharding techniques with real‑world e‑commerce examples.

Distributed Transactionsarchitecturedatabase sharding
0 likes · 13 min read
When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas
Architect
Architect
Sep 18, 2023 · Databases

Database Sharding: Data Partitioning Strategies, Challenges, and Practical Solutions

The article explains why relational databases become performance bottlenecks at large scales, introduces vertical and horizontal sharding techniques, discusses their advantages and drawbacks, and provides detailed guidance on handling distributed transactions, joins, pagination, global primary keys, and ID generation strategies.

Distributed TransactionsID generationglobal primary key
0 likes · 24 min read
Database Sharding: Data Partitioning Strategies, Challenges, and Practical Solutions
dbaplus Community
dbaplus Community
Sep 11, 2023 · Databases

When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas

This article explains why relational databases hit performance bottlenecks at large scale, introduces vertical and horizontal sharding techniques, compares their pros and cons, discusses common challenges such as distributed transactions, joins, pagination and global key generation, and offers practical solutions and middleware options.

database partitioningglobal primary keyhorizontal sharding
0 likes · 24 min read
When and How to Shard Databases: A Practical Guide to Splitting Tables and Schemas
ITPUB
ITPUB
Apr 1, 2023 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

Learn why large-scale internet applications need database sharding, understand the evolution from single databases to split databases and tables, and follow practical steps for assessing, planning, and implementing horizontal and vertical sharding, including sizing calculations, key selection, and query challenges.

Data PartitioningScalabilitydatabase sharding
0 likes · 14 min read
Mastering Database Sharding: When and How to Split Databases and Tables
Java Interview Crash Guide
Java Interview Crash Guide
Dec 10, 2021 · Databases

Mastering Database Sharding: When and How to Split Your Data

This article explains the concepts, types, advantages, and challenges of database sharding—including vertical and horizontal partitioning—covers when to consider splitting, practical strategies for handling transactions, joins, pagination, global IDs, and lists popular middleware solutions for implementing sharding in production.

Global ID Generationdatabase partitioningdistributed databases
0 likes · 25 min read
Mastering Database Sharding: When and How to Split Your Data
Su San Talks Tech
Su San Talks Tech
Oct 27, 2021 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

This article explains why and how to split databases and tables in high‑concurrency systems, covering vertical (business‑domain) and horizontal (data‑volume) sharding, practical architectures, read‑write separation, routing algorithms, and real‑world case studies from gaming, membership points, and restaurant ordering platforms.

Read-Write SeparationScalabilityhorizontal sharding
0 likes · 15 min read
Mastering Database Sharding: When and How to Split Databases and Tables
IT Architects Alliance
IT Architects Alliance
Aug 3, 2021 · Industry Insights

How to Split Complex Systems and Evolve Architecture for Scalable Micro‑services

The article examines why growing business complexity and throughput demands necessitate system decomposition and architectural evolution, detailing horizontal scaling, vertical and business splitting, database partitioning strategies, cache and index integration, remote service data sourcing, and asynchronous messaging to achieve scalable, robust micro‑service‑based solutions.

MicroservicesSystem Architectureasynchronous messaging
0 likes · 9 min read
How to Split Complex Systems and Evolve Architecture for Scalable Micro‑services
Java Interview Crash Guide
Java Interview Crash Guide
Dec 17, 2020 · Databases

Mastering Data Sharding: When and How to Split Your Database

This article explains the concepts, types, advantages, and drawbacks of vertical and horizontal database sharding, discusses the challenges such as distributed transactions, cross‑node joins, pagination, global primary‑key generation, migration, and provides practical guidelines and case studies for deciding when and how to apply sharding.

Distributed Transactionsdatabase partitioningglobal IDs
0 likes · 28 min read
Mastering Data Sharding: When and How to Split Your Database
Senior Brother's Insights
Senior Brother's Insights
Dec 2, 2020 · Databases

Mastering Data Sharding: When, How, and What to Watch Out For

This comprehensive guide explains why and when to split relational databases, details vertical and horizontal sharding techniques, discusses associated challenges such as distributed transactions, cross‑node joins, pagination, global primary keys, and offers practical solutions and middleware options.

Distributed TransactionsGlobal ID Generationdatabase partitioning
0 likes · 24 min read
Mastering Data Sharding: When, How, and What to Watch Out For
Laravel Tech Community
Laravel Tech Community
May 23, 2020 · Databases

Database Sharding: Principles, Methods, and Tools

The article explains why and when to apply database sharding, describes horizontal and vertical partitioning methods, lists common sharding tools, and discusses challenges such as distributed transactions, join avoidance, pagination, and global primary key generation.

Distributed Transactionsdatabase shardingglobal primary key
0 likes · 14 min read
Database Sharding: Principles, Methods, and Tools
Senior Brother's Insights
Senior Brother's Insights
Jan 14, 2020 · Databases

Mastering Database Sharding: When, Why, and How to Split Your Data

This comprehensive guide explains the motivations, methods, and trade‑offs of database sharding—including vertical and horizontal partitioning, sharding rules, handling cross‑node joins, distributed transactions, global primary key generation, and practical migration strategies—so you can scale relational databases effectively.

Distributed TransactionsGlobal ID Generationdatabase sharding
0 likes · 24 min read
Mastering Database Sharding: When, Why, and How to Split Your Data
JD Tech
JD Tech
Jun 8, 2018 · Backend Development

System Splitting and Architectural Evolution: Strategies for Scaling and Decoupling

The article explains how increasing business complexity and throughput demands drive system splitting—horizontal scaling, vertical and business sharding, and database partitioning—and describes the subsequent architectural evolution toward micro‑services, caching, indexing, and asynchronous processing to improve capacity, robustness, and performance.

Microservicescachinghorizontal scaling
0 likes · 10 min read
System Splitting and Architectural Evolution: Strategies for Scaling and Decoupling
Java Backend Technology
Java Backend Technology
May 8, 2018 · Databases

How MyCat Simplifies Database Sharding and Read/Write Routing

This article explains MyCat's role as a database middleware, tracing the evolution from single‑database setups through distributed deployment, caching, master‑slave, vertical and horizontal sharding, and shows how MyCat automates data‑source and shard selection to reduce code complexity.

Database MiddlewareMaster‑SlaveMycat
0 likes · 11 min read
How MyCat Simplifies Database Sharding and Read/Write Routing
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 22, 2018 · Databases

Mastering MySQL Sharding: Vertical, Horizontal, and Hybrid Strategies Explained

This article explores MySQL sharding fundamentals, detailing vertical, horizontal, and combined partitioning methods, their advantages and drawbacks, and surveys various open‑source implementations such as MySQL Proxy, HSCALE, Amoeba, HiveDB, and PL/Proxy, while offering practical guidance on configuration, transaction handling, and common pitfalls.

AmoebaProxydatabase partitioning
0 likes · 22 min read
Mastering MySQL Sharding: Vertical, Horizontal, and Hybrid Strategies Explained
dbaplus Community
dbaplus Community
Apr 19, 2017 · Databases

How to Use MariaDB Spider for Horizontal & Vertical Sharding

This article explains what MariaDB Spider is, its role as a pluggable storage engine for MySQL/MariaDB sharding, demonstrates vertical and horizontal partitioning with real‑world Tencent game case, provides installation steps, configuration commands, performance considerations, tunable parameters, and load‑balancing architecture.

MariaDBSpiderdatabase partitioning
0 likes · 8 min read
How to Use MariaDB Spider for Horizontal & Vertical Sharding
Qunar Tech Salon
Qunar Tech Salon
Feb 18, 2016 · Databases

Challenges and Strategies for Database Vertical and Horizontal Sharding

The article examines the increasing storage bottleneck in large-scale web systems, explains vertical and horizontal database sharding, discusses the technical difficulties they introduce—including join rewrites, transaction handling, and ORM integration—and proposes practical approaches to minimize service impact and manage distributed transactions.

ORMdatabase shardinghorizontal sharding
0 likes · 15 min read
Challenges and Strategies for Database Vertical and Horizontal Sharding
MaGe Linux Operations
MaGe Linux Operations
Feb 4, 2016 · Databases

Mastering Database Sharding: Vertical & Horizontal Partitioning Strategies

This article explains the core concepts of database sharding, detailing vertical and horizontal partitioning methods, strategies for combining them, handling shared data, and addressing challenges such as distributed transactions, cross‑node joins, and aggregation queries, with practical insights for scalable system design.

Distributed Transactionscross-node queriesdatabase partitioning
0 likes · 9 min read
Mastering Database Sharding: Vertical & Horizontal Partitioning Strategies

Airbnb’s Database Scaling Using MySQL Replication and Vertical Sharding

Airbnb tackled rapid data growth by vertically partitioning tables across multiple MySQL databases using Amazon RDS replication, minimizing downtime through read‑replica promotion, and implementing a staged migration that reduced primary database writes by 33%, cut size by 20%, and improved stability and scalability.

AirbnbAmazon RDSMySQL replication
0 likes · 12 min read
Airbnb’s Database Scaling Using MySQL Replication and Vertical Sharding
Java High-Performance Architecture
Java High-Performance Architecture
Aug 18, 2015 · Databases

Vertical vs Horizontal Database Sharding: Benefits, Drawbacks, and When to Use Each

Vertical sharding splits large tables across multiple servers by whole tables, offering simple partitioning but limited scalability, while horizontal sharding distributes rows of high‑traffic tables based on key rules, improving performance and scalability yet introducing complex partition logic and maintenance challenges.

Scalabilitydatabase shardinghorizontal sharding
0 likes · 3 min read
Vertical vs Horizontal Database Sharding: Benefits, Drawbacks, and When to Use Each