horizontal scaling

macrozheng

Dec 6, 2023 · Databases

When and How to Implement Database Sharding and Partitioning for High‑Scale Systems

This article explains why database sharding and partitioning become necessary, outlines performance bottlenecks, presents software and hardware optimization techniques, details horizontal and vertical splitting strategies, and discusses the added complexity such as cross‑database joins, distributed transactions, and ID generation.

SQL Optimizationdatabase shardingdistributed transactions

0 likes · 13 min read

When and How to Implement Database Sharding and Partitioning for High‑Scale Systems

Architect's Guide

Nov 15, 2023 · Databases

Smooth 2N Database Scaling and High Availability with MariaDB, Keepalived, and Sharding

This article presents five expansion strategies—shutdown, write‑stop, log‑based, dual‑write, and smooth 2N—detailing step‑by‑step procedures for MariaDB installation, master‑master replication, dynamic data‑source configuration, and Keepalived high‑availability setup, enabling seamless horizontal scaling and minimal service disruption for large‑scale databases.

Database ScalingHigh AvailabilityKeepalived

0 likes · 30 min read

Smooth 2N Database Scaling and High Availability with MariaDB, Keepalived, and Sharding

vivo Internet Technology

Sep 27, 2023 · Big Data

Horizontal Scaling of Hive Metastore Service at Vivo: Evaluation, TiDB Migration, and Lessons Learned

Vivo’s big‑data team horizontally scaled its Hive Metastore by evaluating MySQL sharding (Waggle‑Dance) against a TiDB migration, ultimately adopting TiDB, which after a synchronized cut‑over delivered ~15% faster queries, 80% DDL latency reduction, linear scaling, low resource use, and valuable operational lessons.

Big DataHive MetastoreSQL

0 likes · 19 min read

Horizontal Scaling of Hive Metastore Service at Vivo: Evaluation, TiDB Migration, and Lessons Learned

Spring Full-Stack Practical Cases

Jul 9, 2023 · Backend Development

Mastering System Scalability: How the AKF Cube Guides X, Y, Z Expansions

This article explains the AKF Cube methodology for scaling distributed systems, detailing how horizontal replication (X axis), functional decomposition (Y axis), and user‑based sharding (Z axis) can be combined to boost performance while balancing implementation costs.

AKF cubeLoad BalancingSharding

0 likes · 12 min read

Mastering System Scalability: How the AKF Cube Guides X, Y, Z Expansions

Architect's Guide

Jun 20, 2023 · Databases

Why and How to Perform Database Sharding and Table Partitioning

Database sharding and table partitioning are essential scaling techniques that separate data across multiple databases and tables to handle growing user volume, data size, and concurrency, with explanations of when to split, methods (horizontal vs vertical), and a comparison of popular middleware solutions.

database shardinghorizontal scalingmiddleware

0 likes · 14 min read

Why and How to Perform Database Sharding and Table Partitioning

Wukong Talks Architecture

May 16, 2023 · Databases

Understanding Sharding: 21 Common Concepts of Database Partitioning

This article introduces the fundamental concepts of database sharding, including data fragmentation, nodes, logical and physical tables, broadcast and single tables, sharding keys, strategies, algorithms, binding tables, SQL parsing, routing, rewriting, execution, result merging, distributed primary keys, data masking, distributed transactions, migration, and shadow databases, providing a comprehensive guide for designing and operating a sharded architecture.

SQL routingShardingbinding tables

0 likes · 19 min read

Understanding Sharding: 21 Common Concepts of Database Partitioning

Code Ape Tech Column

Mar 27, 2023 · Databases

Horizontal Database Scaling Strategies and Practical Implementation with MariaDB, Keepalived, and ShardingJDBC

This article explains how to expand a sharded database from three to four nodes, compares five migration schemes—including stop‑service, stop‑write, log‑based, dual‑write, and smooth 2N approaches—and provides step‑by‑step instructions for MariaDB installation, master‑slave configuration, Keepalived high‑availability setup, and dynamic data‑source integration using ShardingJDBC.

High AvailabilityKeepalivedMariaDB

0 likes · 33 min read

Horizontal Database Scaling Strategies and Practical Implementation with MariaDB, Keepalived, and ShardingJDBC

Architect's Guide

Nov 11, 2022 · Databases

Database Sharding: Table Partitioning, Horizontal and Vertical Splitting, and Implementation with Sharding-JDBC and Mycat

This article explains why high‑concurrency big‑data systems need database sharding, describes table‑level partitioning methods (modulus and range), shows how to implement them with MySQL and Java code, compares vertical and horizontal database splitting, and evaluates middleware solutions such as Sharding‑JDBC and Mycat.

JavaMySQLSharding

0 likes · 11 min read

Database Sharding: Table Partitioning, Horizontal and Vertical Splitting, and Implementation with Sharding-JDBC and Mycat

Code Ape Tech Column

Oct 14, 2022 · Backend Development

Designing Scalable Systems: From a Single Server to Multi‑Node Architecture

This article explains how to design and evolve a system from a single‑server deployment to a highly scalable architecture using vertical and horizontal scaling, load balancing, database replication, sharding, caching, CDN, and stateless design to support billions of users.

Load Balancingdatabase replicationhorizontal scaling

0 likes · 20 min read

Designing Scalable Systems: From a Single Server to Multi‑Node Architecture

IT Architects Alliance

Sep 26, 2022 · Databases

Horizontal Scaling in TDSQL: Design Principles, Practices, and Case Studies

This article explains the background, challenges, and design principles of horizontal scaling for TDSQL, detailing its architecture, scaling process, shard‑key selection, high availability, distributed transactions, performance optimization, practical case studies, and a Q&A section.

Distributed DatabasesHigh AvailabilitySharding

0 likes · 24 min read

Horizontal Scaling in TDSQL: Design Principles, Practices, and Case Studies

Top Architect

Jun 30, 2022 · Databases

Database Sharding and Partitioning Strategies with Practical Implementation

This article explains why high‑traffic systems need database sharding, compares table‑level and database‑level partitioning methods, presents concrete MySQL table‑creation scripts and Java service code, and discusses the advantages, drawbacks, and common middleware solutions such as Sharding‑JDBC and Mycat.

MySQLMycatSharding-JDBC

0 likes · 12 min read

Database Sharding and Partitioning Strategies with Practical Implementation

Ctrip Technology

Jun 9, 2022 · Databases

Ctrip Order Database Architecture Optimization and Sharding Case Study

This article details Ctrip's comprehensive redesign of its airline ticket order database, covering the background performance bottlenecks, vertical and hot‑cold data splitting, sharding key selection, multi‑level caching, cross‑shard query optimization, dual‑write mechanisms, fault‑tolerance strategies, project planning, and the resulting improvements in scalability and cost.

Dual‑Writedatabase shardingfault tolerance

0 likes · 37 min read

Ctrip Order Database Architecture Optimization and Sharding Case Study

Architecture Digest

May 19, 2022 · Operations

Designing High‑Availability Stateless Services: Redundancy, Load Balancing, Scaling, and Monitoring

The article explains how to build highly available stateless services by using redundant deployment, vertical and horizontal scaling, appropriate load‑balancing algorithms, monitoring, and automated recovery, and also discusses high‑concurrency identification, CDN/OSS usage, and practical recommendations for cloud‑native environments.

High AvailabilityLoad BalancingScaling

0 likes · 11 min read

Designing High‑Availability Stateless Services: Redundancy, Load Balancing, Scaling, and Monitoring

Top Architect

Mar 16, 2022 · Databases

Comprehensive Guide to Database Sharding: Vertical & Horizontal Partitioning, Global ID Generation, and Distributed Transaction Challenges

This article explains the concepts, methods, advantages, and drawbacks of database sharding, covering vertical and horizontal partitioning, sharding rules, global primary key generation, distributed transaction issues, cross‑node queries, pagination, data migration, and practical case studies, with code examples and diagrams.

Global ID GenerationShardingdatabase partitioning

0 likes · 24 min read

Comprehensive Guide to Database Sharding: Vertical & Horizontal Partitioning, Global ID Generation, and Distributed Transaction Challenges

IT Architects Alliance

Mar 13, 2022 · Databases

Designing Scalable Systems for Billions of Users: Architecture, Scaling, and Database Strategies

This article explains how to evolve a simple single‑server web application into a highly available, horizontally scalable system by introducing DNS routing, vertical and horizontal scaling, load‑balancing, database replication, sharding, denormalization, SQL/NoSQL choices, caching, CDN, and GeoDNS techniques.

Cloud ArchitectureDatabaseLoad Balancing

0 likes · 18 min read

Designing Scalable Systems for Billions of Users: Architecture, Scaling, and Database Strategies

vivo Internet Technology

Oct 20, 2021 · Databases

Database Sharding Strategies: Common Approaches, Pitfalls, and Best Practices

Effective MySQL sharding requires sustainable, low‑skew designs, favoring hash‑based methods with proper coprime counts, two‑stage partitioning, routing tables, or consistent hashing, while supporting expansion via doubling or flexible consistent‑hash growth to avoid hot spots and uneven data distribution.

Data PartitioningHash ShardingMySQL

0 likes · 23 min read

Database Sharding Strategies: Common Approaches, Pitfalls, and Best Practices

Shopee Tech Team

Aug 26, 2021 · Databases

Database Architecture Evolution and Sharding Practice in Shopee's Logistics Service

Shopee’s Logistics Channel Service migrated from a shared‑cluster MySQL setup to dedicated clusters, added TiDB for transient tracking data, and ultimately adopted hash‑based sharding with separate order and tracking services plus an asynchronous compensation mechanism, enabling uniform data distribution, cross‑database consistency, six‑month archiving, and scalable growth without rebalancing.

Database ArchitectureMySQLTiDB

0 likes · 18 min read

Database Architecture Evolution and Sharding Practice in Shopee's Logistics Service

IT Architects Alliance

Jun 10, 2021 · Cloud Native

Designing High‑Availability Stateless Services: Load Balancing, Scaling, and Deployment Strategies

This article explains how to achieve high availability for stateless services by employing redundancy, vertical and horizontal scaling, various load‑balancing algorithms (random, round‑robin, weighted, least‑connections, source‑hash), and automatic scaling techniques in cloud‑native environments, while also covering performance monitoring and CDN/OSS usage.

High AvailabilityLoad Balancingauto scaling

0 likes · 10 min read

Designing High‑Availability Stateless Services: Load Balancing, Scaling, and Deployment Strategies

DevOps Cloud Academy

Mar 1, 2021 · Cloud Computing

Why Moving to the Cloud Is Not Just a Simple Lift‑and‑Shift: Lessons on Elasticity, Stateless Design, and Architecture

The article explains that migrating legacy monolithic systems to the cloud is far from a simple lift‑and‑shift, highlighting the pitfalls of inflexible on‑premise infrastructure, the importance of horizontal scaling, stateless application design, micro‑service decomposition, and asynchronous communication to fully leverage cloud elasticity and cost efficiency.

Statelessarchitectureasynchronous

0 likes · 11 min read

Why Moving to the Cloud Is Not Just a Simple Lift‑and‑Shift: Lessons on Elasticity, Stateless Design, and Architecture

Architects' Tech Alliance

Jan 4, 2021 · Backend Development

System Splitting and Architectural Evolution: Strategies for Scaling, Decoupling, and Performance Optimization

The article explains how increasing business complexity and throughput demands drive system splitting, architectural evolution, and the adoption of scaling, sharding, caching, and asynchronous messaging techniques to improve capacity, robustness, and maintainability of large‑scale backend services.

architecture evolutionasynchronous processingcaching

0 likes · 7 min read

System Splitting and Architectural Evolution: Strategies for Scaling, Decoupling, and Performance Optimization