BestHub
Sign in
Tagged articles
117 articles
Page 1 of 2
Java Companion
Java Companion
Apr 26, 2026 · Databases

Is Sharding Ready to Retire? Why the Classic Split‑Database Approach Is Becoming Legacy

The article reviews the rise and decline of traditional database sharding, explains its technical pitfalls such as wrong shard keys, cross‑database joins, and distributed transactions, compares it with emerging NewSQL solutions like TiDB, OceanBase and PolarDB‑X, and offers practical criteria for choosing the right architecture.

NewSQLOceanBasePolarDB-X
0 likes · 14 min read
Is Sharding Ready to Retire? Why the Classic Split‑Database Approach Is Becoming Legacy
IT Services Circle
IT Services Circle
Apr 11, 2026 · Databases

Why Sharding Isn’t Dead: Modern Alternatives and When to Use Them

The article revisits the rise and fall of database sharding, explains why it became problematic, and evaluates newer cloud‑native, distributed‑SQL, and serverless databases as modern replacements, offering a practical four‑step guide to help engineers choose the right solution for their workload and team.

Cloud NativeDistributed SQLOperations
0 likes · 23 min read
Why Sharding Isn’t Dead: Modern Alternatives and When to Use Them
Tech Freedom Circle
Tech Freedom Circle
Mar 25, 2026 · Backend Development

Cracking Alibaba’s 10M Orders Interview: Architecture Seven‑Suite + Heterogeneous Storage Solution

The article dissects Alibaba’s second‑round interview question on handling 10 million daily order queries, exposing why a single sharding answer fails and presenting a comprehensive architecture‑seven‑suite combined with heterogeneous storage (MySQL, HBase, ClickHouse, ES, Redis, MQ) to achieve high concurrency, low latency, and reliable data consistency.

Backend ArchitectureDistributed SystemsInterview Preparation
0 likes · 40 min read
Cracking Alibaba’s 10M Orders Interview: Architecture Seven‑Suite + Heterogeneous Storage Solution
SpringMeng
SpringMeng
Feb 7, 2026 · Databases

Redis’s Multithreaded Query Engine Boosts RAG Performance

Redis introduces a multithreaded query engine that keeps average latency under 10 ms while delivering up to 16× higher throughput for vector‑search workloads, enabling faster retrieval‑augmented generation (RAG) applications and outperforming pure vector databases and managed Redis services in benchmark tests.

BenchmarkMultithreaded QueryRAG
0 likes · 6 min read
Redis’s Multithreaded Query Engine Boosts RAG Performance
Architect's Guide
Architect's Guide
Jan 27, 2026 · Databases

How to Scale an Order System with Sharding, Distributed IDs, and Seata Transactions

This article details a comprehensive redesign of a high‑traffic order system, covering the challenges of massive data volume, concurrency pressure, and poor scalability, and presenting a step‑by‑step solution that includes sharding strategy selection, database product comparison, unique ID generation, middleware choice, migration plan, risk mitigation, and FAQ handling.

Backend ArchitectureSeatadatabase scaling
0 likes · 17 min read
How to Scale an Order System with Sharding, Distributed IDs, and Seata Transactions
Volcano Engine Developer Services
Volcano Engine Developer Services
Jan 26, 2026 · Databases

How Volcano Engine veDB Scales to Tens of Thousands of Pods with Cloud‑Native Architecture

This article explains how Volcano Engine's veDB leverages compute‑storage separation, Kubernetes operators, and declarative operations to achieve extreme deployment density, seamless scaling, and high‑availability for millions of database instances, while addressing the challenges of traditional VM‑based deployments.

Cloud NativeOperatordatabase scaling
0 likes · 14 min read
How Volcano Engine veDB Scales to Tens of Thousands of Pods with Cloud‑Native Architecture
AI Engineering
AI Engineering
Jan 24, 2026 · Databases

Can One PostgreSQL Instance Power 800 Million Users? OpenAI’s Trade‑offs Unpacked

OpenAI runs a single primary PostgreSQL with about 50 replicas to serve roughly 800 million ChatGPT users, employing PgBouncer connection pooling, cache‑lock mechanisms, query and schema optimizations, workload isolation, multi‑layer throttling, and cascade replication, while acknowledging the architecture’s limits and the complexity of full sharding.

Azure CosmosDBCascade ReplicationOpenAI
0 likes · 8 min read
Can One PostgreSQL Instance Power 800 Million Users? OpenAI’s Trade‑offs Unpacked
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 16, 2026 · Backend Development

Why Bigger Connection Pools Fail Under High Concurrency and What to Do Instead

Increasing a database connection pool size often worsens performance under massive traffic because the bottleneck lies in hardware limits and management overhead, so developers must adopt async processing, read‑write splitting, caching, sharding, and proper pool tuning to sustain high concurrency.

Backend PerformanceConnection Poolasynchronous processing
0 likes · 4 min read
Why Bigger Connection Pools Fail Under High Concurrency and What to Do Instead
java1234
java1234
Jan 10, 2026 · Databases

MySQL 8.2 Finally Supports Read/Write Splitting

MySQL 8.2 introduces native read/write splitting via MySQL Router, allowing automatic routing of reads to replicas and writes to the primary in an InnoDB ReplicaSet without any application changes.

InnoDB ReplicaSetRouterdatabase scaling
0 likes · 4 min read
MySQL 8.2 Finally Supports Read/Write Splitting
Raymond Ops
Raymond Ops
Jan 9, 2026 · Databases

Master MongoDB Sharding: From Single Server to Enterprise-Scale Cluster

When a single‑node MongoDB instance can no longer handle tens of millions of records, this guide walks you through the theory, architecture, deployment steps, shard key strategies, performance tuning, monitoring, backup, and troubleshooting needed to build a robust, production‑grade sharded cluster.

BackupMongoDBOps
0 likes · 14 min read
Master MongoDB Sharding: From Single Server to Enterprise-Scale Cluster
Architect
Architect
Dec 28, 2025 · Databases

How to Scale an Order System: Sharding, ID Generation, and Database Choices

This article walks through the challenges of a growing order system, analyzes current bottlenecks, compares sharding and distributed database products, proposes a unique ID strategy, outlines sharding key selection, presents a migration plan with ShardingSphere‑JDBC, and discusses risks and FAQs for a robust backend architecture.

Distributed TransactionsUnique IDdatabase scaling
0 likes · 18 min read
How to Scale an Order System: Sharding, ID Generation, and Database Choices
Top Architect
Top Architect
Dec 15, 2025 · Databases

How to Add a Column to a Billion‑Row Order Table Without Downtime

When a core order table with tens of millions of rows needs a new column, naïve ALTER TABLE can lock the table and disrupt services, so this article explores safe alternatives such as master‑slave switching, online DDL tools, extension tables, JSON‑based schema‑less designs, and clever reuse of existing redundant fields, complete with practical code snippets and lessons learned.

DDLJSONOnline DDL
0 likes · 9 min read
How to Add a Column to a Billion‑Row Order Table Without Downtime
macrozheng
macrozheng
Dec 3, 2025 · Databases

How Redis’s New Multithreaded Query Engine Boosts Vector Search Performance

Redis has introduced a multithreaded query engine that dramatically reduces latency and increases throughput—up to 16×—for vector similarity searches, enabling vertical scaling and better support for real‑time RAG applications compared to traditional single‑threaded architectures and competing vector databases.

RAGdatabase scalingmultithreading
0 likes · 6 min read
How Redis’s New Multithreaded Query Engine Boosts Vector Search Performance
Tech Freedom Circle
Tech Freedom Circle
Nov 28, 2025 · Databases

How to Achieve MySQL Sub‑Second Scaling for 100M‑10B Rows (Interview Scenario)

The article analyzes a JD interview question on scaling a MySQL order table from 100 million to billions of rows, detailing four practical expansion strategies—stop‑service migration, double‑write migration, ShardingSphere middleware, and dual‑VIP routing—each with step‑by‑step procedures, code samples, risk assessments, and validation methods to enable near‑instant capacity growth without service interruption.

ShardingSpheredatabase scalingdouble write
0 likes · 42 min read
How to Achieve MySQL Sub‑Second Scaling for 100M‑10B Rows (Interview Scenario)
Senior Brother's Insights
Senior Brother's Insights
Oct 29, 2025 · Databases

Sharding vs Partitioning: When and How to Scale Your Database

This article explains the concepts, differences, advantages, and disadvantages of database sharding and partitioning, provides practical MySQL examples for horizontal sharding by region and range partitioning, and offers guidance on choosing the right approach for scalability and maintainability.

Partitioningdata distributiondatabase scaling
0 likes · 10 min read
Sharding vs Partitioning: When and How to Scale Your Database
Architect's Guide
Architect's Guide
Oct 1, 2025 · Backend Development

How to Build High‑Traffic, High‑Concurrency Systems: Key Principles & Practices

Designing high‑traffic, high‑concurrency systems requires careful planning across architecture, client optimization, CDN usage, clustering, caching, database tuning, and service governance, with principles such as statelessness, modularity, and fault‑tolerance to ensure scalability, reliability, and maintainability.

Backend ArchitectureSystem Designcaching
0 likes · 12 min read
How to Build High‑Traffic, High‑Concurrency Systems: Key Principles & Practices
MaGe Linux Operations
MaGe Linux Operations
Sep 13, 2025 · Databases

Master MySQL Performance: From Slow Queries to Billion-Row Optimization

This comprehensive guide walks you through real-world MySQL performance tuning, covering slow query analysis, index design, query optimization, parameter tuning, hardware considerations, sharding, and fault handling, with practical scripts and case studies to help you transform sluggish databases into high‑throughput, scalable systems.

Index Optimizationdatabase scalingmysql
0 likes · 24 min read
Master MySQL Performance: From Slow Queries to Billion-Row Optimization
Cognitive Technology Team
Cognitive Technology Team
Aug 24, 2025 · Databases

When Auto‑Increment IDs Exhaust: Risks and Scalable Solutions for MySQL & PostgreSQL

This article examines how auto‑increment primary keys work, the limits of common integer types, the failures that occur when those limits are reached, and practical strategies—including type upgrades, distributed ID generators, sharding, and sequence cycling—to prevent and mitigate ID exhaustion in high‑traffic MySQL and PostgreSQL deployments.

PostgreSQLauto_incrementdatabase scaling
0 likes · 9 min read
When Auto‑Increment IDs Exhaust: Risks and Scalable Solutions for MySQL & PostgreSQL
MaGe Linux Operations
MaGe Linux Operations
Aug 12, 2025 · Databases

Master MongoDB Sharding: From Single Server to Scalable Cluster Deployment

This comprehensive guide explains MongoDB sharding fundamentals, walks through step‑by‑step deployment of config servers, shard replica sets, and mongos routers, compares range, hash, and compound shard keys, and provides performance tuning, security, backup, monitoring, and troubleshooting best practices for production‑grade clusters.

Cluster DeploymentConfig ServersMongoDB
0 likes · 13 min read
Master MongoDB Sharding: From Single Server to Scalable Cluster Deployment
Selected Java Interview Questions
Selected Java Interview Questions
Jul 8, 2025 · Databases

How to Scale 1 Billion Orders with MySQL Sharding: Strategies, Gene IDs, and Migration

This article explores the performance bottlenecks of a 700‑million‑row MySQL orders table and presents a comprehensive sharding solution—including vertical and horizontal partitioning, gene‑based shard keys, routing logic, global secondary indexes, data migration strategies, and common pitfalls—demonstrating how query latency can drop from seconds to milliseconds while supporting billions of records.

Data MigrationPartitioningdatabase scaling
0 likes · 9 min read
How to Scale 1 Billion Orders with MySQL Sharding: Strategies, Gene IDs, and Migration
Su San Talks Tech
Su San Talks Tech
Jul 3, 2025 · Databases

Mastering MySQL Sharding: Strategies for 1 Billion Orders

This article explores the pain points of a 700‑million‑row MySQL order table, presents vertical and horizontal sharding strategies, introduces gene‑based Snowflake IDs, details routing logic, migration steps, common pitfalls, and shows performance gains after applying the final architecture.

Distributed SystemsPerformance Optimizationdatabase scaling
0 likes · 9 min read
Mastering MySQL Sharding: Strategies for 1 Billion Orders
Java Backend Technology
Java Backend Technology
May 16, 2025 · Databases

How to Prevent MySQL Auto‑Increment ID Exhaustion: 6 Proven Strategies

When MySQL auto‑increment IDs approach their limit, this guide explains six practical solutions—including expanding column types, using UUIDs, segmenting ID generation, composite keys, adjusting increment steps, and sharding databases—to ensure scalable, unique identifiers for large‑scale applications.

ID Exhaustionauto_incrementdatabase scaling
0 likes · 7 min read
How to Prevent MySQL Auto‑Increment ID Exhaustion: 6 Proven Strategies
Su San Talks Tech
Su San Talks Tech
Jan 7, 2025 · Databases

7 Common Pitfalls of Database Sharding and How to Solve Them

This article examines seven typical challenges that arise after implementing database sharding—such as global ID conflicts, cross‑shard queries, distributed transactions, shard‑key design, data migration, pagination, and operational overhead—and provides practical solutions and code examples to address each issue.

Distributed SystemsID generationdatabase scaling
0 likes · 12 min read
7 Common Pitfalls of Database Sharding and How to Solve Them
Lobster Programming
Lobster Programming
Dec 26, 2024 · Databases

How to Migrate Tens of Millions of Rows: Strategies and Practical Steps

This article explains common data‑migration strategies such as hash‑modulo, time‑range and ID‑range sharding, and compares practical migration solutions including downtime migration, dual‑write, and an MQ + Redis approach, with detailed workflow diagrams and implementation tips.

Data MigrationMessage Queuedatabase scaling
0 likes · 8 min read
How to Migrate Tens of Millions of Rows: Strategies and Practical Steps
Architect's Guide
Architect's Guide
Dec 11, 2024 · Databases

Challenges and Limitations of Database Sharding in Large‑Scale E‑commerce Systems

The article examines why MySQL sharding (分库分表) is adopted for high‑traffic e‑commerce, outlines its inherent problems such as distributed transaction handling, index and global key constraints, operational overhead, and argues that distributed databases like OceanBase offer a more robust alternative.

Distributed Transactionsdatabase scalingglobal primary key
0 likes · 10 min read
Challenges and Limitations of Database Sharding in Large‑Scale E‑commerce Systems
Practical DevOps Architecture
Practical DevOps Architecture
Nov 5, 2024 · Backend Development

Comprehensive Video Series on Software Architecture for Aspiring Architects

This extensive series of 50 video lessons covers fundamental and advanced topics such as technology selection, capacity planning, micro‑service design, database scaling, caching strategies, load balancing, decoupling, layering, and service mesh, providing engineers with the knowledge needed to become proficient architects.

Backend DevelopmentSoftware Architecturecaching
0 likes · 6 min read
Comprehensive Video Series on Software Architecture for Aspiring Architects
Architect
Architect
Oct 27, 2024 · Backend Development

How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks

This article details the end‑to‑end architecture and step‑by‑step performance tuning of a high‑traffic lottery platform, covering server‑level rate limiting, application‑level throttling, semaphore usage, user‑behavior detection, caching strategies, database optimizations, and hardware upgrades that together enabled stable handling of millions of daily requests.

Backend ArchitecturePerformance Optimizationdatabase scaling
0 likes · 15 min read
How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks
Architect
Architect
Oct 1, 2024 · Backend Development

How We Engineered a Million‑User Lottery System to Survive Massive Spikes

This article details the end‑to‑end architecture, rate‑limiting strategies, caching layers, database optimizations, and hardware upgrades that enabled a lottery service to handle daily traffic exceeding one million users during peak promotional events.

Backend ArchitecturePerformance Optimizationcaching
0 likes · 15 min read
How We Engineered a Million‑User Lottery System to Survive Massive Spikes
Tencent Cloud Developer
Tencent Cloud Developer
Aug 15, 2024 · Fundamentals

Understanding the End-to-End Process of a Web Request: IP, DNS, CDN, TCP, Protocol Design, CGI/FastCGI, Server Models, and Database Evolution

The article walks through every stage of a web request—from IPv4 addressing, NAT, and DNS resolution through CDN proximity and TCP stream handling, to HTTP framing, CGI versus FastCGI processing, stateless versus stateful server models, and finally database scaling techniques such as sharding and Redis caching.

CDNCGIDNS
0 likes · 21 min read
Understanding the End-to-End Process of a Web Request: IP, DNS, CDN, TCP, Protocol Design, CGI/FastCGI, Server Models, and Database Evolution
JD Tech
JD Tech
Aug 9, 2024 · Backend Development

Designing High‑Concurrency Systems: From Single‑Machine Optimizations to Distributed Architecture

This article explains how to build high‑concurrency systems by analyzing hardware and code optimizations on a single machine, exploring multi‑machine scaling, database and business‑application considerations, and presenting a practical inventory‑stock case that evolves from simple locking to partitioned, asynchronous, Redis‑based designs.

System Architecturecachingdatabase scaling
0 likes · 18 min read
Designing High‑Concurrency Systems: From Single‑Machine Optimizations to Distributed Architecture
21CTO
21CTO
May 25, 2024 · Databases

How Pinterest Scaled Its Architecture: From Clusters to Sharding

This article examines Pinterest's evolution through four development phases, the core technologies it adopted, and how it transitioned from complex clustering to a simpler sharding architecture to achieve scalable, high‑availability data storage.

Pinterestarchitectureclustering
0 likes · 11 min read
How Pinterest Scaled Its Architecture: From Clusters to Sharding
Sohu Tech Products
Sohu Tech Products
Apr 10, 2024 · Databases

ShardingSphere-JDBC Database Sharding Tutorial Project

The tutorial project showcases how to implement database sharding with ShardingSphere-JDBC (versions 4 and 5) in a SpringBoot O2O order service, providing modules for sharding, a gRPC ID generator, detailed configuration of four data sources, sharding algorithms, and Swagger-based testing of order creation and queries.

ShardingSphere-JDBCSpringBootdatabase scaling
0 likes · 5 min read
ShardingSphere-JDBC Database Sharding Tutorial Project
AntTech
AntTech
Apr 3, 2024 · Artificial Intelligence

Post‑Mortem of an AI‑Generated Flash‑Sale System Failure at Ant Internal Network

The article analyzes a recent outage of Ant's internal flash‑sale service built with AI‑generated low‑code, explains why the AI‑written business logic was not the cause, details the database capacity bottleneck that triggered a snowball effect, and discusses future automation and operational strategies to prevent similar failures.

AIOperationsdatabase scaling
0 likes · 12 min read
Post‑Mortem of an AI‑Generated Flash‑Sale System Failure at Ant Internal Network
Su San Talks Tech
Su San Talks Tech
Feb 21, 2024 · Databases

Mastering MySQL Sharding: Strategies, Pitfalls, and Best Practices

This comprehensive guide explains why MySQL sharding (分库分表) is essential for handling massive data growth, outlines various horizontal and vertical partitioning strategies, discusses common challenges such as hot‑spot, cross‑database queries, pagination, and transaction handling, and compares popular middleware solutions.

Partitioningdatabase scalingmysql
0 likes · 28 min read
Mastering MySQL Sharding: Strategies, Pitfalls, and Best Practices
Architect
Architect
Feb 17, 2024 · Backend Development

How Bilibili Scaled Its Membership Purchase System: Call‑Chain Refactor, Async Ordering, and Sharding

This article details how Bilibili’s membership‑purchase platform tackled massive traffic spikes by redesigning the order call chain, introducing concurrent and asynchronous processing, and applying a sharding strategy that split databases and tables, ultimately boosting latency performance and supporting over 4,000 TPS during peak sales.

BackendMicroservicesPerformance Optimization
0 likes · 15 min read
How Bilibili Scaled Its Membership Purchase System: Call‑Chain Refactor, Async Ordering, and Sharding
Architect's Guide
Architect's Guide
Nov 15, 2023 · Databases

Smooth 2N Database Scaling and High Availability with MariaDB, Keepalived, and Sharding

This article presents five expansion strategies—shutdown, write‑stop, log‑based, dual‑write, and smooth 2N—detailing step‑by‑step procedures for MariaDB installation, master‑master replication, dynamic data‑source configuration, and Keepalived high‑availability setup, enabling seamless horizontal scaling and minimal service disruption for large‑scale databases.

MariaDBdatabase scalinghigh availability
0 likes · 30 min read
Smooth 2N Database Scaling and High Availability with MariaDB, Keepalived, and Sharding
Architect
Architect
Sep 11, 2023 · Databases

How eBay Scaled ClickHouse with Read/Write Separation and Keeper

This article details eBay's event monitoring platform architecture, explains the challenges of high‑load OLAP workloads on ClickHouse clusters, describes the design and implementation of read/write separation and multi‑shard Keeper coordination, and shares concrete configuration snippets, performance observations, and production lessons learned.

ClickHouseDistributed SystemsKeeper
0 likes · 20 min read
How eBay Scaled ClickHouse with Read/Write Separation and Keeper
Architect's Guide
Architect's Guide
Jun 15, 2023 · Databases

Splitting a Massive MySQL Financial Transaction Table: Challenges, Design, and Implementation

The article describes how a finance team tackled a 50‑million‑row MySQL transaction table by analyzing the pain points, defining split goals, selecting sharding‑jdbc, designing multi‑source transaction handling, pagination across shards, data migration strategies, and a staged rollout to ensure stability and performance.

Backend DevelopmentData MigrationTable Sharding
0 likes · 10 min read
Splitting a Massive MySQL Financial Transaction Table: Challenges, Design, and Implementation
Architecture Digest
Architecture Digest
May 15, 2023 · Databases

Case Study: Splitting a Massive MySQL Financial Transaction Table Using Sharding-JDBC

This article details how a finance team tackled a 50‑million‑row MySQL transaction table by designing a horizontal sharding strategy with Sharding‑JDBC, addressing performance bottlenecks, multi‑source transaction handling, pagination across shards, and a phased data migration and rollout plan.

Backend DevelopmentData Migrationdatabase scaling
0 likes · 11 min read
Case Study: Splitting a Massive MySQL Financial Transaction Table Using Sharding-JDBC
IT Architects Alliance
IT Architects Alliance
Apr 14, 2023 · Databases

Comprehensive Guide to Database Horizontal Scaling, Smooth 2N Expansion, and Keepalived High‑Availability Configuration

This technical guide explains how to scale a sharded database horizontally by introducing five expansion schemes—including shutdown, write‑stop, log‑based, dual‑write, and smooth 2N approaches—covers MariaDB installation, master‑master replication setup, dynamic data‑source configuration with ShardingJDBC, and detailed Keepalived high‑availability configuration for seamless service continuity.

Dual WriteDynamic Data SourceMariaDB
0 likes · 31 min read
Comprehensive Guide to Database Horizontal Scaling, Smooth 2N Expansion, and Keepalived High‑Availability Configuration
Su San Talks Tech
Su San Talks Tech
Mar 14, 2023 · Databases

How to Solve Read‑Amplification in MySQL Sharding: Strategies & Tips

This article explains the concepts of database sharding, compares vertical and horizontal partitioning, discusses ID‑range and modulo sharding methods, analyzes the read‑amplification problem caused by non‑sharding keys, and presents practical solutions such as auxiliary index tables, Elasticsearch integration, and TiDB adoption.

ElasticsearchTiDBdatabase scaling
0 likes · 14 min read
How to Solve Read‑Amplification in MySQL Sharding: Strategies & Tips
Efficient Ops
Efficient Ops
Feb 12, 2023 · Databases

Why Single‑Node MySQL Is No Longer Enough: Embrace Distributed Databases

The article explains the limitations of standalone MySQL for large‑scale workloads, explores sharding, read/write separation, and middleware approaches, and argues that modern distributed databases and cloud‑native solutions are the sustainable path forward for data‑intensive applications.

Cloud Databasesdatabase scalingdistributed databases
0 likes · 6 min read
Why Single‑Node MySQL Is No Longer Enough: Embrace Distributed Databases
Programmer DD
Programmer DD
Jan 10, 2023 · Databases

How YouTube Scales Billions of Videos with Vitess and Distributed Databases

This article explores how YouTube handles massive video uploads and billions of daily views by employing a sophisticated backend stack—including MySQL clusters powered by Vitess, sharding, replication, caching, disaster recovery, and cloud‑native deployment on Kubernetes—ensuring scalability, reliability, and low‑latency delivery.

VitessYouTubedatabase scaling
0 likes · 13 min read
How YouTube Scales Billions of Videos with Vitess and Distributed Databases
Java High-Performance Architecture
Java High-Performance Architecture
Jan 5, 2023 · Databases

Scaling Billions of Orders: MySQL Sharding, ES & Hive Strategies

This article explains how to handle massive order volumes by classifying data into hot and cold tiers, storing them in MySQL, Elasticsearch, and Hive, and implementing sharding and partitioning strategies—including shard keys, modulo routing, and combined database‑table distribution—to achieve high throughput and low cost.

ElasticsearchHivedatabase scaling
0 likes · 8 min read
Scaling Billions of Orders: MySQL Sharding, ES & Hive Strategies
ITPUB
ITPUB
Jan 1, 2023 · Databases

Why Single-Node MySQL Fails and Distributed Databases Are the Future

Even non-programmers notice MySQL’s growing pains—large tables, oversized databases, and read-heavy workloads—prompting a shift toward distributed databases, where sharding, read/write separation, and cloud-native solutions like TiDB or Aurora replace traditional middleware, marking the end of single-node MySQL dominance.

database scalingdistributed databasesmiddleware
0 likes · 7 min read
Why Single-Node MySQL Fails and Distributed Databases Are the Future
Java Backend Technology
Java Backend Technology
Dec 29, 2022 · Databases

Why MySQL Must Evolve: From Single‑Node Limits to Distributed Databases

The article explains how traditional single‑node MySQL faces scalability challenges such as massive tables, resource exhaustion, and read‑heavy workloads, and argues that adopting sharding, middleware, or modern distributed databases like TiDB, OceanBase, Aurora, and PolarDB is the inevitable path forward for robust data management.

cloud databasedatabase scalingdistributed database
0 likes · 6 min read
Why MySQL Must Evolve: From Single‑Node Limits to Distributed Databases
macrozheng
macrozheng
Dec 28, 2022 · Databases

Why Single‑Node MySQL Won’t Scale and How to Move to Distributed Databases

The article explains the limitations of standalone MySQL, outlines common scaling problems such as oversized tables and high read traffic, and compares middleware‑based sharding solutions with modern distributed databases, highlighting why the latter are becoming the preferred choice for growing applications.

database scalingdistributed databasemiddleware
0 likes · 6 min read
Why Single‑Node MySQL Won’t Scale and How to Move to Distributed Databases
Bilibili Tech
Bilibili Tech
Nov 19, 2022 · Operations

Technical Assurance for High‑Write Live‑Streaming Gift Scenarios

The technical‑assurance team secured Bilibili’s high‑write live‑stream gift system by expanding capacity, isolating hot keys, refactoring pipelines, adding asynchronous writes, employing horizontal scaling and full‑link load testing, converting uncertain dependencies into graceful fallbacks, and deploying dual‑active, chaos‑engineered disaster‑resilience architecture aligned with business usage patterns.

SREcapacity planningdatabase scaling
0 likes · 16 min read
Technical Assurance for High‑Write Live‑Streaming Gift Scenarios
ITPUB
ITPUB
Nov 7, 2022 · Databases

Scaling MySQL for 20k+ Concurrent Users: Sharding and Read‑Write Separation

Managing 20,000+ concurrent SQL queries requires moving beyond a single‑instance design; this guide explains why simple architectures fail, how to shard databases into multiple instances, route traffic using geographic hashing, and implement read‑write separation to sustain high read loads while keeping latency low.

Read-Write SeparationSQLdatabase scaling
0 likes · 7 min read
Scaling MySQL for 20k+ Concurrent Users: Sharding and Read‑Write Separation
Top Architect
Top Architect
Oct 19, 2022 · Databases

MySQL Replication, High Availability, and Sharding: Concepts and Solutions

This article explains the evolution from single‑node MySQL databases to master‑slave replication, various replication modes, high‑availability strategies, and both vertical and horizontal sharding techniques, while discussing the associated challenges such as distributed transactions, routing, and operational complexity.

Distributed TransactionsReplicationdatabase scaling
0 likes · 11 min read
MySQL Replication, High Availability, and Sharding: Concepts and Solutions
Architect's Guide
Architect's Guide
Oct 19, 2022 · Databases

Database Scaling, Replication, High Availability, and Sharding Overview

This article explains why single‑node databases cannot keep up with rapid business growth and describes MySQL replication methods, high‑availability solutions such as MHA and MGR, and the challenges and techniques of vertical and horizontal sharding for large‑scale systems.

Replicationdatabase scalinghigh availability
0 likes · 11 min read
Database Scaling, Replication, High Availability, and Sharding Overview
Architecture Digest
Architecture Digest
Sep 9, 2022 · Databases

MySQL Replication, High Availability, and Sharding Strategies

This article explains the evolution from single‑node MySQL to master‑slave replication, various replication modes, high‑availability solutions such as MHA and MGR, and the challenges and techniques of vertical and horizontal sharding for scaling large‑scale internet applications.

Distributed TransactionsReplicationdatabase scaling
0 likes · 12 min read
MySQL Replication, High Availability, and Sharding Strategies
FunTester
FunTester
Jul 21, 2022 · Databases

Scaling Databases with Distributed Sharding and Peak‑Shaving Strategies

The article explains why simply adding hardware cannot keep up with growing database workloads and presents a three‑step approach—business isolation, horizontal sharding, and advanced reporting using PolarDB‑X—to achieve high concurrency, elastic capacity, and efficient caching for modern high‑traffic applications.

Distributed SystemsPeak ShavingPolarDB-X
0 likes · 7 min read
Scaling Databases with Distributed Sharding and Peak‑Shaving Strategies
Programmer DD
Programmer DD
Jul 20, 2022 · Databases

Mastering MySQL Sharding: Strategies, ID Generation, and Seamless Scaling

This article explains why and how to apply database sharding, introduces key terminology, compares global ID generation methods such as auto‑increment, UUID, COMB and Snowflake, outlines sharding algorithms, discusses challenges like distributed transactions, and presents practical expansion and implementation solutions.

ID generationdatabase scalingmysql
0 likes · 12 min read
Mastering MySQL Sharding: Strategies, ID Generation, and Seamless Scaling
Architecture Digest
Architecture Digest
Apr 4, 2022 · Databases

Splitting a Massive MySQL Financial Transaction Table: Challenges, Sharding Strategy, and Migration Process

This article describes how a finance team tackled a 500 million‑row MySQL transaction table by analyzing pre‑split issues, defining sharding goals, selecting sharding‑jdbc, addressing multi‑datasource transaction and pagination challenges, designing a hybrid data‑migration plan, and executing a three‑stage rollout to ensure system stability and performance.

Data Migrationdatabase scalingmysql
0 likes · 11 min read
Splitting a Massive MySQL Financial Transaction Table: Challenges, Sharding Strategy, and Migration Process
Java Interview Crash Guide
Java Interview Crash Guide
Jan 18, 2022 · Databases

Why We Switched from SQL Server to Elasticsearch: A Real‑World Scaling Journey

This article shares a practical experience of replacing a massive SQL Server data store with Elasticsearch, covering the motivations, architectural design, performance advantages, indexing mechanisms, data synchronization strategies, implementation details, and operational considerations for handling tens of billions of records.

ElasticsearchNoSQLdatabase scaling
0 likes · 38 min read
Why We Switched from SQL Server to Elasticsearch: A Real‑World Scaling Journey
NiuNiu MaTe
NiuNiu MaTe
Dec 15, 2021 · Databases

Master MySQL Performance: Practical Tuning, Indexes, and Scaling Strategies

This comprehensive guide walks through MySQL performance fundamentals, real‑world testing results, slow‑query detection, index impact, pagination pitfalls, count optimizations, sharding techniques, and step‑by‑step migration plans for large tables, equipping engineers with actionable tuning insights.

Index Optimizationdatabase scalingmysql
0 likes · 13 min read
Master MySQL Performance: Practical Tuning, Indexes, and Scaling Strategies
Open Source Linux
Open Source Linux
Nov 17, 2021 · Backend Development

Mastering Common Backend Architecture Patterns: From Single‑DB to Read‑Write Separation

This article explains six typical system architecture designs, focusing on the first three—single‑database single‑app, content‑delivery, and read‑write separation—detailing their structures, advantages, disadvantages, and practical implementation steps for modern backend development.

Backend ArchitectureContent Delivery NetworkRead-Write Separation
0 likes · 9 min read
Mastering Common Backend Architecture Patterns: From Single‑DB to Read‑Write Separation
High Availability Architecture
High Availability Architecture
Oct 26, 2021 · Databases

Practical Guide to Horizontal Database Sharding: Design Principles, Common Schemes, and Expansion Strategies

This article explains the background, design criteria, and practical implementations of horizontal database sharding—including range, hash, gene, routing‑table, and consistent‑hash methods—while discussing common pitfalls, data‑skew mitigation, and both doubling and consistent‑hash expansion techniques for MySQL clusters.

consistent hashingdatabase scalinghash algorithm
0 likes · 24 min read
Practical Guide to Horizontal Database Sharding: Design Principles, Common Schemes, and Expansion Strategies
dbaplus Community
dbaplus Community
Oct 21, 2021 · Databases

How We Scaled an E‑commerce Order System with Sharding, Consistent Hashing, and Zero‑Downtime Migration

This article details how a rapidly growing e‑commerce platform migrated from a single MySQL instance to a 16‑shard architecture using Sharding‑Jdbc, introduced consistent‑hashing to mitigate data skew, leveraged ES+HBase for multi‑dimensional queries, and implemented zero‑downtime migration strategies such as dual‑write and Canal replication.

ElasticsearchHBaseconsistent hashing
0 likes · 21 min read
How We Scaled an E‑commerce Order System with Sharding, Consistent Hashing, and Zero‑Downtime Migration
Architecture Digest
Architecture Digest
Sep 16, 2021 · Databases

Designing High‑Throughput Payment Systems: Ant Group’s LDC Architecture, CRG Zones, and CAP Analysis

The article explains how Ant Group’s Alipay handles massive double‑11 payment traffic by using logical data centers (LDC), unit‑based architecture with RZone, GZone and CZone, traffic routing, disaster‑recovery strategies, and a CAP‑aware design built on the OceanBase distributed database.

CAP theoremDistributed SystemsHigh TPS
0 likes · 35 min read
Designing High‑Throughput Payment Systems: Ant Group’s LDC Architecture, CRG Zones, and CAP Analysis
IT Architects Alliance
IT Architects Alliance
Jul 22, 2021 · Fundamentals

Key Responsibilities and Skills for Software Architects

The article outlines the essential duties, required competencies, decision‑making principles, and optimization techniques for software architects, covering system decomposition, technology selection, communication, technical depth, performance tuning, database scaling, and the broader mindset needed to lead complex development projects.

Performance OptimizationSoftware ArchitectureSystem Design
0 likes · 16 min read
Key Responsibilities and Skills for Software Architects
Full-Stack Internet Architecture
Full-Stack Internet Architecture
May 12, 2021 · Databases

Database Scaling Strategies: From Single Instance to Smooth Horizontal Expansion

The article explains how to evolve a simple single‑instance database into a highly available, horizontally sharded system, detailing offline scaling, online dual‑write migration, and a smooth four‑node expansion process with configuration changes, data migration, and cleanup steps.

Configuration Managementdatabase scalinghigh availability
0 likes · 6 min read
Database Scaling Strategies: From Single Instance to Smooth Horizontal Expansion
Alibaba Cloud Developer
Alibaba Cloud Developer
May 10, 2021 · Databases

How to Solve Cross-Database Transactions with Sharding: A Practical Guide

This article explains how to handle multi-table cross-database transactions by aligning sharding strategies for related tables, using a case study of shop_order_detail and shop_order_stat, and provides detailed formulas and TDDL configuration code to ensure consistent routing within the same database shard.

JavaTDDLcross-database transaction
0 likes · 11 min read
How to Solve Cross-Database Transactions with Sharding: A Practical Guide
JD Retail Technology
JD Retail Technology
Apr 15, 2021 · Backend Development

How We Scaled JD’s UGC Platform with Elasticsearch: A Backend Architecture Deep Dive

This case study details how JD’s "Browse" UGC project evolved from rapid agile delivery to a performance bottleneck as data grew, and how introducing Elasticsearch, redesigning the query flow, and refactoring storage components restored fast, flexible searches for both front‑end and operations users.

Backend ArchitectureElasticsearchJD UGC Platform
0 likes · 9 min read
How We Scaled JD’s UGC Platform with Elasticsearch: A Backend Architecture Deep Dive
Suning Technology
Suning Technology
Jan 19, 2021 · Databases

Scaling Citus Clusters via Logical Replication – Lessons from PostgreSQL China Conference

The 10th PostgreSQL China Technical Conference in January 2021 featured expert talks on scaling Citus clusters with logical replication and on applying PostgreSQL to Suning’s retail digitalization, highlighting architecture, challenges, technology choices, and future directions for database-driven business transformation.

CitusData ArchitectureLogical Replication
0 likes · 2 min read
Scaling Citus Clusters via Logical Replication – Lessons from PostgreSQL China Conference
vivo Internet Technology
vivo Internet Technology
Dec 23, 2020 · Backend Development

How Vivo Scaled Its Order System: Sharding, Migration, and Real‑World Lessons

This article details how Vivo transformed its monolithic e‑commerce order service into a scalable, service‑oriented system by applying data archiving, sharding‑JDBC based sharding, MySQL‑to‑Elasticsearch sync, zero‑downtime migration, and distributed‑transaction techniques, while sharing practical pitfalls and performance results.

Distributed SystemsElasticsearchMicroservices
0 likes · 17 min read
How Vivo Scaled Its Order System: Sharding, Migration, and Real‑World Lessons
ITPUB
ITPUB
Nov 12, 2020 · Databases

How Vivo Scaled to Billions of Records: Sharding and InnoDB Compression Strategies

This article details how Vivo's cloud service tackled explosive data growth by applying horizontal and vertical sharding, routing‑table based dynamic expansion, and MySQL InnoDB compression, providing step‑by‑step guidance, performance results, and practical recommendations for large‑scale database deployments.

InnoDBPartitioningdata compression
0 likes · 16 min read
How Vivo Scaled to Billions of Records: Sharding and InnoDB Compression Strategies
Java Architect Essentials
Java Architect Essentials
Nov 2, 2020 · Cloud Computing

High-Concurrency Architecture and Optimization Strategies in Cloud Development

During the pandemic, the Yunnan “Anti‑Epidemic” mini‑program faced over 80 W requests per minute, prompting an analysis of how cloud development’s serverless, auto‑scaling architecture—covering data pipelines, cloud functions, and cloud databases—can ensure high performance, availability, and cost‑effective handling of massive concurrent traffic.

Cloud FunctionsPerformance OptimizationServerless
0 likes · 19 min read
High-Concurrency Architecture and Optimization Strategies in Cloud Development
Programmer DD
Programmer DD
Oct 19, 2020 · Backend Development

How to Build a High‑Performance Flash‑Sale System: Architecture, Challenges & Solutions

This article explores the end‑to‑end design of a flash‑sale (秒杀) system, detailing business flow, technical challenges, architectural principles, front‑end and back‑end design, concurrency handling, anti‑cheating measures, data safety, and practical solutions for high‑traffic e‑commerce scenarios.

System Architecturedatabase scalingflash sale
0 likes · 36 min read
How to Build a High‑Performance Flash‑Sale System: Architecture, Challenges & Solutions
Architects Research Society
Architects Research Society
Sep 2, 2020 · Databases

Scaling PostgreSQL for Multi‑Terabyte Databases: Indexes, Partitioning, Tablespaces, Parallelism, and Replication

This article explains how to extract maximum performance and scalability from PostgreSQL for multi‑terabyte workloads by leveraging specialized indexes, declarative partitioning, tablespaces, parallel query execution, read‑only replica load‑balancing, and foreign‑table sharding techniques.

ParallelismPartitioningPostgreSQL
0 likes · 10 min read
Scaling PostgreSQL for Multi‑Terabyte Databases: Indexes, Partitioning, Tablespaces, Parallelism, and Replication
Laravel Tech Community
Laravel Tech Community
May 17, 2020 · Databases

Can MySQL Handle 100,000 Concurrent Connections? A Real‑World Test

This article details a comprehensive experiment that evaluates MySQL's ability to sustain up to 100,000 simultaneous connections using Percona Server's thread‑pool plugin, sysbench clients, adjusted OS/network limits, and multiple IP addresses, presenting hardware specs, configuration steps, observed errors, performance metrics, and practical recommendations.

Sysbenchdatabase scalinghigh concurrency
0 likes · 8 min read
Can MySQL Handle 100,000 Concurrent Connections? A Real‑World Test
Programmer DD
Programmer DD
Apr 29, 2020 · Databases

NewSQL vs Sharding: Which Database Architecture Truly Wins?

This article objectively compares NewSQL databases with middleware‑based sharding approaches, examining their architectural differences, transaction models, CAP implications, high‑availability designs, scaling mechanisms, storage engines, maturity, and provides a decision guide to help engineers choose the right solution for their workloads.

Distributed TransactionsNewSQLdatabase scaling
0 likes · 17 min read
NewSQL vs Sharding: Which Database Architecture Truly Wins?
Java Backend Technology
Java Backend Technology
Mar 21, 2020 · Databases

How Zhihu Scaled to Trillions of Rows with TiDB: Lessons from Moneta

Zhihu’s Moneta service, handling over 1.3 trillion rows and billions of daily writes, migrated from MySQL sharding to TiDB, achieving millisecond query latency, high availability, and horizontal scalability, while sharing architectural choices, performance metrics, migration challenges, and future expectations for TiDB 3.0.

HTAPMySQL MigrationPerformance Optimization
0 likes · 16 min read
How Zhihu Scaled to Trillions of Rows with TiDB: Lessons from Moneta
Top Architect
Top Architect
Mar 17, 2020 · Databases

Understanding Ant Financial’s LDC Architecture: Unitization, CAP Analysis, and High‑TPS Design

This article explains how Ant Financial’s massive Double‑11 payment traffic is handled through logical data centers (LDC), unit‑based architecture (RZone, GZone, CZone), traffic routing, disaster‑recovery strategies, and a CAP analysis that highlights the role of OceanBase’s Paxos‑based consensus in achieving high availability and eventual consistency.

CAP theoremDistributed SystemsOceanBase
0 likes · 36 min read
Understanding Ant Financial’s LDC Architecture: Unitization, CAP Analysis, and High‑TPS Design
AntTech
AntTech
Nov 11, 2019 · Operations

How Alipay Scaled Its Payment System for Double 11: Architecture, Capacity Planning, and Elastic Design

The article details how Alipay engineers tackled the massive traffic spikes of Double 11 by addressing external payment bottlenecks, implementing recharge‑based balances, building capacity‑planning platforms, adopting logical data‑center (LDC) and CRG zone architectures, deploying elastic scaling, and evolving their OceanBase database and service‑mesh infrastructure to sustain millions of transactions per second.

AlipayDouble 11Elastic Architecture
0 likes · 16 min read
How Alipay Scaled Its Payment System for Double 11: Architecture, Capacity Planning, and Elastic Design
dbaplus Community
dbaplus Community
Oct 27, 2019 · Databases

How Weibo Scales Redis: Architecture, Optimizations, and Future Plans

This article details how Weibo leverages Redis across billions of requests, describing its massive scale, the challenges of trillion‑level reads/writes, the technical choices and customizations made—including LongSet, HA solutions, multi‑level caching, RocksDB integration—and outlines ongoing capacity and future development strategies.

RocksDBWeibocache optimization
0 likes · 18 min read
How Weibo Scales Redis: Architecture, Optimizations, and Future Plans
21CTO
21CTO
Apr 15, 2019 · Big Data

Mastering High‑Concurrency Big Data: Sharding, Partitioning, and Index Strategies

This article explores practical techniques for handling massive, high‑concurrency data workloads, covering relational database limits, read/write separation, vertical and horizontal sharding, key selection, archival to NoSQL stores, and the use of heterogeneous index tables to maintain performance.

Big DataPartitioningdatabase scaling
0 likes · 6 min read
Mastering High‑Concurrency Big Data: Sharding, Partitioning, and Index Strategies
dbaplus Community
dbaplus Community
Dec 9, 2018 · Databases

How Read‑Write Splitting and Columnar Storage Rescued a 100× MySQL Load Spike

A MySQL‑based receipt‑tracking service suffered a sudden 100‑fold load increase, prompting a step‑by‑step optimization that combined read‑write splitting, middleware‑less data routing, columnar storage with Infobright, and dynamic scheduling to dramatically lower CPU/IO pressure and restore performance.

Columnar StoragePerformance Optimizationdatabase scaling
0 likes · 13 min read
How Read‑Write Splitting and Columnar Storage Rescued a 100× MySQL Load Spike
Java Backend Technology
Java Backend Technology
Jul 25, 2018 · Cloud Native

Mastering Microservice Architecture: 10 Essential Design Principles

This article outlines ten crucial design principles for building robust microservice systems, covering API gateways, stateless services, database scaling, caching strategies, service decomposition, orchestration, configuration management, logging, fault tolerance, and comprehensive monitoring, each illustrated with clear diagrams.

MicroservicesOrchestrationapi-gateway
0 likes · 11 min read
Mastering Microservice Architecture: 10 Essential Design Principles
ITFLY8 Architecture Home
ITFLY8 Architecture Home
May 1, 2018 · Backend Development

How Yirendai Scaled Its Internet Finance Platform: From 1.0 to 4.0

This article examines how Yirendai tackled the high‑concurrency, big‑data challenges of internet finance by evolving its architecture through four major versions, introducing performance optimizations, service decomposition, database scaling, and cloud‑native strategies to support massive user growth while preserving a seamless customer experience.

BackendPerformance OptimizationSystem Architecture
0 likes · 14 min read
How Yirendai Scaled Its Internet Finance Platform: From 1.0 to 4.0
Architecture Digest
Architecture Digest
Nov 3, 2017 · Databases

Understanding Database Sharding: Why It Matters and How to Implement It

Database sharding, or splitting databases into multiple instances and tables, is essential for scaling backend systems; this article explains its importance, historical context, core concepts, storage stretching techniques, index and consistency handling, and provides a practical design example for transaction systems.

Backend ArchitectureConsistencyPartitioning
0 likes · 11 min read
Understanding Database Sharding: Why It Matters and How to Implement It
21CTO
21CTO
Aug 24, 2017 · Databases

How JD.com Guarantees Database Performance During Billion‑Scale Sales Events

This article details JD.com’s comprehensive strategies—including architecture design, pre‑event preparation, real‑time safeguards, and post‑event analysis—to ensure MySQL databases remain high‑performance and highly available during massive traffic spikes like 618 and Double‑11 sales.

AutomationPerformance Optimizationdatabase scaling
0 likes · 23 min read
How JD.com Guarantees Database Performance During Billion‑Scale Sales Events
Architecture Digest
Architecture Digest
Aug 8, 2017 · Backend Development

Scalability Design of Website Systems: Architecture and Load‑Balancing Strategies

This article explains how website systems achieve scalability through architectural designs such as physical function separation, server clustering, various load‑balancing techniques, distributed cache mechanisms, and both relational and NoSQL database scaling methods, providing practical guidance for large‑scale web deployments.

Backend ArchitectureScalabilityServer Clustering
0 likes · 13 min read
Scalability Design of Website Systems: Architecture and Load‑Balancing Strategies
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jul 28, 2017 · Databases

Sharding Mastery: Strategies, Key Generation & Seamless Scaling

This article presents a comprehensive guide to database sharding, covering implementation strategies, vertical and horizontal partitioning, global primary key generation techniques, framework versus custom solutions, multi‑data‑source transaction handling, and a novel, migration‑free scaling approach that combines incremental range and hash‑based routing.

Backend DevelopmentDistributed Transactionsdatabase scaling
0 likes · 31 min read
Sharding Mastery: Strategies, Key Generation & Seamless Scaling
21CTO
21CTO
Apr 22, 2017 · Backend Development

How to Build a High‑Performance Flash Sale (Seckill) System: Architecture, Challenges & Solutions

This article analyzes the business flow, technical challenges, and architectural design of a flash‑sale (seckill) system, offering practical solutions for isolation, high‑concurrency handling, database sharding, caching, cheating prevention, and data consistency to ensure reliable high‑traffic e‑commerce operations.

BackendSystem Architecturecaching
0 likes · 33 min read
How to Build a High‑Performance Flash Sale (Seckill) System: Architecture, Challenges & Solutions