This article examines why large‑scale MySQL deployments encounter CPU, I/O and memory bottlenecks, compares vertical and horizontal data‑sharding strategies, evaluates open‑source middleware ShardingJdbc versus MyCat, and provides a detailed Spring Boot integration design with routing rules and practical use‑case examples.
This article explains the essence of software architecture as a process of reducing system entropy through splitting and merging, outlines the capabilities required of architects, and details the step‑by‑step evolution of large‑scale website infrastructures including caching, CDN, database sharding, and messaging systems.
This article explains the multi‑layer data architecture design for microservice systems, covering concepts such as data usability, primary and secondary data decoupling, sharding, multi‑source data adaptation and caching, and introduces data marts to improve scalability and maintainability.
This article walks through the step‑by‑step evolution of a Java website—from a single‑machine setup to a multi‑tier, load‑balanced, sharded, cached, and service‑oriented architecture capable of handling billions of requests—detailing the challenges and solutions at each stage.
The article outlines a step‑by‑step evolution of a web application from a single‑machine deployment to a fully distributed architecture, covering server separation, clustering, load‑balancing algorithms, session handling, read‑write splitting, search engine integration, caching, database sharding, service‑oriented decomposition, and message‑queue middleware.
Facing billions of rows spread across 1024 tables in 64 databases, a Chinese gaming platform replaced its custom sharding framework with TiDB, achieving real‑time OLTP consistency, elastic scaling, robust backup, high availability, and lower migration costs while preserving MySQL compatibility.
This article traces Alibaba's e‑commerce technical evolution—from early LAMP‑based monoliths through Java‑centric 2.0 systems to a massive multi‑IDC, service‑oriented distributed architecture with HSF, Pandora, and advanced database sharding solutions—highlighting the challenges and innovations that enabled its massive scalability.
This article summarizes the origins, core principles, typical evolution stages, and common toolkits of large website architecture, highlighting how network growth, performance demands, and scalability challenges drive the adoption of caching, load balancing, database sharding, CDNs, and distributed services.
This article recounts the technical evolution of 58 Express from its early startup days through rapid growth to an intelligent dispatch era, detailing challenges, database sharding, service decomposition, big‑data analytics, AI‑driven order routing, monitoring, and lessons learned for building a high‑performance backend system.
This article explains the motivations, scenarios, architecture, core components, performance characteristics, and future roadmap of Sharding-JDBC, a lightweight Java framework that enables transparent database sharding and scaling for high‑volume, high‑concurrency applications.
This article explains the fundamentals of database sharding, including horizontal partitioning, routing, load balancing, clustering, and read/write separation, and discusses practical strategies such as range, hash, and mapping partitions to improve scalability, availability, and performance for high‑traffic web applications.
This article outlines how a massive e‑commerce platform like Taobao evolves its backend architecture step by step—from an all‑in‑one server through service separation, caching, load balancing, session management, database sharding, CDN acceleration, and finally distributed search—highlighting the motivations, trade‑offs, and key design considerations at each stage.
This article analyzes the business model of flash‑sale (seckill) operations, enumerates the technical challenges such as impact on existing services, high‑concurrency load, bandwidth, order‑URL security, and proposes architectural principles, layered designs, queue choices, database sharding, scaling, overload protection, anti‑cheat measures, and data‑safety techniques to build a robust backend system.
This article examines Youku’s large‑scale system architecture, detailing its server fleet, LAMP‑based front‑end framework, evolving MySQL database designs from master‑slave replication to vertical partitioning and sharding, and its caching strategies and CDN deployment that together support over 1 billion daily users.
Meituan’s group‑buy order system was refactored from a monolithic, single‑point‑failure design into a sharded, micro‑service architecture with connection‑pool middleware, dual‑cluster databases, and robust messaging, delivering stable, high‑performance handling of millions of daily orders even during peak events.
This article walks through the typical evolution of a growing website—from separating web and database servers to adding caching layers, load balancing, sharding, and distributed systems—explaining why each change is needed and what knowledge areas it touches.
The article details the technical challenges encountered during the service‑oriented decomposition of Qunar's payment platform, covering Dubbo and HTTP service conventions, database sharding and read/write separation, asynchronous processing, multi‑system management, and comprehensive monitoring and alerting solutions.
Facing a 200 GB order table that strained performance during flash‑sale spikes, Meituan first vertically split the schema, then horizontally sharded orders by user and merchant IDs using a 32 × 32 hash scheme with embedded timestamp‑based IDs, enabling scalable clusters, flexible migration stages, and simplified queries while preserving transaction integrity.
The article examines the technical challenges encountered during the service‑oriented decomposition of Qunar's payment platform—including development efficiency, interface conventions, concurrency, security, monitoring, database sharding, read‑write separation, and asynchronous processing—and presents concrete solutions and best‑practice recommendations.
This article explains the principles, architecture, and performance of Sharding-JDBC, covering sharding scenarios, rule configuration, JDBC rewriting, SQL parsing and routing, result merging, and future roadmap, while comparing it with other open‑source sharding solutions.
The article outlines how mature large‑site architectures evolve from a single‑server setup to multi‑layered systems featuring separated application, data and file tiers, caching, load‑balancing, database sharding, CDN, distributed file systems, NoSQL/search, business‑level service decomposition and distributed service frameworks.
The article outlines how a large website’s architecture progresses from a single‑server setup through service separation, caching, clustering, read/write splitting, CDN, distributed databases, NoSQL, business decomposition and cloud platforms, while highlighting common pitfalls.
This article traces the step‑by‑step evolution of large‑scale website architectures—from single‑server setups to distributed services—highlighting key techniques such as server clustering, caching, load balancing, database sharding, CDN usage, and the adoption of NoSQL and micro‑service frameworks.
This article explains how a rapidly growing order database exceeding 200 GB can be scaled using vertical and horizontal partitioning, various sharding strategies, custom ID generation, migration phases, and practical considerations for transactions and complex queries.
The article outlines a comprehensive database sharding solution for a massive order system, describing vertical and horizontal partitioning, various sharding strategies, a custom ID scheme, transaction handling, complex query constraints, and a three‑stage data migration plan to achieve long‑term scalability.
The article explains how to build a highly scalable internet application by adopting stateless session handling, effective caching, service decomposition with remote call frameworks, database sharding, asynchronous messaging, unstructured data storage, comprehensive monitoring, and unified configuration management.
CachingSession Managementasynchronous communication
Taobao’s massive B2C platform achieves high scalability and reliability by employing stateless session management with multi‑value cookies, leveraging Tair caching, splitting services via HSF, partitioning databases with TDDL, adopting asynchronous messaging, using distributed file storage, and implementing comprehensive monitoring and unified configuration management.
This article explains two practical horizontal sharding techniques for large databases—using an MD5 hash of the user UID to distribute rows across 256 tables, and right‑shifting the UID to create scalable table ranges—while discussing their capacity limits and extensibility.
This article explains two practical horizontal sharding techniques for large‑scale projects—MD5‑based hashing and bit‑shifting of user IDs—detailing their PHP implementations, scalability limits, and how to extend table counts as data grows.
The article examines the increasing storage bottleneck in large-scale web systems, explains vertical and horizontal database sharding, discusses the technical difficulties they introduce—including join rewrites, transaction handling, and ORM integration—and proposes practical approaches to minimize service impact and manage distributed transactions.
The article chronicles Xiaomi Web's architectural journey from a simple three‑engineer monolith in 2011 through systematic service decomposition, asynchronous messaging, database sharding with Cobar, cloud‑native scaling, advanced caching, virtual inventory allocation, and sophisticated monitoring, illustrating practical lessons for building high‑performance e‑commerce platforms.
Horizontal sharding splits a large table into multiple databases using hash‑modulo routing, improving performance and scalability; the article explains the basic algorithm, shows example calculations for a 4‑shard setup, and demonstrates how to expand shards from four to eight.
Facing explosive traffic growth in 2014, Didi’s ride‑hailing platform tackled critical challenges by redesigning its LBS architecture, replacing unstable long‑connection services with an AIO‑based framework, partitioning databases, adopting Dubbo and RocketMQ for distributed processing, and building a real‑time monitoring and data center using Storm, HBase, and custom SQL‑to‑HBase translation.
This article analyzes the complete flash‑sale workflow, identifies its unique characteristics and high‑concurrency technical challenges, and presents a layered architecture—including frontend static pages, request interception, queue design, database sharding, caching, optimistic locking, and anti‑cheating measures—to ensure reliability, scalability and data safety.
The article describes how Alibaba scaled its massive data platform by horizontally sharding Oracle tables to MySQL, employing multi‑data‑center synchronization tools such as Erosa, Eromanga, and Otter, and designing multi‑level caching and proxy solutions like Cobar to ensure high availability and performance.
This article analyzes YouPai.com's evolution from a simple master‑slave setup to horizontal sharding using a mapping table, detailing migration steps, access flow, and challenges such as cross‑database joins, consistency, and ID generation.
The article details how Alibaba tackled explosive data growth by migrating from a single Oracle instance to a multi‑source architecture using horizontal and vertical sharding, MySQL clusters, KV stores, and proprietary tools such as Erosa, Otter, and Cobar to achieve high availability, consistency, and performance across multiple IDC sites.
This article chronicles the evolution of Sina's news comment platform from a single‑server C++/MySQL prototype to a multi‑node, asynchronous, Python‑based architecture, highlighting the caching, sharding, and queueing techniques that enabled the system to survive massive traffic spikes without downtime.
Vertical sharding splits large tables across multiple servers by whole tables, offering simple partitioning but limited scalability, while horizontal sharding distributes rows of high‑traffic tables based on key rules, improving performance and scalability yet introducing complex partition logic and maintenance challenges.
This article explains why many companies over‑invest in Hadoop, outlines how to evaluate data size, growth, and relevance, and presents practical alternatives such as archiving, data sampling, database sharding, and hiring business‑savvy analysts before committing to a Hadoop deployment.
The article traces web architecture’s evolution from simple single‑server Java/JSP sites through memory caching, load‑balanced multi‑machine logic, read/write separation, master‑slave replication or message‑queue syncing, horizontal/vertical sharding, and finally multi‑server web‑server deployments behind load balancers to achieve scalability and reliability.