BestHub
Sign in
Tagged articles

database sharding

232 articles · Page 3 of 3
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jul 24, 2017 · Databases

Mastering Database Sharding: Boost Performance with Horizontal Partitioning

This article explains the fundamentals of database sharding, including horizontal partitioning, routing, load balancing, clustering, and read/write separation, and discusses practical strategies such as range, hash, and mapping partitions to improve scalability, availability, and performance for high‑traffic web applications.

Horizontal PartitioningLoad Balancingdatabase sharding
0 likes · 17 min read
Mastering Database Sharding: Boost Performance with Horizontal Partitioning
Qunar Tech Salon
Qunar Tech Salon
Apr 20, 2017 · Backend Development

Evolution of Large‑Scale E‑commerce Backend Architecture: From Single Server to Distributed Systems

This article outlines how a massive e‑commerce platform like Taobao evolves its backend architecture step by step—from an all‑in‑one server through service separation, caching, load balancing, session management, database sharding, CDN acceleration, and finally distributed search—highlighting the motivations, trade‑offs, and key design considerations at each stage.

Backend Architecturecachingdatabase sharding
0 likes · 11 min read
Evolution of Large‑Scale E‑commerce Backend Architecture: From Single Server to Distributed Systems
Architecture Digest
Architecture Digest
Mar 12, 2017 · Backend Development

Design and Technical Challenges of High‑Concurrency Flash Sale (Seckill) Systems

This article analyzes the business model of flash‑sale (seckill) operations, enumerates the technical challenges such as impact on existing services, high‑concurrency load, bandwidth, order‑URL security, and proposes architectural principles, layered designs, queue choices, database sharding, scaling, overload protection, anti‑cheat measures, and data‑safety techniques to build a robust backend system.

Queuebackendcaching
0 likes · 31 min read
Design and Technical Challenges of High‑Concurrency Flash Sale (Seckill) Systems
21CTO
21CTO
Feb 26, 2017 · Backend Development

Inside Youku’s Massive Architecture: Front‑End, Database & Caching Secrets

This article examines Youku’s large‑scale system architecture, detailing its server fleet, LAMP‑based front‑end framework, evolving MySQL database designs from master‑slave replication to vertical partitioning and sharding, and its caching strategies and CDN deployment that together support over 1 billion daily users.

Video ArchitectureYoukudatabase sharding
0 likes · 7 min read
Inside Youku’s Massive Architecture: Front‑End, Database & Caching Secrets
Meituan Technology Team
Meituan Technology Team
Dec 27, 2016 · Backend Development

Meituan Group Order System: Optimization, Sharding, and Service‑Oriented Refactoring

Meituan’s group‑buy order system was refactored from a monolithic, single‑point‑failure design into a sharded, micro‑service architecture with connection‑pool middleware, dual‑cluster databases, and robust messaging, delivering stable, high‑performance handling of millions of daily orders even during peak events.

Meituandatabase shardingmicroservices
0 likes · 14 min read
Meituan Group Order System: Optimization, Sharding, and Service‑Oriented Refactoring
Ctrip Technology
Ctrip Technology
Dec 2, 2016 · Backend Development

Challenges and Practices in Service‑Oriented Splitting of Qunar Payment System

The article details the technical challenges encountered during the service‑oriented decomposition of Qunar's payment platform, covering Dubbo and HTTP service conventions, database sharding and read/write separation, asynchronous processing, multi‑system management, and comprehensive monitoring and alerting solutions.

Monitoringasynchronous processingdatabase sharding
0 likes · 10 min read
Challenges and Practices in Service‑Oriented Splitting of Qunar Payment System
Meituan Technology Team
Meituan Technology Team
Nov 18, 2016 · Databases

Vertical and Horizontal Database Sharding Strategies for Large-Scale Order Systems

Facing a 200 GB order table that strained performance during flash‑sale spikes, Meituan first vertically split the schema, then horizontally sharded orders by user and merchant IDs using a 32 × 32 hash scheme with embedded timestamp‑based IDs, enabling scalable clusters, flexible migration stages, and simplified queries while preserving transaction integrity.

Horizontal PartitioningVertical Partitioningdatabase sharding
0 likes · 11 min read
Vertical and Horizontal Database Sharding Strategies for Large-Scale Order Systems
Qunar Tech Salon
Qunar Tech Salon
Nov 12, 2016 · Backend Development

Challenges and Solutions in Service‑Oriented Splitting of Qunar Payment System

The article examines the technical challenges encountered during the service‑oriented decomposition of Qunar's payment platform—including development efficiency, interface conventions, concurrency, security, monitoring, database sharding, read‑write separation, and asynchronous processing—and presents concrete solutions and best‑practice recommendations.

Monitoringasynchronous processingbackend development
0 likes · 10 min read
Challenges and Solutions in Service‑Oriented Splitting of Qunar Payment System
Architecture Digest
Architecture Digest
Aug 1, 2016 · Backend Development

Evolution of Large-Scale Website Architecture: From Single Server to Distributed Services

The article outlines how mature large‑site architectures evolve from a single‑server setup to multi‑layered systems featuring separated application, data and file tiers, caching, load‑balancing, database sharding, CDN, distributed file systems, NoSQL/search, business‑level service decomposition and distributed service frameworks.

Load Balancingcachingdatabase sharding
0 likes · 9 min read
Evolution of Large-Scale Website Architecture: From Single Server to Distributed Services
dbaplus Community
dbaplus Community
Jul 17, 2016 · Databases

How JD Scaled Its One‑Yuan Grab Treasure System with Database Sharding and ES Aggregation

This article details JD's One‑Yuan Grab Treasure platform redesign, covering business growth drivers, database sharding estimation, hash‑plus‑range routing implementation, Elasticsearch aggregation, Canal‑based sync, historical data migration, and downgrade mechanisms to ensure high‑throughput, reliable order processing during massive sales events.

Backend ArchitectureData MigrationPerformance Scaling
0 likes · 11 min read
How JD Scaled Its One‑Yuan Grab Treasure System with Database Sharding and ES Aggregation
Big Data and Microservices
Big Data and Microservices
May 9, 2016 · Industry Insights

How Major E‑Commerce Sites Evolve Their Architecture for Scale and Performance

This article traces the step‑by‑step evolution of large‑scale website architectures—from single‑server setups to distributed services—highlighting key techniques such as server clustering, caching, load balancing, database sharding, CDN usage, and the adoption of NoSQL and micro‑service frameworks.

Load Balancingarchitecturecaching
0 likes · 9 min read
How Major E‑Commerce Sites Evolve Their Architecture for Scale and Performance
21CTO
21CTO
Apr 27, 2016 · Databases

How to Scale an Order Database Beyond 200GB: Vertical & Horizontal Sharding Strategies

This article explains how a rapidly growing order database exceeding 200 GB can be scaled using vertical and horizontal partitioning, various sharding strategies, custom ID generation, migration phases, and practical considerations for transactions and complex queries.

Data MigrationHorizontal PartitioningVertical Partitioning
0 likes · 9 min read
How to Scale an Order Database Beyond 200GB: Vertical & Horizontal Sharding Strategies
Architecture Digest
Architecture Digest
Apr 27, 2016 · Databases

Database Sharding Strategies: Vertical and Horizontal Partitioning, ID Generation, and Migration Phases

The article outlines a comprehensive database sharding solution for a massive order system, describing vertical and horizontal partitioning, various sharding strategies, a custom ID scheme, transaction handling, complex query constraints, and a three‑stage data migration plan to achieve long‑term scalability.

Data MigrationHorizontal PartitioningVertical Partitioning
0 likes · 10 min read
Database Sharding Strategies: Vertical and Horizontal Partitioning, ID Generation, and Migration Phases
Architecture Digest
Architecture Digest
Apr 23, 2016 · Backend Development

Designing Scalable Large-Scale Internet Applications: Stateless Sessions, Caching, Service Splitting, Database Sharding, Asynchronous Communication, and Configuration Management

The article explains how to build a highly scalable internet application by adopting stateless session handling, effective caching, service decomposition with remote call frameworks, database sharding, asynchronous messaging, unstructured data storage, comprehensive monitoring, and unified configuration management.

Service Splittingasynchronous communicationcaching
0 likes · 16 min read
Designing Scalable Large-Scale Internet Applications: Stateless Sessions, Caching, Service Splitting, Database Sharding, Asynchronous Communication, and Configuration Management
21CTO
21CTO
Apr 16, 2016 · Backend Development

How Taobao Scales: Stateless Sessions, Caching, Service Splitting, and More

Taobao’s massive B2C platform achieves high scalability and reliability by employing stateless session management with multi‑value cookies, leveraging Tair caching, splitting services via HSF, partitioning databases with TDDL, adopting asynchronous messaging, using distributed file storage, and implementing comprehensive monitoring and unified configuration management.

Service Splittingcachingdatabase sharding
0 likes · 18 min read
How Taobao Scales: Stateless Sessions, Caching, Service Splitting, and More
ITPUB
ITPUB
Mar 18, 2016 · Databases

Horizontal Table Partitioning: MD5 Hash vs. Bit‑Shift Sharding

This article explains two practical horizontal sharding techniques for large databases—using an MD5 hash of the user UID to distribute rows across 256 tables, and right‑shifting the UID to create scalable table ranges—while discussing their capacity limits and extensibility.

Horizontal PartitioningMD5 hashbit shifting
0 likes · 5 min read
Horizontal Table Partitioning: MD5 Hash vs. Bit‑Shift Sharding
21CTO
21CTO
Mar 16, 2016 · Databases

How to Horizontally Partition Tables Using MD5 Hashing and Bit Shifting

This article explains two practical horizontal sharding techniques for large‑scale projects—MD5‑based hashing and bit‑shifting of user IDs—detailing their PHP implementations, scalability limits, and how to extend table counts as data grows.

Horizontal PartitioningMD5 hashingPHP
0 likes · 5 min read
How to Horizontally Partition Tables Using MD5 Hashing and Bit Shifting
Qunar Tech Salon
Qunar Tech Salon
Feb 18, 2016 · Databases

Challenges and Strategies for Database Vertical and Horizontal Sharding

The article examines the increasing storage bottleneck in large-scale web systems, explains vertical and horizontal database sharding, discusses the technical difficulties they introduce—including join rewrites, transaction handling, and ORM integration—and proposes practical approaches to minimize service impact and manage distributed transactions.

Horizontal ShardingORMVertical Sharding
0 likes · 15 min read
Challenges and Strategies for Database Vertical and Horizontal Sharding
Architecture Digest
Architecture Digest
Feb 13, 2016 · Backend Development

Evolution of Xiaomi Web Architecture: From Monolith to Scalable Microservices and Cloud‑Native Solutions

The article chronicles Xiaomi Web's architectural journey from a simple three‑engineer monolith in 2011 through systematic service decomposition, asynchronous messaging, database sharding with Cobar, cloud‑native scaling, advanced caching, virtual inventory allocation, and sophisticated monitoring, illustrating practical lessons for building high‑performance e‑commerce platforms.

MonitoringScalingcloud
0 likes · 12 min read
Evolution of Xiaomi Web Architecture: From Monolith to Scalable Microservices and Cloud‑Native Solutions
21CTO
21CTO
Jan 8, 2016 · Backend Development

How Didi Scaled Ride‑Hailing: LBS, Long‑Connection, and Real‑Time Data Solutions

Facing explosive traffic growth in 2014, Didi’s ride‑hailing platform tackled critical challenges by redesigning its LBS architecture, replacing unstable long‑connection services with an AIO‑based framework, partitioning databases, adopting Dubbo and RocketMQ for distributed processing, and building a real‑time monitoring and data center using Storm, HBase, and custom SQL‑to‑HBase translation.

MonitoringRide Hailingdatabase sharding
0 likes · 14 min read
How Didi Scaled Ride‑Hailing: LBS, Long‑Connection, and Real‑Time Data Solutions
21CTO
21CTO
Jan 7, 2016 · Backend Development

How to Build a High‑Performance Flash‑Sale System: Architecture, Challenges & Solutions

This article analyzes the complete flash‑sale workflow, identifies its unique characteristics and high‑concurrency technical challenges, and presents a layered architecture—including frontend static pages, request interception, queue design, database sharding, caching, optimistic locking, and anti‑cheating measures—to ensure reliability, scalability and data safety.

Flash SaleLoad Balancingdatabase sharding
0 likes · 34 min read
How to Build a High‑Performance Flash‑Sale System: Architecture, Challenges & Solutions
Architect
Architect
Dec 21, 2015 · Databases

Alibaba's Massive Data Architecture: Sharding, Multi‑Data‑Center Synchronization, and Caching Strategies

The article describes how Alibaba scaled its massive data platform by horizontally sharding Oracle tables to MySQL, employing multi‑data‑center synchronization tools such as Erosa, Eromanga, and Otter, and designing multi‑level caching and proxy solutions like Cobar to ensure high availability and performance.

AlibabaData synchronizationcaching
0 likes · 16 min read
Alibaba's Massive Data Architecture: Sharding, Multi‑Data‑Center Synchronization, and Caching Strategies
Qunar Tech Salon
Qunar Tech Salon
Dec 4, 2015 · Databases

Scaling Massive Data at Alibaba: From Oracle to MySQL Sharding and Distributed Solutions

The article details how Alibaba tackled explosive data growth by migrating from a single Oracle instance to a multi‑source architecture using horizontal and vertical sharding, MySQL clusters, KV stores, and proprietary tools such as Erosa, Otter, and Cobar to achieve high availability, consistency, and performance across multiple IDC sites.

AlibabaMySQLOracle
0 likes · 16 min read
Scaling Massive Data at Alibaba: From Oracle to MySQL Sharding and Distributed Solutions
21CTO
21CTO
Oct 29, 2015 · Backend Development

Scaling Sina's News Comment System: From 3.0 to 5.0 – Key Backend Lessons

This article chronicles the evolution of Sina's news comment platform from a single‑server C++/MySQL prototype to a multi‑node, asynchronous, Python‑based architecture, highlighting the caching, sharding, and queueing techniques that enabled the system to survive massive traffic spikes without downtime.

Backend ArchitectureMessage QueueScalable Systems
0 likes · 21 min read
Scaling Sina's News Comment System: From 3.0 to 5.0 – Key Backend Lessons
Java High-Performance Architecture
Java High-Performance Architecture
Aug 18, 2015 · Databases

Vertical vs Horizontal Database Sharding: Benefits, Drawbacks, and When to Use Each

Vertical sharding splits large tables across multiple servers by whole tables, offering simple partitioning but limited scalability, while horizontal sharding distributes rows of high‑traffic tables based on key rules, improving performance and scalability yet introducing complex partition logic and maintenance challenges.

Horizontal ShardingVertical Shardingdatabase sharding
0 likes · 3 min read
Vertical vs Horizontal Database Sharding: Benefits, Drawbacks, and When to Use Each
MaGe Linux Operations
MaGe Linux Operations
Feb 25, 2015 · Big Data

Do You Really Need Hadoop? 10 Alternatives to Consider First

This article explains why many companies over‑invest in Hadoop, outlines how to evaluate data size, growth, and relevance, and presents practical alternatives such as archiving, data sampling, database sharding, and hiring business‑savvy analysts before committing to a Hadoop deployment.

Big Data AlternativesData ArchivingHadoop
0 likes · 9 min read
Do You Really Need Hadoop? 10 Alternatives to Consider First
Baidu Tech Salon
Baidu Tech Salon
Apr 29, 2014 · Backend Development

Evolution of Web Architecture: From Single‑Server Sites to Distributed Multi‑Machine Systems

The article traces web architecture’s evolution from simple single‑server Java/JSP sites through memory caching, load‑balanced multi‑machine logic, read/write separation, master‑slave replication or message‑queue syncing, horizontal/vertical sharding, and finally multi‑server web‑server deployments behind load balancers to achieve scalability and reliability.

Load Balancingcachingdatabase sharding
0 likes · 25 min read
Evolution of Web Architecture: From Single‑Server Sites to Distributed Multi‑Machine Systems