This article explains why relational databases become bottlenecks at large scale, introduces vertical and horizontal sharding techniques, discusses the challenges of distributed transactions, cross‑shard queries, pagination, and global primary‑key generation, and provides practical guidelines and middleware options for implementing sharding in production systems.
Distributed ID systems must be globally unique, incremental, highly available, and secure; this article compares common generation methods—including UUID, database auto‑increment, Redis atomic counters, and the Snowflake algorithm—detailing their advantages, drawbacks, and suitable use‑cases for modern high‑throughput services.
This article reviews various distributed ID generation strategies—including MySQL auto‑increment tables, multi‑master configurations, segment allocation, Snowflake algorithm, and open‑source solutions like Baidu uid‑generator and Meituan Leaf—highlighting their designs, trade‑offs, and implementation details for high‑performance backend systems.
This article examines various distributed ID generation methods—including UUID, MySQL auto‑increment, Snowflake, and Redis—explaining their advantages, drawbacks, and how top companies combine block allocation and double‑buffering to achieve uniqueness, scalability, and high performance.
This article explains how to design a database architecture that can handle millions of daily active users and tens of thousands of concurrent requests by using multi‑server sharding, extensive table partitioning, read‑write separation, and distributed unique‑ID generation techniques such as Snowflake.
This article explains the need for compact, time‑ordered unique IDs in distributed systems, describes Twitter's Snowflake 64‑bit ID structure, provides a full Java implementation with bit‑allocation details, and demonstrates its high‑performance generation of millions of IDs.
This article explains the necessity of globally unique and trend‑ordered identifiers for business systems, compares database auto‑increment, UUID, Redis, Snowflake, and MongoDB ObjectId solutions, and outlines their advantages, drawbacks, and best‑practice design criteria.
MTDDL, Meituan’s in‑house client‑side sharding middleware, was created to address rapid product‑database growth by offering dynamic data‑source routing, read‑write separation, distributed ID generation, configurable database‑and‑table sharding, connection‑pool management, SQL monitoring, and live configuration updates via annotations and extensible strategies.
The article explains how exposing auto‑increment primary keys can leak business information, illustrates the danger with historical examples, and evaluates alternative ID generation strategies such as encoding, UUIDs, and Snowflake‑style distributed IDs, including performance comparisons in MySQL.