Tagged articles

snowflake

140 articles · Page 2 of 2
Programmer DD
Programmer DD
Mar 31, 2021 · Backend Development

How to Choose the Right Distributed ID Generation Strategy for Scalable Systems

This article examines common distributed ID generation methods—including UUID, MySQL auto‑increment, multi‑instance auto‑increment, Snowflake, and Redis—detailing their advantages, drawbacks, and practical use cases, and presents advanced designs such as database‑driven ID blocks, concurrency handling, and double‑buffer techniques for high‑traffic systems.

Redisdatabase shardingdistributed ID
0 likes · 13 min read
How to Choose the Right Distributed ID Generation Strategy for Scalable Systems
ITPUB
ITPUB
Mar 6, 2021 · Databases

What Do the DB-Engines March 2021 Rankings Reveal About Today's Top Databases?

The DB‑Engines March 2021 ranking evaluates 364 databases, highlighting shifts among the top ten—including Microsoft SQL Server’s steep decline, MySQL’s growth surge, PostgreSQL’s continued rise, and Snowflake’s dramatic climb—while offering trend graphs and insights for professionals choosing the right database technology.

DB-EnginesMySQLPostgreSQL
0 likes · 6 min read
What Do the DB-Engines March 2021 Rankings Reveal About Today's Top Databases?
Java Backend Technology
Java Backend Technology
Jan 14, 2021 · Databases

How to Overcome Database Bottlenecks with Sharding and Scaling Strategies

This article explains common I/O and CPU bottlenecks in databases, introduces horizontal and vertical sharding techniques, discusses tools, global primary‑key generation methods, Snowflake ID algorithm, migration challenges, and provides practical guidance on when and how to apply database partitioning to improve performance and scalability.

DatabaseShardingglobal ID
0 likes · 16 min read
How to Overcome Database Bottlenecks with Sharding and Scaling Strategies
21CTO
21CTO
Jan 6, 2021 · Databases

Why PostgreSQL, MariaDB, and Azure SQL Are Redefining the DB‑Engines Rankings

The latest DB‑Engines popularity ranking reveals Oracle, MySQL and SQL Server still dominate the top three, while PostgreSQL, MariaDB, Azure SQL Database and Snowflake surge ahead, highlighting a stable yet evolving landscape where cloud‑native databases are gaining rapid momentum.

Azure SQLDB-EnginesDatabases
0 likes · 4 min read
Why PostgreSQL, MariaDB, and Azure SQL Are Redefining the DB‑Engines Rankings
Code Ape Tech Column
Code Ape Tech Column
Dec 28, 2020 · Backend Development

Distributed ID Concepts, Implementation Schemes, and Open‑Source Solutions

This article explains the need for globally unique identifiers in distributed systems, compares common generation schemes such as UUID, database auto‑increment, Redis counters, and Snowflake, and reviews open‑source implementations like Meituan Leaf and Baidu UidGenerator with a Java Snowflake example.

distributed IDjavaopen-source
0 likes · 10 min read
Distributed ID Concepts, Implementation Schemes, and Open‑Source Solutions
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Nov 4, 2020 · Fundamentals

An Overview of Six Distributed ID Generation Algorithms and Their Trade‑offs

This article introduces the concept of distributed IDs, outlines the required properties of global uniqueness, high availability, performance and simplicity, and compares six generation schemes—UUID/GUID, database auto‑increment, random numbers, random strings, Snowflake, and MongoDB ObjectID—detailing their structures, advantages and disadvantages.

MongoDB ObjectIDauto_incrementdistributed ID
0 likes · 8 min read
An Overview of Six Distributed ID Generation Algorithms and Their Trade‑offs
Architect
Architect
Oct 13, 2020 · Fundamentals

Distributed ID Generation Schemes and the rpcxio/did Service

This article reviews various ID generation methods—including UUID/GUID, auto‑increment integers, random numbers, Snowflake, and MongoDB ObjectID—explains their advantages and drawbacks, and introduces the rpcxio/did distributed ID service with performance benchmarks and deployment considerations.

distributed systemsid generationsnowflake
0 likes · 12 min read
Distributed ID Generation Schemes and the rpcxio/did Service
MaGe Linux Operations
MaGe Linux Operations
Aug 23, 2020 · Databases

Choosing the Right Primary Key Strategy: UUID, Snowflake, Redis, and More

This article reviews common primary key generation methods—including auto‑increment drawbacks and five alternatives such as UUID, step, segment, Snowflake, and Redis—explaining their mechanisms, advantages, and trade‑offs to help you select the best fit for high‑concurrency and distributed systems.

DatabaseShardingprimary key
0 likes · 9 min read
Choosing the Right Primary Key Strategy: UUID, Snowflake, Redis, and More
Sohu Tech Products
Sohu Tech Products
Jul 15, 2020 · Backend Development

Design and Implementation of a High‑Performance Global Unique ID Generation Algorithm (Mist) and Service (Medis)

This article analyses the limitations of existing global unique ID solutions such as Snowflake, presents the design of a new high‑performance, time‑independent Mist algorithm with extended lifespan, and describes its practical Redis‑backed service Medis, including performance benchmarks and architectural considerations.

Redisdistributed systemsglobal unique ID
0 likes · 14 min read
Design and Implementation of a High‑Performance Global Unique ID Generation Algorithm (Mist) and Service (Medis)
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jul 12, 2020 · Backend Development

Distributed ID Generation Techniques Discussed in an Interview with Java Implementations

During a technical interview, the candidate explains various distributed ID generation methods—including database auto‑increment, sharding, batch allocation, UUID, Redis atomic counters, and the Snowflake algorithm—analyzes their pros and cons, and provides Java code examples for Redis‑based and Snowflake ID generators.

Redisdistributed IDjava
0 likes · 18 min read
Distributed ID Generation Techniques Discussed in an Interview with Java Implementations
Top Architect
Top Architect
Jun 8, 2020 · Backend Development

Ensuring Idempotency with Unique IDs: UUID, Snowflake, and Distributed ID Generation

The article explains why idempotency is essential for reliable services, describes how unique identifiers such as UUIDs, Snowflake IDs, and database‑generated keys can be used to achieve it, and offers practical guidance on shared storage, avoiding unnecessary queries, and handling duplicate requests in distributed systems.

DatabaseIdempotencyUnique ID
0 likes · 8 min read
Ensuring Idempotency with Unique IDs: UUID, Snowflake, and Distributed ID Generation
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
May 17, 2020 · Databases

How to Build a High‑Availability, High‑Performance Distributed ID Generator

Distributed systems need globally unique, often monotonic IDs, and this article examines common ID generation strategies—Snowflake, database auto‑increment, segment allocation, multi‑master databases, and Raft‑based consensus—evaluating each for high availability and high performance, and highlighting trade‑offs and implementation details.

DatabaseRaftdistributed ID
0 likes · 8 min read
How to Build a High‑Availability, High‑Performance Distributed ID Generator
Architecture Digest
Architecture Digest
May 11, 2020 · Backend Development

Ensuring Idempotency in Distributed Systems: Unique ID Generation Strategies

The article explains why idempotency is essential for reliable service calls, discusses using unique identifiers such as UUIDs and Snowflake algorithms, compares centralized and client‑side ID generation, and offers practical storage and query‑optimisation techniques to prevent duplicate orders and resource waste.

IdempotencyUnique IDdistributed systems
0 likes · 6 min read
Ensuring Idempotency in Distributed Systems: Unique ID Generation Strategies
Java Architecture Diary
Java Architecture Diary
May 2, 2020 · Backend Development

Mastering Snowflake: How Distributed Systems Generate Unique IDs

This article explores various distributed ID generation methods, focusing on Twitter's Snowflake algorithm, detailing its structure, advantages, drawbacks, and comparisons with UUID, database auto-increment, and Redis, while providing implementation insights and references to related open-source solutions.

Algorithmdistributed IDsnowflake
0 likes · 7 min read
Mastering Snowflake: How Distributed Systems Generate Unique IDs
macrozheng
macrozheng
Mar 31, 2020 · Backend Development

Mastering Distributed ID Generation: 9 Proven Methods and Their Trade‑offs

This article explains why distributed IDs are essential, outlines the key requirements for a global unique identifier, and compares nine popular generation strategies—including UUID, database auto‑increment, segment mode, Redis, Snowflake, TinyID, Baidu uid‑generator, and Meituan Leaf—detailing their advantages, drawbacks, and sample implementations.

LeafUID generatordistributed ID
0 likes · 21 min read
Mastering Distributed ID Generation: 9 Proven Methods and Their Trade‑offs
21CTO
21CTO
Feb 20, 2020 · Backend Development

How to Choose the Right Global Unique ID Strategy for Distributed Systems

Generating globally unique IDs in distributed systems requires balancing uniqueness, monotonicity, high availability, security, and storage efficiency, and this article compares common solutions—including database auto‑increment, Redis/MongoDB/Zookeeper, UUID versions, and the Snowflake algorithm—detailing their advantages, drawbacks, and practical implementation tips.

Unique IDbackenddistributed-systems
0 likes · 9 min read
How to Choose the Right Global Unique ID Strategy for Distributed Systems
Aikesheng Open Source Community
Aikesheng Open Source Community
Jan 3, 2020 · Databases

Demonstration of DBLE Global Sequence Configuration: Timestamp (Snowflake) and Offset‑Setup Types

This tutorial demonstrates how to configure and use DBLE's global sequence feature, covering the timestamp‑based Snowflake algorithm and the offset‑setup type, including server.xml settings, table definitions, insertion behavior, and handling of restarts to ensure unique identifiers.

DBLEdatabase configurationglobal sequence
0 likes · 6 min read
Demonstration of DBLE Global Sequence Configuration: Timestamp (Snowflake) and Offset‑Setup Types
Java High-Performance Architecture
Java High-Performance Architecture
Dec 3, 2019 · Backend Development

Choosing the Right Distributed ID Strategy: UUID, DB, Redis, Snowflake Explained

Distributed ID systems must be globally unique, incremental, highly available, and secure; this article compares common generation methods—including UUID, database auto‑increment, Redis atomic counters, and the Snowflake algorithm—detailing their advantages, drawbacks, and suitable use‑cases for modern high‑throughput services.

database auto-incrementdistributed IDsnowflake
0 likes · 5 min read
Choosing the Right Distributed ID Strategy: UUID, DB, Redis, Snowflake Explained
Selected Java Interview Questions
Selected Java Interview Questions
Oct 11, 2019 · Databases

Primary Key Strategies After Database Sharding

After splitting a database into multiple shards, generating globally unique primary keys becomes essential, and this article examines various solutions—including auto‑increment IDs, sequence steps, UUIDs, timestamp concatenation, and the Snowflake algorithm—detailing their advantages, drawbacks, and suitable scenarios.

Shardingid generationprimary key
0 likes · 11 min read
Primary Key Strategies After Database Sharding
macrozheng
macrozheng
Sep 19, 2019 · Backend Development

Mastering Distributed ID Generation: From MySQL Auto‑Increment to Snowflake

This article reviews various distributed ID generation strategies—including MySQL auto‑increment tables, multi‑master configurations, segment allocation, Snowflake algorithm, and open‑source solutions like Baidu uid‑generator and Meituan Leaf—highlighting their designs, trade‑offs, and implementation details for high‑performance backend systems.

MySQLdistributed IDsegment allocation
0 likes · 13 min read
Mastering Distributed ID Generation: From MySQL Auto‑Increment to Snowflake
Architecture Digest
Architecture Digest
Sep 11, 2019 · Databases

Distributed ID Generation Mechanisms: Auto‑Increment, Multi‑Master, Segment Mode, Snowflake and Redis

This article reviews various distributed ID generation strategies—including database auto‑increment tables, dual‑master MySQL setups, segment allocation, the Snowflake algorithm, and Redis INCR—detailing their designs, SQL examples, scalability trade‑offs, and open‑source implementations.

DatabaseSegmentdistributed-id
0 likes · 13 min read
Distributed ID Generation Mechanisms: Auto‑Increment, Multi‑Master, Segment Mode, Snowflake and Redis
21CTO
21CTO
Jul 18, 2019 · Databases

Why Snowflake Is Overtaking Oracle: A Deep Dive into Modern Data Warehousing

This article examines Snowflake’s rapid rise as a cloud‑native data warehouse, contrasts its architecture and operational advantages with Oracle’s legacy system, and explains how shifting market dynamics, open‑source alternatives, and cloud adoption are reshaping the database landscape.

Cloud ComputingData WarehouseDatabase Comparison
0 likes · 11 min read
Why Snowflake Is Overtaking Oracle: A Deep Dive into Modern Data Warehousing
21CTO
21CTO
Nov 14, 2018 · Cloud Native

How Cloud‑Native Data Sharing with Snowflake Is Redefining Data Warehousing

This article explains how Snowflake’s cloud‑native data‑sharing capabilities let users across companies securely access shared datasets without costly extraction or duplication, transforming traditional data‑warehouse and BI workflows and unlocking fresh, detailed insights for businesses.

BICloud‑Nativedata sharing
0 likes · 7 min read
How Cloud‑Native Data Sharing with Snowflake Is Redefining Data Warehousing
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 16, 2018 · Databases

Scaling Payment Systems: Sharding, Snowflake IDs, and High‑Availability Databases

This article explains how a high‑throughput payment platform uses database sharding by user ID, Snowflake‑style globally unique order IDs, asynchronous replication for eventual consistency, multi‑level data caching, and coarse‑fine traffic pipelines to achieve millions of requests per second with robust high‑availability.

Data Tieringhigh-availabilityorder ID
0 likes · 16 min read
Scaling Payment Systems: Sharding, Snowflake IDs, and High‑Availability Databases
Java Backend Technology
Java Backend Technology
Sep 30, 2018 · Backend Development

Choosing the Right Distributed ID Generation Strategy: UUID, Snowflake, Redis, and More

This article compares various distributed unique identifier generation methods—including UUID, database auto‑increment, Redis INCR, Zookeeper, segmented DB caches, and the Snowflake algorithm—detailing their principles, advantages, drawbacks, and suitable use‑cases to help developers select the optimal solution for their systems.

Zookeeperbackend-developmentdistributed-id
0 likes · 13 min read
Choosing the Right Distributed ID Generation Strategy: UUID, Snowflake, Redis, and More
Java Backend Technology
Java Backend Technology
Apr 23, 2018 · Backend Development

Mastering Distributed ID Generation: Snowflake, Custom ID Generators, and Base62 Conversion

This article explores the challenges of generating globally unique, trend‑ordered IDs in distributed systems, compares database auto‑increment, UUID and ID‑grouping approaches, explains Twitter's Snowflake algorithm, provides a full Java implementation with Base62 conversion utilities, and introduces the Vesta ID‑generator framework.

base62id generationjava
0 likes · 16 min read
Mastering Distributed ID Generation: Snowflake, Custom ID Generators, and Base62 Conversion
Architecture Digest
Architecture Digest
Dec 6, 2017 · Backend Development

Design and Implementation of a Distributed Unique ID Generator for User IDs

This article describes the background, requirements, existing industry solutions, and the final optimized implementation of a high‑performance, globally unique user ID generator based on MySQL auto‑increment, Redis, and atomic memory segments, including performance results from production deployment.

Unique IDbackenddistributed-systems
0 likes · 8 min read
Design and Implementation of a Distributed Unique ID Generator for User IDs
Dada Group Technology
Dada Group Technology
Nov 17, 2017 · Backend Development

Designing a High‑Availability Distributed ID Generator: From UUID to Snowflake

This article examines the requirements for globally unique IDs in distributed systems, compares classic generation schemes such as UUID, Flickr, Snowflake and TDDL, and details a customized Snowflake‑based implementation with ZooKeeper‑managed worker IDs, clock‑rollback handling, deployment optimizations, and JVM tuning to achieve high performance and reliability.

High Availabilitybackenddistributed systems
0 likes · 15 min read
Designing a High‑Availability Distributed ID Generator: From UUID to Snowflake
21CTO
21CTO
Oct 15, 2017 · Backend Development

Mastering Distributed Unique IDs: From Auto‑Increment to Snowflake

This article surveys various distributed unique ID generation techniques—including Oracle auto‑increment, Redis batch allocation, UUID versions, Hibernate and MongoDB strategies, and Twitter’s Snowflake—explaining their structures, trade‑offs, and practical implementation considerations for reliable, collision‑free identifiers.

Unique IDbackend-developmentdistributed-systems
0 likes · 10 min read
Mastering Distributed Unique IDs: From Auto‑Increment to Snowflake
Meituan Technology Team
Meituan Technology Team
Apr 21, 2017 · Backend Development

Design and Implementation of Meituan's Distributed ID Generation System Leaf

Meituan’s Leaf system merges segment‑based caching with Snowflake‑style bit fields to deliver globally unique, trend‑increasing 64‑bit IDs at ultra‑low latency, using double‑buffered DB segments, master‑slave MySQL replication, Zookeeper‑assigned worker IDs, and clock‑rollback safeguards, achieving ~50 k QPS and 1 ms 99.9th‑percentile response across billions of daily IDs.

High AvailabilityLeafbackend
0 likes · 18 min read
Design and Implementation of Meituan's Distributed ID Generation System Leaf
ITPUB
ITPUB
Feb 10, 2017 · Backend Development

How to Generate Globally Unique IDs in Distributed Systems: Snowflake and Its Variants

This article explains the challenges of generating globally unique IDs across distributed shards, outlines the requirements for such IDs, and details Twitter's Snowflake algorithm—including its structure, generation process, and clock handling—before exploring three notable Snowflake variants and their trade‑offs.

Unique IDbackenddistributed systems
0 likes · 10 min read
How to Generate Globally Unique IDs in Distributed Systems: Snowflake and Its Variants
Hujiang Technology
Hujiang Technology
Nov 9, 2016 · Databases

Risks of Auto‑Increment IDs and Distributed ID Solutions

The article explains how exposing auto‑increment primary keys can leak business information, illustrates the danger with historical examples, and evaluates alternative ID generation strategies such as encoding, UUIDs, and Snowflake‑style distributed IDs, including performance comparisons in MySQL.

Database Designauto_incrementdistributed ID
0 likes · 9 min read
Risks of Auto‑Increment IDs and Distributed ID Solutions
dbaplus Community
dbaplus Community
Jun 14, 2016 · Backend Development

How LeTV Scaled Its Order System to One Million Transactions per Second

The talk explains how LeTV’s BOSS platform used sharding, a custom distributed ORM called Mango, and Snowflake‑style ID generation together with cluster‑level request routing to expand its order processing from hundreds of thousands to over a million transactions per second.

High Throughputbackenddistributed-orm
0 likes · 5 min read
How LeTV Scaled Its Order System to One Million Transactions per Second