Tag

distributed-systems

1 views collected around this technical thread.

JD Tech
JD Tech
Apr 27, 2025 · Backend Development

A Lightweight Mock/Spy Tool for Data Consistency in RPC Timeout Scenarios

The article analyzes data‑consistency challenges caused by RPC timeouts, especially when interfaces lack idempotency or idempotency fails, and presents a lightweight mock/spy utility that can intercept, mock, or spy on service calls to quickly restore consistency in distributed systems.

IdempotencyMockRPC
0 likes · 11 min read
A Lightweight Mock/Spy Tool for Data Consistency in RPC Timeout Scenarios
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
May 10, 2024 · Backend Development

Design and Implementation of a Kafka‑Proxy for High Availability and Traffic Governance

This article presents a Kafka‑Proxy solution that enhances cluster availability, traffic governance, seamless cluster switching, near‑source production/consumption, non‑disruptive offset resetting, and message flow control through metadata sharing and a lightweight proxy layer.

High AvailabilityKafkabackend
0 likes · 16 min read
Design and Implementation of a Kafka‑Proxy for High Availability and Traffic Governance
Java Tech Enthusiast
Java Tech Enthusiast
Mar 24, 2024 · Backend Development

Global ID Generation Strategies for Distributed Systems

The article surveys common global ID generation strategies for distributed systems—database‑managed approaches like MySQL auto‑increment and MyCat‑Zookeeper, and Java‑based methods such as UUID, Snowflake, Leaf, Redis INCRBY and direct Zookeeper—comparing their trade‑offs and recommending Leaf (segment or Snowflake mode) or MyCat‑Zookeeper for reliable, scalable identifiers.

Global IDMySQLZookeeper
0 likes · 15 min read
Global ID Generation Strategies for Distributed Systems
Top Architect
Top Architect
Sep 17, 2022 · Big Data

Meituan's Kafka Architecture: Challenges and Optimizations at Massive Scale

This article details how Meituan's Kafka platform, serving over 15,000 machines and handling petabytes of daily traffic, faces read/write latency, slow nodes, and large‑scale cluster management challenges, and describes a series of application‑layer, system‑layer, and operational optimizations—including disk balancing, migration pipelines, fetcher isolation, consumer async, SSD caching, isolation strategies, full‑link monitoring, lifecycle management, and TOR disaster recovery—to improve performance and reliability.

KafkaMeituanOptimization
0 likes · 22 min read
Meituan's Kafka Architecture: Challenges and Optimizations at Massive Scale
vivo Internet Technology
vivo Internet Technology
Sep 7, 2022 · Backend Development

Design and Implementation of Pickup Code System for SaaS E-commerce Platform

The article details the design and implementation of a pickup‑code system for SaaS e‑commerce platforms, covering simple single‑table approaches and a globally unique 8‑digit code scheme that embeds database and table identifiers, with strategies for sharding, conflict resolution, dynamic routing, and extensible tenant‑specific configuration.

E-commerce ArchitectureSaaS-platformShardingSphere
0 likes · 11 min read
Design and Implementation of Pickup Code System for SaaS E-commerce Platform
IT Architects Alliance
IT Architects Alliance
Apr 27, 2022 · Operations

High‑Availability Architecture for a Billion‑Scale Membership System: ES Dual‑Center, Redis Caching, MySQL Migration, and Flow‑Control Strategies

This article details how a membership system serving billions of users achieves high performance and high availability through a dual‑center Elasticsearch cluster, traffic‑isolated ES clusters, Redis cache with distributed locks, MySQL dual‑center partitioning, and fine‑grained flow‑control and degradation mechanisms, all while ensuring zero‑downtime migrations and consistent data.

ElasticsearchFlow ControlHigh Availability
0 likes · 20 min read
High‑Availability Architecture for a Billion‑Scale Membership System: ES Dual‑Center, Redis Caching, MySQL Migration, and Flow‑Control Strategies
Java Architect Essentials
Java Architect Essentials
Sep 29, 2021 · Cloud Native

A Comprehensive Guide to Microservice Architecture and Implementation

This article provides an in‑depth overview of microservice concepts, motivations, architectural principles, design patterns, service splitting strategies, essential infrastructure, popular frameworks such as Spring Boot, Spring Cloud, Dubbo, and Service Mesh, and practical recommendations for adopting microservices in real‑world projects.

DevOpsService MeshSpring Boot
0 likes · 18 min read
A Comprehensive Guide to Microservice Architecture and Implementation
Xianyu Technology
Xianyu Technology
Feb 5, 2021 · Backend Development

Improving Xianyu Messaging Reliability: Architecture, Issues, and Solutions

The article details how Xianyu’s 2020 messaging failures—lost messages, wrong avatars, and order status errors—were traced to duplicate IDs, push‑logic mismatches, and client bugs, and solved by introducing global UUIDs, ACK‑based retries, hierarchical conversation models, hybrid storage caching, and real‑time monitoring, boosting delivery reliability above 99.9%.

MessagingMobileReliability
0 likes · 12 min read
Improving Xianyu Messaging Reliability: Architecture, Issues, and Solutions
Top Architect
Top Architect
Jun 8, 2020 · Backend Development

Ensuring Idempotency with Unique IDs: UUID, Snowflake, and Distributed ID Generation

The article explains why idempotency is essential for reliable services, describes how unique identifiers such as UUIDs, Snowflake IDs, and database‑generated keys can be used to achieve it, and offers practical guidance on shared storage, avoiding unnecessary queries, and handling duplicate requests in distributed systems.

DatabaseIdempotencyUUID
0 likes · 8 min read
Ensuring Idempotency with Unique IDs: UUID, Snowflake, and Distributed ID Generation
Architecture Digest
Architecture Digest
May 30, 2020 · Fundamentals

A Comprehensive Guide to Learning Distributed Systems

This article provides a thorough overview of distributed systems, explaining their definition, when to adopt them, core concepts like partition and replication, common challenges, essential properties, typical architectural components, and practical implementations to help readers build a solid learning roadmap.

PartitionReplicationconsistency
0 likes · 15 min read
A Comprehensive Guide to Learning Distributed Systems
Architecture Digest
Architecture Digest
Nov 26, 2017 · Backend Development

Rate Limiting Strategies and Algorithms for High‑Concurrency Services

The article explains the need for rate limiting in high‑traffic scenarios, describes common algorithms such as token‑bucket and Guava RateLimiter, compares single‑node and distributed implementations, and outlines a Redis‑based solution for precise flow control across multiple service instances.

GuavaRate LimitingRedis
0 likes · 7 min read
Rate Limiting Strategies and Algorithms for High‑Concurrency Services
Architecture Digest
Architecture Digest
Apr 6, 2016 · Backend Development

Evolution of Kuaidi Dache Architecture: Solving LBS Bottlenecks, Long‑Connection Stability, Distributed Refactoring, Open Platform, Real‑Time Monitoring, and Data‑Layer Transformation

This article details how Kuaidi Dache scaled from 2013 to 2015 by addressing LBS performance limits, redesigning long‑connection services, refactoring monolithic code into layered services with Dubbo and RocketMQ, building a secure open platform, implementing Storm‑based real‑time monitoring, and migrating data storage to sharded MySQL, Canal‑driven sync, and HBase for massive scalability.

Real-time Monitoringarchitecturebackend
0 likes · 12 min read
Evolution of Kuaidi Dache Architecture: Solving LBS Bottlenecks, Long‑Connection Stability, Distributed Refactoring, Open Platform, Real‑Time Monitoring, and Data‑Layer Transformation
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Mar 30, 2015 · Backend Development

Douban's Platform Architecture: Online Services, BeansDB, DAE, and DPark

The article details Douban's comprehensive platform architecture, describing its online load‑balancing layer, the BeansDB key‑value store, the internal DAE PaaS, the big‑data DPark engine, and the team and operational practices that support both online and offline workloads.

Big DataGoarchitecture
0 likes · 9 min read
Douban's Platform Architecture: Online Services, BeansDB, DAE, and DPark