BestHub
Sign in
Tagged articles

distributed systems

2274 articles · Page 8 of 23
HomeTech
HomeTech
Apr 5, 2023 · Backend Development

Design and Implementation of a Real‑Time Cache Update System Based on Kafka and Distributed Cache

This article presents a comprehensive design and implementation of a real‑time cache update system that leverages Kafka‑driven database change streams, a centralized cache scheduling center, executor registration, broadcast and fail‑over scheduling, and a lightweight SDK to achieve millisecond‑level cache consistency for C‑end services.

BackendJavaKafka
0 likes · 10 min read
Design and Implementation of a Real‑Time Cache Update System Based on Kafka and Distributed Cache
Alibaba Cloud Developer
Alibaba Cloud Developer
Mar 31, 2023 · Backend Development

How Alibaba’s Custom Three‑Layer Distribution Boosts Scheduled Task Efficiency

This article walks through Alibaba's evolution from single‑machine scheduled jobs to a customized three‑layer distributed task framework, detailing classifications, Spring scheduling examples, batch processing integration, cluster distribution mechanics, and optimization techniques that maximize resource utilization and achieve smooth, balanced task execution.

AntschedulerSpringdistributed systems
0 likes · 16 min read
How Alibaba’s Custom Three‑Layer Distribution Boosts Scheduled Task Efficiency
Open Source Linux
Open Source Linux
Mar 31, 2023 · Fundamentals

What Is a Network Operating System? Concepts, Functions, and Key Examples

This article explains the concept of network operating systems, traces their historical development, outlines core functions such as resource sharing, communication, security, and management, describes typical architectures, and introduces major examples like UNIX, Linux, NetWare, and Windows Server.

NOSNetwork ManagementNetwork Operating System
0 likes · 8 min read
What Is a Network Operating System? Concepts, Functions, and Key Examples
Code Ape Tech Column
Code Ape Tech Column
Mar 30, 2023 · Backend Development

How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions

This article explains the common interview question of guaranteeing 100% message reliability in MQ middleware such as Kafka or RabbitMQ, outlines the three lifecycle stages of a message, discusses detection mechanisms, id generation, idempotent consumption, and handling message backlog, providing concrete design patterns and practical examples.

IdempotencyKafkaMessage Queue
0 likes · 12 min read
How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions
Volcano Engine Developer Services
Volcano Engine Developer Services
Mar 29, 2023 · Backend Development

How ByteHouse Achieves High‑Availability Real‑Time Data Ingestion with HaKafka

ByteHouse evolved its real‑time import pipeline from a community ClickHouse architecture to a custom HaKafka engine and a cloud‑native design, addressing node failures, read‑write conflicts, scaling costs, and latency by introducing two‑level concurrency, memory tables, exactly‑once semantics, and robust fault‑tolerance.

KafkaMemory TableReal-time Ingestion
0 likes · 15 min read
How ByteHouse Achieves High‑Availability Real‑Time Data Ingestion with HaKafka
MaGe Linux Operations
MaGe Linux Operations
Mar 27, 2023 · Backend Development

Mastering Rate Limiting: Concepts, Algorithms, and Real-World Implementations

This article explains the fundamental concepts of rate limiting, including time and resource dimensions, various rule types such as QPS, connection count, bandwidth, black/white lists, and distributed considerations, then details common algorithms like token bucket, leaky bucket, sliding window, and practical implementations using Nginx, Guava, Redis, and Sentinel.

Backenddistributed systemsleaky-bucket
0 likes · 16 min read
Mastering Rate Limiting: Concepts, Algorithms, and Real-World Implementations
Top Architect
Top Architect
Mar 27, 2023 · Big Data

Kafka Architecture, Performance Optimization, and Production Deployment Guide

This article provides a comprehensive overview of Kafka’s core concepts, high‑performance design, cluster planning, resource evaluation, deployment steps, producer and consumer configurations, fault‑tolerance mechanisms, and operational tools, offering practical guidance for building and managing a high‑throughput Kafka production environment.

Cluster DeploymentConsumerJava
0 likes · 31 min read
Kafka Architecture, Performance Optimization, and Production Deployment Guide
dbaplus Community
dbaplus Community
Mar 22, 2023 · Databases

Scaling an Airline Ticket Order Database: From Monolith to 64‑Shard Sharding

The article details how a rapidly growing airline ticket order system was re‑architected by identifying performance bottlenecks, applying vertical and horizontal sharding, optimizing cache layers, implementing dual‑write mechanisms, and planning a phased migration to achieve ten‑fold QPS growth while reducing resource usage and operational risk.

MySQLcache optimizationdatabase sharding
0 likes · 38 min read
Scaling an Airline Ticket Order Database: From Monolith to 64‑Shard Sharding
Architect
Architect
Mar 21, 2023 · Operations

Log Management, Observability, and APM Practices in Distributed Systems

This article explains what logs are, when to record them, their value in large‑scale architectures, and how to build effective logging, metrics, and tracing platforms using tools such as ELK, Prometheus, and SkyWalking, while also presenting good and bad logging practices and sample batch‑log retrieval code.

APMELKPrometheus
0 likes · 20 min read
Log Management, Observability, and APM Practices in Distributed Systems
Volcano Engine Developer Services
Volcano Engine Developer Services
Mar 16, 2023 · Databases

How ByteDance’s Abase Achieves Extreme High Availability in KV Storage

This article explains the evolution, architecture, and high‑availability solutions of ByteDance’s Abase KV storage system, detailing its multi‑write design, leader‑less approach, multi‑region deployment, consistency mechanisms, performance optimizations, and real‑world metrics that support billions of requests per second.

ByteDanceKV storagedistributed systems
0 likes · 20 min read
How ByteDance’s Abase Achieves Extreme High Availability in KV Storage
DataFunSummit
DataFunSummit
Mar 15, 2023 · Databases

Abase: ByteDance’s Large‑Scale Online KV Storage System – Architecture, High Availability, and Key Technologies

This article introduces Abase, ByteDance’s massive online KV storage system, detailing its evolution from a single‑cluster KV service to a multi‑region, multi‑tenant platform, and explains the high‑availability challenges and the leaderless multi‑write architecture, hybrid logical clocks, quorum settings, and performance optimizations that enable hundred‑billion QPS and sub‑10 ms latency.

ABaseByteDanceConsensus Protocols
0 likes · 19 min read
Abase: ByteDance’s Large‑Scale Online KV Storage System – Architecture, High Availability, and Key Technologies
Architects Research Society
Architects Research Society
Mar 15, 2023 · Big Data

Understanding Transactions in Apache Kafka: Semantics, API, and Practical Considerations

This article explains why exactly‑once semantics are needed for stream‑processing applications, describes Kafka's transactional model and semantics, details the Java transaction API and its usage, and discusses the internal components, performance trade‑offs, and practical guidelines for building reliable Kafka‑based pipelines.

Exactly-OnceJavaKafka
0 likes · 17 min read
Understanding Transactions in Apache Kafka: Semantics, API, and Practical Considerations
ITPUB
ITPUB
Mar 14, 2023 · Fundamentals

Master Distributed Systems: CAP, BASE, Locks, Transactions, Paxos & Raft

This comprehensive guide explores core distributed system concepts—including the CAP theorem and its trade‑offs, BASE consistency, various distributed lock strategies, multiple transaction patterns such as 2PC, 3PC, TCC and Seata, as well as consensus algorithms Paxos and Raft, while also covering idempotency and rate‑limiting techniques.

CAP theoremDistributed TransactionsIdempotency
0 likes · 29 min read
Master Distributed Systems: CAP, BASE, Locks, Transactions, Paxos & Raft
Programmer DD
Programmer DD
Mar 14, 2023 · Backend Development

Why This Spring ‘Full‑Stack’ Book Is a Must‑Read for Java Developers

The article reviews a comprehensive Spring framework book that covers the entire Spring family—from core concepts and data access to web development and cloud‑native microservices—using a practical, localized approach and a large milk‑tea shop case study to guide both beginners and experienced Java developers.

JavaSpring BootSpring Framework
0 likes · 10 min read
Why This Spring ‘Full‑Stack’ Book Is a Must‑Read for Java Developers
Bilibili Tech
Bilibili Tech
Mar 14, 2023 · Big Data

Bilibili HDFS Erasure Coding Strategy and Implementation

Bilibili reduced petabyte‑scale storage costs by back‑porting erasure‑coding patches to its HDFS 2.8.4 cluster, deploying a parallel EC‑enabled cluster, adding a data‑proxy service, intelligent routing and block‑checking, and automating cold‑data migration, while noting write overhead and planning native acceleration.

Data ReliabilityHDFSbig data
0 likes · 14 min read
Bilibili HDFS Erasure Coding Strategy and Implementation
FunTester
FunTester
Mar 13, 2023 · Operations

How Chaos Engineering Can Strengthen System Reliability: A Practical Guide

This article explains the origins and principles of chaos engineering, illustrates how fault‑injection scenarios expose system weaknesses, outlines step‑by‑step implementation—from tool selection and metric definition to execution and post‑mortem—and highlights its role in achieving high‑availability service level agreements.

DevOpschaos engineeringdistributed systems
0 likes · 10 min read
How Chaos Engineering Can Strengthen System Reliability: A Practical Guide
JavaEdge
JavaEdge
Mar 8, 2023 · Backend Development

Choosing CP vs AP for Service Discovery: When to Use Zookeeper or a Message Bus

This article explains the importance of service discovery in high‑availability systems, compares DNS, VIP, Zookeeper‑based CP solutions and message‑bus‑based AP approaches, outlines their registration and subscription workflows, highlights scalability and consistency trade‑offs, and provides practical guidance for designing robust registration centers.

APZooKeepercp
0 likes · 14 min read
Choosing CP vs AP for Service Discovery: When to Use Zookeeper or a Message Bus
Top Architect
Top Architect
Mar 8, 2023 · Backend Development

Implementing Rate Limiting with Redis: setnx, ZSet Sliding Window, and Token‑Bucket Approaches

This article explains three Redis‑based rate‑limiting techniques—using setnx for simple counters, leveraging ZSet for a sliding‑window algorithm, and applying a token‑bucket pattern with List—provides Java code examples for each method, discusses their advantages and drawbacks, and shows how to integrate them into backend services.

Javabackend developmentdistributed systems
0 likes · 7 min read
Implementing Rate Limiting with Redis: setnx, ZSet Sliding Window, and Token‑Bucket Approaches
MaGe Linux Operations
MaGe Linux Operations
Feb 25, 2023 · Backend Development

Mastering Rate Limiting: Strategies, Algorithms, and Real‑World Implementations

This article explains how rate limiting protects system availability by controlling traffic flow, introduces common patterns such as circuit breaking, service degradation, delay and privilege handling, compares cache, degradation, and rate limiting, and details popular algorithms and practical code implementations for both single‑node and distributed environments.

Guavacircuit breakerdistributed systems
0 likes · 13 min read
Mastering Rate Limiting: Strategies, Algorithms, and Real‑World Implementations
JD Tech
JD Tech
Feb 23, 2023 · Backend Development

Comprehensive Guide to Scheduling Tasks: Algorithms, Java Implementations, and Distributed Solutions

This article provides an in‑depth overview of scheduled task processing, covering common business scenarios, fundamental principles, single‑machine algorithms such as min‑heap and time‑wheel, Java utilities like Timer, DelayQueue, ScheduledExecutorService, Spring Task, Quartz, and distributed approaches using Redis, Elastic‑Job, and XXL‑Job.

CronSpringdistributed systems
0 likes · 22 min read
Comprehensive Guide to Scheduling Tasks: Algorithms, Java Implementations, and Distributed Solutions
MaGe Linux Operations
MaGe Linux Operations
Feb 19, 2023 · Backend Development

Mastering API Protection: Rate Limiting, Caching, and Degradation for E‑Commerce Spikes

When a product suddenly surges in demand, this guide explains how to safeguard e‑commerce APIs using rate‑limiting algorithms (leaky bucket, token bucket, sliding window), Nginx and Java semaphore controls, distributed throttling with message queues, service degradation strategies, and caching techniques to maintain stability.

distributed systemse-commercerate limiting
0 likes · 11 min read
Mastering API Protection: Rate Limiting, Caching, and Degradation for E‑Commerce Spikes
ITPUB
ITPUB
Feb 13, 2023 · Fundamentals

How a Bat-Borne Virus Explains the Gossip Protocol in Distributed Systems

Using a fictional coronavirus carried by a bat, the article illustrates the Gossip protocol’s mechanisms—direct mail, anti-entropy, and epidemic spread—to explain how distributed systems achieve eventual consistency, highlighting advantages, drawbacks, and practical considerations for storage components like Cassandra.

Anti-entropydata replicationdistributed systems
0 likes · 10 min read
How a Bat-Borne Virus Explains the Gossip Protocol in Distributed Systems
Bilibili Tech
Bilibili Tech
Feb 7, 2023 · Cloud Native

Bilibili Configuration Center (Config & Paladin): Architecture, Features, and Performance

Bilibili’s Config Center evolved from the 2017 Config v1 monolith—offering unified UI, MySQL storage, and long‑polling—to the Raft‑based Paladin v2, which adds lifecycle management, tenant isolation, incremental publishing, high‑throughput caching, multi‑active deployment, validation and rich tooling, handling hundreds of thousands of configs and tens of thousands of concurrent clients with sub‑50 ms push latency while planning deeper K8s integration.

Paladindistributed systemshigh availability
0 likes · 15 min read
Bilibili Configuration Center (Config & Paladin): Architecture, Features, and Performance
IT Architects Alliance
IT Architects Alliance
Feb 6, 2023 · Cloud Native

What Is Kubernetes and Why Is It Hard to Get Started?

This article introduces Kubernetes as a Google‑originated container‑based distributed cluster management system, explaining its architecture, core components such as Master, Nodes, Pods, Services, etcd, and detailing how communication, scheduling, storage, external access, scaling, and controller coordination work together.

Container OrchestrationKubernetesService
0 likes · 8 min read
What Is Kubernetes and Why Is It Hard to Get Started?
Code Ape Tech Column
Code Ape Tech Column
Feb 6, 2023 · Backend Development

Understanding the Basic Structure and Technical Stack of RPC Architecture

This article explains the fundamental components of RPC architecture, details the client‑server roles, communication protocols, serialization methods, transport protocols, and synchronous versus asynchronous invocation patterns, providing a comprehensive guide for building a custom RPC framework.

RPCTransport Protocolbackend development
0 likes · 12 min read
Understanding the Basic Structure and Technical Stack of RPC Architecture
21CTO
21CTO
Feb 5, 2023 · Backend Development

How Meituan Scaled Its Code Hosting Platform to Millions of Repositories

This article details Meituan's three‑stage evolution of its self‑developed Code platform—from a single‑machine service to a multi‑machine read‑write‑separated system and finally to a distributed, sharded architecture—highlighting the scalability and high‑availability challenges faced and the engineering solutions implemented.

backend architecturecode hostingdistributed systems
0 likes · 24 min read
How Meituan Scaled Its Code Hosting Platform to Millions of Repositories
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 3, 2023 · Cloud Computing

Rethinking Cloud Computing: How Alibaba’s CIPU Redefines Compute Power

This article revisits cloud computing by tracing the evolution of compute power, exploring Alibaba Cloud’s infrastructure breakthroughs such as the CIPU processor and its core platforms, and analyzing how these advances reshape elastic, big‑data, high‑performance, and AI workloads while highlighting trust, cost, and self‑service challenges.

Alibaba CloudCIPUCloud Computing
0 likes · 32 min read
Rethinking Cloud Computing: How Alibaba’s CIPU Redefines Compute Power
Java Architect Essentials
Java Architect Essentials
Feb 2, 2023 · Backend Development

Comparison of Distributed Task Scheduling Frameworks: Elastic‑Job vs X‑Job and Other Solutions

This article examines common business scenarios that require timed execution, introduces single‑machine and distributed scheduling frameworks such as Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, Elastic‑Job, Saturn and XXL‑Job, and provides a detailed feature‑by‑feature comparison to help choose the most suitable solution.

BackendElastic-JobJava
0 likes · 14 min read
Comparison of Distributed Task Scheduling Frameworks: Elastic‑Job vs X‑Job and Other Solutions
Meituan Technology Team
Meituan Technology Team
Feb 2, 2023 · R&D Management

Design and Evolution of Meituan's Distributed Code Hosting Platform

Meituan’s home‑grown Code platform evolved from a single‑server Git service to a distributed, sharded system with multi‑active replication, using Go‑based HTTP/SSH proxies, gRPC communication, and version‑based routing to achieve horizontal scalability, high availability, and millions of daily Git operations.

GitMeituancode hosting
0 likes · 22 min read
Design and Evolution of Meituan's Distributed Code Hosting Platform
JD Tech
JD Tech
Feb 2, 2023 · Fundamentals

Understanding the Byzantine Generals Problem and the Raft Consensus Algorithm

This article explains the Byzantine Generals problem, its fault‑tolerance limits, and how the Raft consensus algorithm solves a simplified version of the problem through leader election, log replication, and safety mechanisms, while also comparing Raft with Paxos, ZAB, and PBFT and providing Go code examples.

Byzantine GeneralsConsensus AlgorithmLeader Election
0 likes · 20 min read
Understanding the Byzantine Generals Problem and the Raft Consensus Algorithm
vivo Internet Technology
vivo Internet Technology
Jan 30, 2023 · Backend Development

Dubbo ZooKeeper Registry Implementation Principle Analysis

The article dissects Dubbo’s ZooKeeperRegistry by tracing its inheritance from AbstractRegistry through FailbackRegistry to CacheableFailbackRegistry, detailing local memory‑disk caching, retry logic via a timing wheel, URL‑push optimizations, and the ZooKeeper‑based ephemeral node and watcher mechanisms that enable dynamic service discovery, while also covering core ZooKeeper concepts.

DubboRPC FrameworkSource Code Analysis
0 likes · 20 min read
Dubbo ZooKeeper Registry Implementation Principle Analysis
Architect's Guide
Architect's Guide
Jan 28, 2023 · Backend Development

Implementing a Simple Java RPC Framework with Zookeeper, Netty, and Javassist

This article walks through the design and implementation of a lightweight Java RPC framework, covering core concepts such as service registration and discovery with Zookeeper, network communication via Netty, serialization, compression, dynamic proxy generation using Javassist, and performance comparisons between reflection and bytecode‑generated proxies.

JavaJavassistNetty
0 likes · 23 min read
Implementing a Simple Java RPC Framework with Zookeeper, Netty, and Javassist
Top Architect
Top Architect
Jan 19, 2023 · Backend Development

Implementing a Simple Java RPC Framework: Architecture, Service Registration, Proxy Generation, and Network Transport

This article explains the principles and implementation of a lightweight Java RPC framework, covering service registration with Zookeeper, client-side dynamic proxies, serialization, compression, Netty-based network transport, and both reflection and Javassist proxy generation, with extensive code examples and performance comparison.

JavaJavassistNetty
0 likes · 25 min read
Implementing a Simple Java RPC Framework: Architecture, Service Registration, Proxy Generation, and Network Transport
DataFunTalk
DataFunTalk
Jan 19, 2023 · Big Data

Tencent Alluxio: Accelerating the Next Generation of Big Data and AI

This article presents a comprehensive overview of Tencent's Alluxio project, covering the evolution of big‑data architecture, recent Alluxio research progress, typical deployment cases, and future work, while highlighting performance improvements, integration with cloud and AI workloads, and community contributions.

AIAlluxiobig data
0 likes · 21 min read
Tencent Alluxio: Accelerating the Next Generation of Big Data and AI
Architect
Architect
Jan 18, 2023 · Databases

Design and Architecture of Bilibili's High‑Performance KV Storage System

This article presents the background, overall architecture, partitioning strategies, raft‑based replication, binlog support, multi‑active deployment, bulk‑load mechanisms, storage‑engine optimizations, load‑balancing policies, and failure‑detection & recovery techniques of a high‑reliability, high‑throughput key‑value store used at Bilibili.

KV storagePartitioningRaft
0 likes · 22 min read
Design and Architecture of Bilibili's High‑Performance KV Storage System
DeWu Technology
DeWu Technology
Jan 16, 2023 · Cloud Native

Nacos Service Registration and Discovery: Principles and Implementation

The article explains Nacos’s open‑source service registry and discovery mechanisms, detailing client auto‑configuration, registration and health‑check workflows, server‑side instance handling, asynchronous copy‑on‑write processing, heartbeat cleanup, and cluster synchronization, while comparing its AP/CP capabilities to Zookeeper and Eureka.

JavaNacosSpring Boot
0 likes · 55 min read
Nacos Service Registration and Discovery: Principles and Implementation
MaGe Linux Operations
MaGe Linux Operations
Jan 13, 2023 · Fundamentals

Why ULID Beats UUID: A Deep Dive into Unique, Sortable IDs

This article explains what ULID is, why it often outperforms UUID by combining timestamp and randomness for collision‑free, lexicographically sortable identifiers, details its specification, binary layout, encoding, and shows practical Python usage and common application scenarios.

UUIDdistributed systemsulid
0 likes · 8 min read
Why ULID Beats UUID: A Deep Dive into Unique, Sortable IDs
Architect
Architect
Jan 12, 2023 · Operations

Critical Path Analysis for Latency Optimization in Large Distributed Systems

This article explains common latency analysis techniques, details the principles and implementation of critical path tracing, and demonstrates its practical application in Baidu App's recommendation service to efficiently identify and reduce performance bottlenecks in complex distributed architectures.

Latency analysisPerformance Monitoringcritical path
0 likes · 14 min read
Critical Path Analysis for Latency Optimization in Large Distributed Systems
Programmer DD
Programmer DD
Jan 11, 2023 · Databases

Redis Deep Dive: Pipelines, Pub/Sub, Persistence, Locks & Cluster

This comprehensive guide explores Redis fundamentals and advanced features, covering pipelines for reduced RTT, publish/subscribe messaging, key expiration strategies, transaction behavior, persistence mechanisms (RDB, AOF, hybrid), distributed locking techniques, sentinel high‑availability, and cluster sharding, with practical code examples and diagrams.

Redisdatabasedistributed systems
0 likes · 47 min read
Redis Deep Dive: Pipelines, Pub/Sub, Persistence, Locks & Cluster
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 10, 2023 · Backend Development

Key Differences Between RPC and Message Queues (MQ) in Distributed Systems

This article explains the core distinctions between Remote Procedure Call (RPC) and Message Queue (MQ) technologies, covering their architectures, communication patterns, functional features, and performance considerations, and outlines typical use cases such as synchronous calls, decoupling, traffic shaping, and asynchronous processing in distributed systems.

Message QueueRPCbackend development
0 likes · 6 min read
Key Differences Between RPC and Message Queues (MQ) in Distributed Systems
Architect
Architect
Jan 8, 2023 · Backend Development

Rethinking Microservices: From Hype to Core Architectural Principles

This article critically examines the microservices movement, tracing its historical roots, debunking common hype, and arguing that the true value lies in modular design, clear team ownership, and disciplined architectural practices rather than merely scaling distributed systems.

ModularityTeam Organizationdistributed systems
0 likes · 23 min read
Rethinking Microservices: From Hype to Core Architectural Principles
Tencent Cloud Developer
Tencent Cloud Developer
Jan 5, 2023 · Cloud Native

QQ Music High-Availability Architecture Overview

QQ Music achieves high availability by layering redundant multi‑datacenter architecture, proactive chaos‑engineering toolchains, and comprehensive observability—including metrics, logging, tracing and profiling—while employing service grading, adaptive retry windows and EMA‑based dynamic timeouts to gracefully handle faults across its massive micro‑service ecosystem.

chaos engineeringdistributed systemsfault tolerance
0 likes · 24 min read
QQ Music High-Availability Architecture Overview
DataFunTalk
DataFunTalk
Jan 3, 2023 · Big Data

Tencent Unified Big Data Scheduling Platform – Architecture, Design, and Operations

The article presents an in‑depth overview of Tencent's self‑developed Unified Scheduling Platform, detailing its system architecture, design challenges, performance optimizations, resource‑fair scheduling mechanisms, operational metrics, future roadmap, and a Q&A session that together illustrate how the platform enables massive offline data processing at scale.

big datadistributed systemsperformance optimization
0 likes · 18 min read
Tencent Unified Big Data Scheduling Platform – Architecture, Design, and Operations
Top Architect
Top Architect
Jan 2, 2023 · Big Data

Optimizing Kafka at Meituan: Challenges and Solutions for a Large‑Scale Data Platform

This article details Meituan's use of Kafka as a unified data cache and distribution layer, outlines the challenges of massive scale and latency, and presents comprehensive optimizations across application, system, and cluster management layers, including disk balancing, migration acceleration, fetcher isolation, and full‑link monitoring.

KafkaMeituanbig data
0 likes · 22 min read
Optimizing Kafka at Meituan: Challenges and Solutions for a Large‑Scale Data Platform
Architecture & Thinking
Architecture & Thinking
Dec 28, 2022 · Backend Development

Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging

This article explains the concept of idempotency, illustrates why repeated operations must yield identical results, and details how RocketMQ’s components—NameServer, Broker, Producer, and Consumer—can be designed with unique message IDs and acknowledgment mechanisms to achieve reliable, duplicate‑free messaging in backend systems.

BackendIdempotencyMessage Queue
0 likes · 10 min read
Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging
Selected Java Interview Questions
Selected Java Interview Questions
Dec 23, 2022 · Backend Development

Effective Cache Strategies for Large Distributed Systems

This article explains how to design and use client‑side, CDN, and server‑side caches—including Redis data structures, consistency patterns, and mitigation techniques for cache breakdown, penetration, and avalanche—to achieve high performance and reliability in billion‑user distributed applications.

Cache Penetrationcache consistencyclient-side cache
0 likes · 23 min read
Effective Cache Strategies for Large Distributed Systems
Programmer DD
Programmer DD
Dec 21, 2022 · Cloud Native

Spring Cloud 2022.0.0 Released: New Features, Modules, and Java 17 Support

Spring Cloud 2022.0.0, built on Spring Framework 6.x and Spring Boot 3.x, introduces a suite of updated modules, full Jakarta EE compatibility, mandatory Java 17 support, and marks OpenFeign as feature‑complete, offering developers a comprehensive toolkit for modern distributed systems.

Java 17Spring Boot 3Spring Cloud
0 likes · 3 min read
Spring Cloud 2022.0.0 Released: New Features, Modules, and Java 17 Support
Architect
Architect
Dec 14, 2022 · Backend Development

Service Rate Limiting, Degradation, and Caching Strategies for High-Concurrency E‑Commerce Systems

This article discusses how to handle sudden traffic spikes in e‑commerce APIs by employing caching, rate‑limiting (leaky bucket, token bucket, sliding window), Nginx and Java Semaphore limits, distributed queue buffering, service degradation, and cache‑consistency techniques to ensure system stability.

distributed systemsrate limitingservice degradation
0 likes · 8 min read
Service Rate Limiting, Degradation, and Caching Strategies for High-Concurrency E‑Commerce Systems
Java High-Performance Architecture
Java High-Performance Architecture
Dec 12, 2022 · Backend Development

Java Rate Limiting: Fixed, Sliding, Leaky & Token Bucket Algorithms Explained

This article introduces the concept of rate limiting, explains three core algorithms—fixed window, sliding window, and leaky bucket—along with the token bucket approach, provides Java code examples for each, discusses their principles, advantages, and pitfalls, and outlines practical implementation considerations.

BackendJavaalgorithm
0 likes · 15 min read
Java Rate Limiting: Fixed, Sliding, Leaky & Token Bucket Algorithms Explained
Architect
Architect
Dec 10, 2022 · Backend Development

Rate Limiting: Concepts, Common Algorithms, and Practical Implementation Strategies

This article explains the fundamentals of rate limiting, describes widely used algorithms such as token bucket, leaky bucket, and sliding window, and details practical implementation methods ranging from single‑machine tools like Guava and Tomcat to distributed solutions using Nginx, Redis, and Sentinel.

distributed systemsleaky-bucketrate limiting
0 likes · 17 min read
Rate Limiting: Concepts, Common Algorithms, and Practical Implementation Strategies
Thoughts on Knowledge and Action
Thoughts on Knowledge and Action
Dec 10, 2022 · Fundamentals

How Raft Guarantees Consistent Log Replication and Leader Election

This article explains the Raft consensus algorithm, detailing how it breaks consistency into leader election, log replication, and safety, and describes the roles, term handling, election rules, log matching, snapshotting, and the RPC mechanisms that ensure a reliable distributed state machine.

Consensus AlgorithmLeader ElectionLog Replication
0 likes · 12 min read
How Raft Guarantees Consistent Log Replication and Leader Election
Selected Java Interview Questions
Selected Java Interview Questions
Dec 9, 2022 · Backend Development

Design and Implementation of BetterGateway for Centralized Error‑Code Management in Distributed Systems

This article describes the background, design, configuration, code implementation, and testing of BetterGateway—a Spring Cloud Alibaba‑based gateway that centralizes error‑code management using Nacos and dynamic refresh to enable fast, accurate exception tracing across micro‑services and third‑party interfaces.

Nacosdistributed systemserror handling
0 likes · 15 min read
Design and Implementation of BetterGateway for Centralized Error‑Code Management in Distributed Systems
php Courses
php Courses
Dec 8, 2022 · Backend Development

Session Sharing Solutions in Distributed Environments: Nginx ip_hash, Tomcat Replication, Redis Cache, and Cookie

To prevent repeated logins in distributed microservice systems, this article explains four session‑sharing solutions—Nginx ip_hash load balancing, Tomcat session replication, Redis‑based session caching, and cookie‑based storage—detailing their principles, configuration examples, and advantages and disadvantages.

NginxTomcatdistributed systems
0 likes · 5 min read
Session Sharing Solutions in Distributed Environments: Nginx ip_hash, Tomcat Replication, Redis Cache, and Cookie
High Availability Architecture
High Availability Architecture
Dec 1, 2022 · Fundamentals

Extending Paxos with Partially Ordered rnd Values for Transactional Mutual Exclusion

The article explains how Paxos can be generalized by defining its round number (rnd) over any partially ordered set, enabling both forced and non‑forced conflict exclusion mechanisms similar to 2PC, and showing how this expands Paxos’s applicability to multi‑dimensional transaction ordering and simplifies distributed database architectures.

2PCConsensusPartial Order
0 likes · 4 min read
Extending Paxos with Partially Ordered rnd Values for Transactional Mutual Exclusion
Architecture Digest
Architecture Digest
Nov 30, 2022 · Backend Development

Meituan Kafka at Scale: Challenges and Optimizations for Latency, Cluster Management, and Reliability

This article details Meituan's large‑scale Kafka deployment—over 15,000 machines and petabyte‑level daily traffic—its operational challenges such as slow nodes, load imbalance, and resource contention, and the comprehensive read/write latency, system‑level, and cluster‑management optimizations implemented to improve performance and reliability.

Kafkacluster-managementdistributed systems
0 likes · 22 min read
Meituan Kafka at Scale: Challenges and Optimizations for Latency, Cluster Management, and Reliability
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Nov 28, 2022 · Cloud Computing

How Baidu’s ARIES Powers Exabyte-Scale Cloud Storage for Baidu Netdisk

This article presents a comprehensive overview of Baidu’s ARIES storage platform, detailing its design philosophy, architecture, key concepts, and engineering challenges, and explains how it underpins Baidu Netdisk’s massive data‑plane storage with high availability, cost‑performance trade‑offs, and robust monitoring.

Cloud Storagedistributed systemserasure coding
0 likes · 36 min read
How Baidu’s ARIES Powers Exabyte-Scale Cloud Storage for Baidu Netdisk
Java Architect Essentials
Java Architect Essentials
Nov 27, 2022 · Backend Development

Service Rate Limiting, Degradation, and Caching Strategies for High‑Concurrency E‑commerce Interfaces

The article explains how to protect a suddenly hot product API in an e‑commerce system by applying caching, various rate‑limiting algorithms, service degradation techniques, and distributed caching patterns, providing concrete Java code and architectural recommendations for backend developers.

BackendCachingJava
0 likes · 9 min read
Service Rate Limiting, Degradation, and Caching Strategies for High‑Concurrency E‑commerce Interfaces
Top Architect
Top Architect
Nov 26, 2022 · Backend Development

Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Features, and Best Practices

This article provides an in-depth comparison of RabbitMQ, RocketMQ, and Kafka, detailing their core components, exchange types, message durability, acknowledgment mechanisms, TTL, dead‑letter queues, load balancing, ordering, transaction handling, high‑availability configurations, and practical solutions for common messaging challenges.

KafkaRabbitMQRocketMQ
0 likes · 33 min read
Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Features, and Best Practices
Top Architect
Top Architect
Nov 25, 2022 · Backend Development

Comprehensive Guide to RocketMQ Message Types, Production, and Consumption

This article provides an in‑depth tutorial on RocketMQ, covering normal, ordered, delayed, transactional, and batch messages, their production and consumption patterns, retry mechanisms, message filtering, and dead‑letter handling, complete with Java code examples for each scenario.

JavaMessage FilteringRocketMQ
0 likes · 36 min read
Comprehensive Guide to RocketMQ Message Types, Production, and Consumption
21CTO
21CTO
Nov 22, 2022 · Fundamentals

Key Distributed System Techniques: Bloom Filter, Consistent Hashing, Quorum

This article explains fundamental distributed‑system mechanisms—including Bloom filters for space‑efficient membership tests, consistent hashing for scalable data placement, quorum requirements for operation safety, leader‑follower coordination, heartbeats, fencing, write‑ahead logging, log segmentation, high‑water marks, leases, gossip protocols, failure detection, split‑brain resolution, checksums, CAP and PACELC theorems, hinted handoff, read repair, and Merkle trees—providing a comprehensive overview for engineers.

Bloom FilterConsistencyconsistent hashing
0 likes · 13 min read
Key Distributed System Techniques: Bloom Filter, Consistent Hashing, Quorum
Tencent Cloud Developer
Tencent Cloud Developer
Nov 18, 2022 · Backend Development

Cache Consistency Strategies and Best Practices

The article explains how using a Redis cache can boost read performance but introduces consistency challenges, compares four cache‑aside write strategies, and recommends the reliable “update database then delete cache” approach combined with short expiration times and asynchronous message‑queue invalidation to keep data fresh.

BackendCache AsideConsistency
0 likes · 20 min read
Cache Consistency Strategies and Best Practices
21CTO
21CTO
Nov 17, 2022 · Operations

Mastering Load Balancing: Common Algorithms and Their Implementations

This article explains what load balancing technology is, reviews common load balancing algorithms such as Round Robin, Weighted Round Robin, Least Connections, and Consistent Hash, and demonstrates their implementations with code examples, while also covering extensions like service discovery, health checks, and slow start mechanisms.

Algorithmsdistributed systemshealth-check
0 likes · 21 min read
Mastering Load Balancing: Common Algorithms and Their Implementations
NetEase Media Technology Team
NetEase Media Technology Team
Nov 17, 2022 · Backend Development

Design and Evolution of NetEase Advertising Engine Platform

NetEase’s advertising engine platform evolved from a monolithic, high‑concurrency system handling over a billion daily requests into a layered, distributed architecture that unifies indexing, billing, user‑tagging, and monitoring services, leverages Elasticsearch and custom extensions for fast retrieval, and plans further upgrades such as a custom retrieval kernel and Go‑based services.

Advertising PlatformIndexing ServiceReal-Time Computing
0 likes · 21 min read
Design and Evolution of NetEase Advertising Engine Platform
Selected Java Interview Questions
Selected Java Interview Questions
Nov 15, 2022 · Backend Development

Comprehensive Guide to Rate Limiting: Concepts, Algorithms, and Implementation Strategies

This article explains the fundamental concepts of rate limiting, compares common algorithms such as token bucket, leaky bucket and sliding window, and details practical implementations using Nginx, Tomcat, Redis, Guava, and Sentinel for both single‑node and distributed backend systems.

algorithmdistributed systemsrate limiting
0 likes · 17 min read
Comprehensive Guide to Rate Limiting: Concepts, Algorithms, and Implementation Strategies
Architect's Guide
Architect's Guide
Nov 15, 2022 · Backend Development

RocketMQ Message Types, Sending Modes, Ordering, Delayed, Transactional, Batch, Filtering, Retry and Dead‑Letter Queues

This article provides a comprehensive overview of RocketMQ messaging concepts—including synchronous, asynchronous and one‑way sending, ordered and delayed messages, transaction handling, batch processing, tag/SQL filtering, retry mechanisms, and dead‑letter queue management—accompanied by Java code examples for each scenario.

JavaMessage QueueRocketMQ
0 likes · 36 min read
RocketMQ Message Types, Sending Modes, Ordering, Delayed, Transactional, Batch, Filtering, Retry and Dead‑Letter Queues
Huolala Tech
Huolala Tech
Nov 11, 2022 · Big Data

How Huolala Boosted Offline Scheduling Performance: Strategies & Lessons

Huolala’s big‑data offline platform, built from scratch, faced escalating scheduling delays as task instances grew, prompting a series of short‑ and mid‑term optimizations—including zombie task cleanup, retention policies, memory caching, algorithmic tweaks, and high‑availability enhancements—to dramatically reduce dependency computation time and sustain million‑scale daily workloads.

big datadistributed systemsoffline scheduling
0 likes · 12 min read
How Huolala Boosted Offline Scheduling Performance: Strategies & Lessons
21CTO
21CTO
Nov 9, 2022 · Operations

How Ctrip Handles Billions of Logs Daily: Real‑Time Monitoring, Clog, CAT & TSDB

This article details Ctrip’s large‑scale log monitoring architecture, covering the overall Overview, the Clog log system, the CAT tracing platform, and the internal TSDB solution, explaining how billions of logs are processed in real time with low latency, high reliability, and efficient querying.

Log MonitoringTime Series Databasebig data
0 likes · 12 min read
How Ctrip Handles Billions of Logs Daily: Real‑Time Monitoring, Clog, CAT & TSDB
dbaplus Community
dbaplus Community
Nov 3, 2022 · Big Data

Why Kafka Stores Data the Way It Does: A Deep Dive into Its Log Architecture

This article thoroughly examines Kafka's storage system, explaining why it uses sequential log writes combined with sparse indexing, how different log formats evolved, and the mechanisms for log retention and compaction that enable high‑throughput, fault‑tolerant streaming at massive scale.

KafkaLog CompactionLog Retention
0 likes · 22 min read
Why Kafka Stores Data the Way It Does: A Deep Dive into Its Log Architecture
Sohu Tech Products
Sohu Tech Products
Nov 2, 2022 · Fundamentals

Understanding ULID: Features, Specification, and Python Usage

This article explains ULID (Universally Unique Lexicographically Sortable Identifier), compares it with UUID, outlines its technical specifications, lists its advantages and typical application scenarios, and provides detailed Python examples for generating and manipulating ULIDs.

Pythondistributed systemsidentifier generation
0 likes · 6 min read
Understanding ULID: Features, Specification, and Python Usage
ShiZhen AI
ShiZhen AI
Nov 2, 2022 · Operations

How to Quickly Scale Kafka Topic Replicas with Know Streaming

This guide explains how Know Streaming adds a non‑native Kafka feature that lets users batch‑scale replicas for one or multiple topics, customize target brokers, preview and edit the reassignment plan, and throttle the operation to minimize impact on the cluster.

KafkaKafka OperationsKnow Streaming
0 likes · 5 min read
How to Quickly Scale Kafka Topic Replicas with Know Streaming
IT Architects Alliance
IT Architects Alliance
Nov 2, 2022 · Databases

The Importance, Evolution, and Future Trends of Distributed Databases

This article examines why databases are foundational to modern IT, traces the historical development of distributed database technologies, compares various architectural approaches such as sharding middleware, shared‑storage and shared‑nothing designs, and discusses emerging trends like multi‑model, HTAP, cloud‑native, and open‑source ecosystems.

HTAPcloud nativedata modeling
0 likes · 11 min read
The Importance, Evolution, and Future Trends of Distributed Databases
Sanyou's Java Diary
Sanyou's Java Diary
Oct 31, 2022 · Backend Development

Mastering the Spring Cloud Alibaba Microservice Ecosystem: From Nacos to XXL‑JOB

This article provides a comprehensive guide to building a microservice ecosystem with Spring Cloud Alibaba, covering essential modules such as service registration, load balancing, configuration, messaging, gateway, fault tolerance, distributed transactions, tracing, and task scheduling, and showing how to integrate them with practical code examples.

NacosSpring BootSpring Cloud
0 likes · 26 min read
Mastering the Spring Cloud Alibaba Microservice Ecosystem: From Nacos to XXL‑JOB
Top Architect
Top Architect
Oct 29, 2022 · Databases

Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization

This article provides a comprehensive overview of Elasticsearch, covering its underlying Lucene architecture, data types, cluster components, shard allocation, indexing mechanisms, storage strategies, and performance tuning tips for building scalable, near‑real‑time search solutions.

distributed systemsindexingperformance optimization
0 likes · 35 min read
Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization
Architects' Tech Alliance
Architects' Tech Alliance
Oct 29, 2022 · Databases

Analysis of China's Distributed Database Market and Future Development Trends

This article examines the importance, definitions, classifications, and technological evolution of distributed databases in China, outlines major architecture routes such as sharding middleware, shared‑storage and decentralized models, discusses HTAP and cloud‑native trends, and summarizes future directions including open‑source ecosystems and industry support.

HTAPcloud nativedatabases
0 likes · 10 min read
Analysis of China's Distributed Database Market and Future Development Trends
DataFunTalk
DataFunTalk
Oct 28, 2022 · Big Data

Angel Graph: A High‑Performance Distributed Graph Computing Framework for Intelligent Risk Control

Angel Graph is a high‑performance, fault‑tolerant distributed graph computing framework developed by Tencent, featuring scalable node‑metric, community‑detection, and graph‑neural‑network algorithms optimized for billion‑node, trillion‑edge datasets, and demonstrated through practical applications in intelligent financial risk control.

Community Detectiondistributed systemsgraph computing
0 likes · 20 min read
Angel Graph: A High‑Performance Distributed Graph Computing Framework for Intelligent Risk Control
Architect's Guide
Architect's Guide
Oct 27, 2022 · Big Data

Elasticsearch Overview: Data Types, Lucene Foundations, Core Concepts, Cluster Architecture, Indexing, Storage, and Performance Optimization

This article provides a comprehensive introduction to Elasticsearch, covering the distinction between structured and unstructured data, Lucene’s inverted index, ES core concepts such as clusters, nodes, shards and replicas, mapping, basic usage, storage mechanisms, and practical performance‑tuning tips for large‑scale search deployments.

ElasticSearchLucenedistributed systems
0 likes · 39 min read
Elasticsearch Overview: Data Types, Lucene Foundations, Core Concepts, Cluster Architecture, Indexing, Storage, and Performance Optimization
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 26, 2022 · Backend Development

DolphinScheduler Design, Architecture, and Source Code Analysis

This article provides a comprehensive overview of DolphinScheduler’s design strategies, distributed architecture, fault‑tolerance mechanisms, configuration files, core APIs, Quartz integration, master‑worker execution flow, RPC communication, load‑balancing algorithms, and logging services, accompanied by detailed code excerpts and diagrams.

DolphinSchedulerQuartzRPC
0 likes · 46 min read
DolphinScheduler Design, Architecture, and Source Code Analysis
Top Architect
Top Architect
Oct 22, 2022 · Backend Development

Comprehensive Guide to Microservice Architecture, Spring Cloud, Dubbo, and Related Backend Practices

This article provides an in‑depth overview of microservice architecture, covering concepts such as RPC frameworks, serialization, CAP/BASE theories, distributed transactions, monitoring, high availability, load balancing, service registration, Dubbo fault‑tolerance strategies, Spring Boot vs MVC differences, core Spring annotations, and auto‑configuration mechanisms.

DubboSpring Cloudbackend architecture
0 likes · 38 min read
Comprehensive Guide to Microservice Architecture, Spring Cloud, Dubbo, and Related Backend Practices
Architect's Tech Stack
Architect's Tech Stack
Oct 20, 2022 · Fundamentals

Understanding ULID: A Better Alternative to UUID

ULID (Universally Unique Lexicographically Sortable Identifier) combines a millisecond-precision timestamp with high-entropy randomness to produce 128‑bit, URL‑safe, lexicographically sortable IDs that avoid UUID’s collision risks, offering advantages such as monotonic ordering, compact Base32 encoding, and suitability for distributed database primary keys.

PythonUUIDdistributed systems
0 likes · 8 min read
Understanding ULID: A Better Alternative to UUID
Top Architect
Top Architect
Oct 16, 2022 · Backend Development

Common Load Balancing Algorithms and Their Java Implementations

This article provides a comprehensive overview of various load balancing strategies—including round‑robin, random, weighted, smooth weighted round‑robin, consistent hashing, least‑active, and optimal‑response algorithms—explaining their principles, advantages, disadvantages, use‑cases, and offering complete Java code examples for each.

Backendalgorithmdistributed systems
0 likes · 33 min read
Common Load Balancing Algorithms and Their Java Implementations
Laravel Tech Community
Laravel Tech Community
Oct 13, 2022 · Backend Development

Designing a Scalable Backend for a Nationwide ID Query Service

The article outlines a simple yet scalable backend architecture that can handle 20 million daily ID queries by partitioning a billion‑record dataset across multiple 16 GB virtual machines, using direct‑index lookups, modest bandwidth, and basic redundancy mechanisms to achieve ample performance headroom.

distributed systemsredundancyscalability
0 likes · 6 min read
Designing a Scalable Backend for a Nationwide ID Query Service
Programmer DD
Programmer DD
Oct 12, 2022 · Backend Development

From Monolith to Distributed: How We Transformed a Stock System with CQRS

This article explains what software architecture is, why choosing an architectural style matters, compares monolithic and distributed approaches using a real‑world inventory system case study, and details the step‑by‑step functional and business splitting, CQRS implementation, code refactoring, and handling of distributed transactions.

CQRSdistributed systemsmicroservices
0 likes · 20 min read
From Monolith to Distributed: How We Transformed a Stock System with CQRS
IT Architects Alliance
IT Architects Alliance
Oct 9, 2022 · Backend Development

Event‑Driven Messaging Patterns at Wix: Consumption, Projection, End‑to‑End Streaming, In‑Memory KV Stores, Scheduling, Transactions, and Aggregation

The article describes how Wix engineers built a robust, Kafka‑based event‑driven messaging infrastructure for over 1,400 microservices, detailing patterns such as consumption and projection, end‑to‑end streaming with websockets, in‑memory KV stores, schedule‑and‑forget jobs, exactly‑once transactions, and event aggregation to achieve scalability, resilience, and low‑latency data access.

Data StreamingKafkadistributed systems
0 likes · 16 min read
Event‑Driven Messaging Patterns at Wix: Consumption, Projection, End‑to‑End Streaming, In‑Memory KV Stores, Scheduling, Transactions, and Aggregation
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 29, 2022 · Backend Development

Scaling Event‑Driven Messaging at Wix with Kafka: Key Patterns

This article explains how Wix uses Kafka‑based event‑driven messaging to decouple microservices, improve scalability, and achieve exactly‑once processing through patterns such as consume‑and‑project, end‑to‑end event streams, in‑memory KV stores, scheduled jobs, transactional events, and event aggregation.

Data StreamingKafkadistributed systems
0 likes · 16 min read
Scaling Event‑Driven Messaging at Wix with Kafka: Key Patterns
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 27, 2022 · Big Data

How JindoData Transforms Data Lake Storage for the Big Data Era

This article reviews Sun DaPeng's presentation on Alibaba Cloud's open‑source big data platform, covering the rapid growth of data, the evolution of storage architectures from HDFS to cloud‑native data lakes, and the detailed JindoData solution—including JindoFS, JindoFSx, and JindoSDK—that delivers high‑performance, cost‑effective storage for modern analytics workloads.

JindoDataclouddistributed systems
0 likes · 16 min read
How JindoData Transforms Data Lake Storage for the Big Data Era