Tagged articles

distributed systems

2274 articles · Page 9 of 23
vivo Internet Technology
vivo Internet Technology
Sep 21, 2022 · Backend Development

Dubbo Generic Invocation: Project Practice and Principle Analysis

By applying Dubbo's GenericService $invoke method, the vivo project replaced tightly‑coupled direct API calls with a unified remote‑call layer that eliminates third‑party JAR dependencies, reduces system coupling, and leverages Dubbo’s internal proxy‑exporter mechanisms to dynamically invoke diverse external services.

DubboGeneric InvocationJava
0 likes · 23 min read
Dubbo Generic Invocation: Project Practice and Principle Analysis
Baidu Geek Talk
Baidu Geek Talk
Sep 21, 2022 · Industry Insights

How Baidu’s Transaction Middle‑Platform Asset System Enables C2C Payments and Guarantees Consistency

This article details the design and implementation of Baidu's transaction middle‑platform asset system, covering its C2C payment model, core asset management capabilities, consistency guarantees, double‑entry accounting, hot‑account handling, sharding and archiving strategies, and compliance with national financial regulations.

C2C paymentsConsistencyFinancial Compliance
0 likes · 15 min read
How Baidu’s Transaction Middle‑Platform Asset System Enables C2C Payments and Guarantees Consistency
Dada Group Technology
Dada Group Technology
Sep 19, 2022 · Backend Development

How to Build a Real‑Time Inventory Sync System that Eliminates Overselling

This article analyzes the challenges of real‑time inventory synchronization for omnichannel retail—such as sync latency, concurrent overselling, and shared stock calculation—and presents a comprehensive backend architecture featuring low‑latency syncing, dynamic throttling, safety‑stock algorithms, and a scalable calculation engine.

Inventorybackend architecturedistributed systems
0 likes · 11 min read
How to Build a Real‑Time Inventory Sync System that Eliminates Overselling
Architect's Guide
Architect's Guide
Sep 17, 2022 · Backend Development

An Introduction to Microservice Architecture: Concepts, Evolution, Comparison with Monolithic, Design Patterns, and Pros & Cons

This article provides a comprehensive overview of microservice architecture, covering its definition, history, differences from monolithic development, key characteristics, comparison with SOA, practical implementation steps, common design patterns, advantages, disadvantages, and essential considerations for successful adoption.

API GatewayDevOpsdistributed systems
0 likes · 20 min read
An Introduction to Microservice Architecture: Concepts, Evolution, Comparison with Monolithic, Design Patterns, and Pros & Cons
Qingyun Technology Community
Qingyun Technology Community
Sep 15, 2022 · Cloud Computing

How GPU, VPU, and CPU Accelerate Cloud Video Transcoding: Architecture and Best Practices

This article explores the rapid growth of video traffic, explains why transcoding is essential, compares CPU, GPU, and VPU hardware for video processing, details the FFmpeg software stack, describes the design of a cloud‑native transcoding cluster, its scheduling, shard‑transcoding technique, and presents performance test results.

Cloud ComputingFFmpegGPU acceleration
0 likes · 23 min read
How GPU, VPU, and CPU Accelerate Cloud Video Transcoding: Architecture and Best Practices
Practical DevOps Architecture
Practical DevOps Architecture
Sep 15, 2022 · Cloud Native

Brief Overview of etcd and Kubernetes: Features, Use Cases, and Core Components

This article provides a concise overview of etcd and Kubernetes, detailing etcd’s features and use‑cases, explaining Kubernetes fundamentals, its relationship with Docker, and describing key components such as Minikube, Kubectl, Kubelet, common deployment methods, and the platform’s cluster management architecture.

cloud nativedistributed systemsetcd
0 likes · 6 min read
Brief Overview of etcd and Kubernetes: Features, Use Cases, and Core Components
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 13, 2022 · Backend Development

Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared

This article examines common business scenarios that require timed execution, explains why scheduled tasks are essential, compares standalone and distributed Java scheduling frameworks—including Timer, ScheduledExecutorService, Spring, Quartz, TBSchedule, Elastic-Job, Saturn, and XXL-Job—and provides guidance on selecting the most suitable solution based on scalability, reliability, and operational needs.

Javabackend developmentdistributed systems
0 likes · 14 min read
Choosing the Right Java Scheduling Framework: Timer, Quartz, Elastic-Job, X-Job Compared
phodal
phodal
Sep 12, 2022 · Backend Development

How Feakin Builds Real‑Time Collaborative Editing with WebSockets, CRDTs, and Rust

This article analyzes Feakin's approach to online collaborative diagram editing, covering communication protocols, data formats, the trade‑offs between centralized OT and decentralized CRDT algorithms, and the Rust‑based server and client implementation using Actix, WebSocket, and WebAssembly.

ActixCRDTOT
0 likes · 13 min read
How Feakin Builds Real‑Time Collaborative Editing with WebSockets, CRDTs, and Rust
Java Captain
Java Captain
Sep 10, 2022 · Backend Development

Designing a Scalable Backend for One Billion Users with Minimal Resources

The article outlines how a modest cluster of 20 virtual machines with 16 GB RAM each can handle 1 billion user records and 20 million hourly queries by using simple in‑memory arrays, basic indexing, modest bandwidth, and straightforward failover mechanisms, without requiring advanced technologies.

Memory Optimizationdistributed systems
0 likes · 7 min read
Designing a Scalable Backend for One Billion Users with Minimal Resources
IT Architects Alliance
IT Architects Alliance
Sep 8, 2022 · Backend Development

Evolution of a Simple MVP Monolithic Architecture to a Complex Distributed System: A Taobao Case Study

This article uses a simulated Taobao example to illustrate how a simple MVP monolithic architecture evolves through ten stages—from separating Tomcat and database to adopting caching, load balancing, database sharding, microservices, ESB, containerization, and cloud platforms—highlighting the technologies and design principles involved in each transition.

Backendarchitecturecloud
0 likes · 20 min read
Evolution of a Simple MVP Monolithic Architecture to a Complex Distributed System: A Taobao Case Study
macrozheng
macrozheng
Sep 8, 2022 · Backend Development

Why Do Payment Orders Disappear? Causes and Prevention Strategies for E‑Commerce

The article explains why e‑commerce users sometimes see their payments completed in the wallet but the order remains unpaid, analyzes internal and external drop‑order scenarios, and provides practical server‑side, client‑side, and active‑query techniques—including scheduled tasks and delayed‑message queues—to prevent such issues.

BackendMessage Queueactive query
0 likes · 13 min read
Why Do Payment Orders Disappear? Causes and Prevention Strategies for E‑Commerce
Tencent Cloud Developer
Tencent Cloud Developer
Sep 6, 2022 · Backend Development

Understanding Rate Limiting in Distributed Systems: Algorithms and Best Practices

Rate limiting safeguards distributed systems by controlling request rates through algorithms such as leaky bucket, token bucket, fixed and sliding windows, and back pressure, while client‑side tactics like exponential backoff, jitter, and careful retries, and requires atomic distributed storage solutions (e.g., Redis+Lua) to avoid race conditions.

algorithmback pressuredistributed systems
0 likes · 16 min read
Understanding Rate Limiting in Distributed Systems: Algorithms and Best Practices
JavaEdge
JavaEdge
Sep 3, 2022 · Backend Development

How to Ensure Idempotent Order Creation and Prevent ABA Issues in Distributed Systems

This article explains why order creation and payment APIs must be idempotent, outlines practical techniques such as unique request IDs, database unique constraints, Redis flags, and version‑based optimistic locking to avoid duplicate orders and solve the ABA problem in distributed environments.

ABA problemDatabase TransactionIdempotency
0 likes · 9 min read
How to Ensure Idempotent Order Creation and Prevent ABA Issues in Distributed Systems
ByteDance Cloud Native
ByteDance Cloud Native
Sep 2, 2022 · Big Data

How ByteDance’s Cloud Shuffle Service Boosts Big Data Job Stability and Performance

ByteDance’s Cloud Shuffle Service (CSS) replaces the traditional Pull‑Based Sort Shuffle in Spark, FlinkBatch and MapReduce with a Push‑Based remote shuffle that improves stability, performance and elasticity, supports compute‑storage separation, and delivers significant speedups in large‑scale TPC‑DS benchmarks.

Remote ShuffleShuffle ServiceSpark
0 likes · 11 min read
How ByteDance’s Cloud Shuffle Service Boosts Big Data Job Stability and Performance
IT Architects Alliance
IT Architects Alliance
Sep 2, 2022 · Fundamentals

Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More

This article introduces essential distributed‑system concepts—including Bloom filters, consistent hashing, quorum, leader/follower roles, heartbeats, fencing, WAL, segment logs, high‑water marks, leases, gossip protocol, Phi failure detection, CAP and PACELC theorems, hinted handoff, read repair, and Merkle trees—explaining their purpose and how they are applied in systems such as BigTable, Cassandra, Dynamo, and Kafka.

Bloom FilterCAP theoremLeader Election
0 likes · 12 min read
Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More
Top Architect
Top Architect
Sep 1, 2022 · Backend Development

Ensuring Zero Message Loss in MQ Systems – Interview Guide and Best Practices

This article explains how to guarantee that messages are never lost when using MQ middleware such as Kafka, RabbitMQ or RocketMQ, covering the three lifecycle stages, detection methods, design‑for‑failure principles, idempotent consumption, handling message backlog, and practical interview answers.

MQMessage Lossdistributed systems
0 likes · 13 min read
Ensuring Zero Message Loss in MQ Systems – Interview Guide and Best Practices
Architecture Digest
Architecture Digest
Aug 31, 2022 · Backend Development

Implementing a Reliable Delay Queue with Redis and Go

This article explains how to build a reliable delayed message queue using Redis, covering business scenarios, requirements such as persistence and retry, the design of Redis data structures, Lua scripts for atomic operations, and a Go implementation with example code for producing and consuming delayed tasks.

GoLuaMessage Queue
0 likes · 13 min read
Implementing a Reliable Delay Queue with Redis and Go
Top Architect
Top Architect
Aug 30, 2022 · Fundamentals

Key Distributed System Design Patterns and Concepts

This article explains essential distributed‑system design patterns such as Bloom filters, consistent hashing, quorum, leader‑follower replication, heartbeats, fencing, write‑ahead logs, segment logs, high‑water marks, leases, CAP and PACELC theorems, hinted handoff, read‑repair, Merkle trees, and related failure‑detection mechanisms, illustrating how they improve scalability, consistency and fault tolerance.

Bloom FilterCAP theoremConsistency
0 likes · 12 min read
Key Distributed System Design Patterns and Concepts

How to Build a Unified Big Data Security Platform with Ranger and Custom Authorization

This article explains the design and implementation of a unified data security control platform that protects user privacy and corporate data across multiple big‑data components (Hive, Hetu, GaussDB) by integrating Apache Ranger, custom authorization APIs, asynchronous processing, distributed locking, and SDK‑based authentication to achieve fine‑grained, one‑stop permission management.

GaussDBaccess controlauthorization
0 likes · 17 min read
How to Build a Unified Big Data Security Platform with Ranger and Custom Authorization
MaGe Linux Operations
MaGe Linux Operations
Aug 28, 2022 · Cloud Native

Master MinIO: From Client Commands to Scalable Distributed Clusters

This guide walks through MinIO client (mc) usage, bucket management, user and policy administration, and two practical methods for expanding a MinIO distributed cluster—peer‑to‑peer scaling and federation with etcd—providing step‑by‑step commands, scripts, and configuration details for cloud‑native object storage.

Object Storagecluster scalingcommand line
0 likes · 31 min read
Master MinIO: From Client Commands to Scalable Distributed Clusters
Code Ape Tech Column
Code Ape Tech Column
Aug 26, 2022 · Fundamentals

Understanding the Raft Consensus Algorithm: Roles, Elections, Log Replication, and Split‑Brain Scenarios

This article explains the Raft consensus algorithm in detail, covering its three node roles, leader election process, state‑machine log replication, handling of leader failures, multiple candidates, and split‑brain situations, providing clear diagrams and step‑by‑step descriptions for distributed system fundamentals.

Consensus AlgorithmLeader ElectionLog Replication
0 likes · 16 min read
Understanding the Raft Consensus Algorithm: Roles, Elections, Log Replication, and Split‑Brain Scenarios
Meituan Technology Team
Meituan Technology Team
Aug 25, 2022 · Databases

Transactions, Consistency, and Consensus in Distributed Systems

This article explains how transactions, consistency, and consensus interrelate in distributed systems, reviews replication models, details ACID properties, internal consistency models, consensus algorithms, and Kafka’s configuration and transaction support, and highlights verification tools like TLA+ and Jepsen for ensuring correctness.

ACIDConsensusConsistency
0 likes · 46 min read
Transactions, Consistency, and Consensus in Distributed Systems
Meituan Technology Team
Meituan Technology Team
Aug 25, 2022 · Databases

Data Replication in Distributed Systems – Part 1: Models, Challenges, and Design Considerations

The article surveys three data‑replication models—master‑slave, multi‑master, and leaderless—explains how they enable scalability and fault‑tolerance, and examines core distributed‑system challenges such as partial node failures, unreliable networks, and unsynchronized clocks, while stressing safety‑liveness trade‑offs and design techniques like quorum and timeouts.

ConsistencyKafkadata replication
0 likes · 37 min read
Data Replication in Distributed Systems – Part 1: Models, Challenges, and Design Considerations
Selected Java Interview Questions
Selected Java Interview Questions
Aug 24, 2022 · Backend Development

Understanding ElasticSearch: Distributed Search, Full‑Text Retrieval, and Inverted Index

This article explains what search is, why traditional databases struggle with full‑text queries, introduces the concepts of inverted indexes and Lucene, and shows how ElasticSearch combines distributed architecture, real‑time analytics, and powerful search features to solve these problems.

distributed systemsfull-text searchinverted index
0 likes · 8 min read
Understanding ElasticSearch: Distributed Search, Full‑Text Retrieval, and Inverted Index
21CTO
21CTO
Aug 23, 2022 · Cloud Native

How RocketMQ Evolved into a Cloud‑Native Super‑Fusion Messaging Platform

This article traces RocketMQ's transformation from a traditional message queue to a cloud‑native, ultra‑fusion platform that integrates messaging, event‑driven architecture, and streaming, highlighting its historical stages, architectural upgrades, multi‑language SDKs, stateless consumption, and future cloud‑native trends.

Message QueueRocketMQcloud native
0 likes · 22 min read
How RocketMQ Evolved into a Cloud‑Native Super‑Fusion Messaging Platform
IT Architects Alliance
IT Architects Alliance
Aug 21, 2022 · Backend Development

How to Build a Scalable Delayed Queue with Redis and Java

This article explains why delayed queues are needed for scenarios like unpaid orders or auto‑generated comments, compares built‑in and third‑party solutions, and provides a detailed design and implementation guide for a Redis‑based delayed‑queue service, including version‑1.0 features, version‑2.0 optimizations, and multi‑node deployment.

JavaMessage QueueRabbitMQ
0 likes · 9 min read
How to Build a Scalable Delayed Queue with Redis and Java
Tencent Cloud Developer
Tencent Cloud Developer
Aug 19, 2022 · Backend Development

Message Queue Basics, Use Cases, and Selection Guide for Kafka, RabbitMQ, Pulsar, and RocketMQ

The article explains fundamental concepts, common use cases, and selection criteria for four popular message‑queue platforms—Kafka, RabbitMQ, Pulsar, and RocketMQ—detailing each system’s architecture, strengths, and drawbacks so readers can match workload, scalability, ordering, latency, and operational needs to the most suitable middleware.

KafkaMessage QueuePulsar
0 likes · 16 min read
Message Queue Basics, Use Cases, and Selection Guide for Kafka, RabbitMQ, Pulsar, and RocketMQ
IT Architects Alliance
IT Architects Alliance
Aug 19, 2022 · Backend Development

Comprehensive Guide to Microservices Architecture, Spring Cloud, Dubbo, and Distributed System Practices

This article provides an in‑depth overview of microservice concepts, RPC frameworks, serialization methods, distributed transaction models, CAP and BASE theories, monitoring solutions, high‑availability strategies, load‑balancing techniques, configuration management, service registration/discovery, and Dubbo fault‑tolerance clusters, offering practical examples and code snippets for Java‑based cloud native systems.

DubboRPCSpring Cloud
0 likes · 37 min read
Comprehensive Guide to Microservices Architecture, Spring Cloud, Dubbo, and Distributed System Practices
21CTO
21CTO
Aug 18, 2022 · Cloud Native

Why Go (Golang) Is the Go‑To Language for Cloud‑Native Development

This article explores Go's concise design, strong concurrency model, fast compilation, static binaries, and broad ecosystem, highlighting its ideal fit for cloud‑native applications, distributed services, and command‑line tools while also addressing its limitations and future direction.

GoStatic Binariescloud native
0 likes · 12 min read
Why Go (Golang) Is the Go‑To Language for Cloud‑Native Development
dbaplus Community
dbaplus Community
Aug 17, 2022 · Databases

How RedKV Achieves Billion‑QPS KV Storage with Multi‑Cloud Elastic Scaling

RedKV is Xiaohongshu's self‑developed NVMe‑SSD based distributed NoSQL KV store that combines Gossip and Shard control, delivering petabyte‑scale storage, near‑100 million QPS, multi‑cloud elasticity, low‑cost Redis compatibility, and advanced features such as token‑bucket rate limiting, online compression, backup‑read tail‑latency mitigation, and robust backup‑recovery mechanisms.

KV storeMulti-CloudNoSQL
0 likes · 24 min read
How RedKV Achieves Billion‑QPS KV Storage with Multi‑Cloud Elastic Scaling
Selected Java Interview Questions
Selected Java Interview Questions
Aug 17, 2022 · Backend Development

Microservice Architecture and Its Most Important Design Patterns

This article explains the evolution of software complexity, introduces microservice architecture as a modern solution, and details ten essential design patterns—including database per service, event sourcing, CQRS, Saga, BFF, API gateway, Strangler, circuit breaker, externalized configuration, and consumer‑driven contract testing—while outlining their advantages, disadvantages, and appropriate usage scenarios.

Backendarchitecturedistributed systems
0 likes · 22 min read
Microservice Architecture and Its Most Important Design Patterns
DaTaobao Tech
DaTaobao Tech
Aug 15, 2022 · Cloud Native

Reflections on CAP Theory, ACID, BASE, and Cloud‑Native Fault Tolerance

Reflecting on reading, the author reviews CAP theory’s consistency‑availability‑partition trade‑offs, extends ACID and BASE concepts, proposes modernizing CAP objects to consistency, fault and disaster tolerance, and examines how cloud‑native architectures, micro‑services, and SLA‑driven designs reshape fault tolerance and future self‑healing systems.

ACIDBASECAP theorem
0 likes · 21 min read
Reflections on CAP Theory, ACID, BASE, and Cloud‑Native Fault Tolerance
Top Architect
Top Architect
Aug 12, 2022 · Operations

Key Distributed System Design Patterns Explained by a Senior Architect

This article presents a concise overview of essential distributed‑system design patterns—including Bloom filters, consistent hashing, quorum, leader/follower, heartbeat, fencing, high‑water mark, leases, gossip protocol, PACELC theorem, hinted handoff, read‑repair, and Merkle trees—explaining their purpose, operation, and typical usage in large‑scale storage and coordination services.

Consistencyarchitecturedistributed systems
0 likes · 15 min read
Key Distributed System Design Patterns Explained by a Senior Architect
IT Architects Alliance
IT Architects Alliance
Aug 11, 2022 · Fundamentals

Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More

This article introduces essential distributed‑system mechanisms—including Bloom filters, consistent hashing, quorum, leader/follower roles, heartbeats, fencing, write‑ahead logs, segment logs, high‑water marks, leases, gossip protocols, failure detection, CAP/PACELC theorems, hinted handoff, read‑repair, and Merkle trees—to help engineers design scalable and fault‑tolerant services.

CAP theoremConsistencyData Structures
0 likes · 12 min read
Key Distributed System Concepts: Bloom Filter, Consistent Hashing, Quorum, Leader/Follower, and More
Ctrip Technology
Ctrip Technology
Aug 11, 2022 · Databases

Design and Implementation of Ctrip's Data Replicate Center (DRC) for Database Cloud Migration

This article details Ctrip's Data Replicate Center (DRC) architecture, challenges, and solutions for migrating MySQL databases to the cloud, covering read‑only and read‑write scenarios, cost analysis, proxy modules, transaction‑table replication, data isolation, filtering, deployment workflow, and achieved performance and cost benefits.

CtripDRCDatabase Replication
0 likes · 16 min read
Design and Implementation of Ctrip's Data Replicate Center (DRC) for Database Cloud Migration
DataFunTalk
DataFunTalk
Aug 9, 2022 · Databases

Graph Database Storage Technologies and Practices: Concepts, Core Goals, Technical Solutions, and Galaxybase Case Study

This article introduces graph database fundamentals, explains why graph databases are needed, outlines core storage goals such as index‑free adjacency, compares array, linked‑list and LSM‑tree storage schemes, and presents the design, performance advantages, and real‑world applications of the Galaxybase distributed graph database.

Galaxybasebig datadistributed systems
0 likes · 20 min read
Graph Database Storage Technologies and Practices: Concepts, Core Goals, Technical Solutions, and Galaxybase Case Study
Selected Java Interview Questions
Selected Java Interview Questions
Aug 5, 2022 · Backend Development

Understanding Interface Call Idempotency and Practical Solutions for Backend Systems

The article explains the concept of interface call idempotency in distributed micro‑service architectures, outlines scenarios that cause idempotency problems, and presents practical solutions such as token mechanisms, various lock strategies, unique constraints, deduplication tables, and global request IDs, with code examples in Java and Redis.

BackendJavaLocks
0 likes · 13 min read
Understanding Interface Call Idempotency and Practical Solutions for Backend Systems
Sohu Tech Products
Sohu Tech Products
Aug 3, 2022 · Fundamentals

Common Message Queues: RabbitMQ, RocketMQ, and Kafka – Components, Features, and Best Practices

This article introduces the core concepts, components, exchange types, reliability mechanisms, ordering, delay, transaction, high‑availability, and load‑balancing strategies of three popular message‑queue systems—RabbitMQ, RocketMQ, and Kafka—while also discussing common challenges such as message ordering, delayed consumption, reliability, idempotence, and backlog handling.

KafkaMessage QueueRabbitMQ
0 likes · 33 min read
Common Message Queues: RabbitMQ, RocketMQ, and Kafka – Components, Features, and Best Practices
政采云技术
政采云技术
Aug 2, 2022 · Fundamentals

Understanding the Chandy‑Lamport Distributed Snapshot Algorithm

This article explains the Chandy‑Lamport algorithm for capturing consistent global snapshots in distributed systems, describes its assumptions and message‑marker rules, walks through a detailed example with three processes and channels, and relates it to Apache Flink's asynchronous checkpoint mechanism.

Apache FlinkChandy-Lamportdistributed systems
0 likes · 14 min read
Understanding the Chandy‑Lamport Distributed Snapshot Algorithm
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Aug 2, 2022 · Backend Development

How Nacos’s Distro Protocol Ensures High‑Availability Consistency

This article explains the design, six mechanisms, and source‑code flow of Nacos’s Distro protocol, showing how asynchronous replication, periodic sync, new‑node loading, and local reads together provide AP‑style high availability and eventual consistency for service registration.

APConsistencyDistro
0 likes · 15 min read
How Nacos’s Distro Protocol Ensures High‑Availability Consistency
MaGe Linux Operations
MaGe Linux Operations
Jul 31, 2022 · Backend Development

Mastering Message Queues: Key Concepts of RabbitMQ, RocketMQ, and Kafka

This article provides a comprehensive overview of modern message‑queue systems, detailing RabbitMQ components and exchange types, RocketMQ’s core architecture and high‑availability features, and Kafka’s fundamental concepts, controller mechanisms, and consumer rebalance strategies, while also covering reliability, ordering, and dead‑letter handling techniques.

KafkaMessage QueueRabbitMQ
0 likes · 31 min read
Mastering Message Queues: Key Concepts of RabbitMQ, RocketMQ, and Kafka
DataFunTalk
DataFunTalk
Jul 31, 2022 · Big Data

Design, Evolution, and Optimization of NetEase's Log Collection and Transmission Service (Datastream‑NG)

This article presents a comprehensive overview of NetEase's log collection and transmission platform, detailing its evolution from 2011 to the current Datastream‑NG architecture, the system's design goals, core component optimizations, operational monitoring, and future plans for intelligent scaling and diagnostics.

Data StreamingLog Collectionbig data
0 likes · 23 min read
Design, Evolution, and Optimization of NetEase's Log Collection and Transmission Service (Datastream‑NG)
Su San Talks Tech
Su San Talks Tech
Jul 31, 2022 · Fundamentals

Mastering Message Queues: Core Concepts of RabbitMQ, RocketMQ, and Kafka

This article explains the fundamental components and mechanisms of RabbitMQ, RocketMQ, and Kafka—including exchanges, TTL, confirm and return listeners, consumer ACK/NACK, dead‑letter queues, delay and ordered messages, transactional flows, high‑availability setups, load balancing, partitioning, leader election, offset handling, and practical solutions to common messaging challenges.

KafkaMessage QueueRabbitMQ
0 likes · 31 min read
Mastering Message Queues: Core Concepts of RabbitMQ, RocketMQ, and Kafka
Top Architect
Top Architect
Jul 31, 2022 · Backend Development

Design and Implementation of Delayed Message Queues in Distributed Systems

This article surveys common delayed‑message solutions in distributed asynchronous messaging, evaluates implementations based on external storage, databases, RocksDB, Redis, and open‑source MQs like RocketMQ, Pulsar and QMQ, and discusses their advantages, drawbacks, and practical design considerations.

Delayed MessagingPulsarRedis
0 likes · 13 min read
Design and Implementation of Delayed Message Queues in Distributed Systems
Top Architect
Top Architect
Jul 30, 2022 · Backend Development

Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Components, and Best Practices

This article provides an in‑depth technical guide to three major message‑queue systems—RabbitMQ, RocketMQ, and Kafka—covering their core components, exchange and routing mechanisms, durability features, consumer acknowledgment, dead‑letter handling, load balancing, and practical strategies for reliability, ordering, and scaling in distributed backend applications.

RabbitMQRocketMQdistributed systems
0 likes · 29 min read
Comprehensive Overview of RabbitMQ, RocketMQ, and Kafka: Architecture, Components, and Best Practices
vivo Internet Technology
vivo Internet Technology
Jul 27, 2022 · Operations

Building and Migrating to RocketMQ-based Message Middleware Platform at vivo

vivo’s Internet Middleware Team replaced its RabbitMQ service with a RocketMQ‑based platform, building an AMQP‑Proxy gateway and metadata layer to enable seamless, zero‑downtime migration while achieving over 100,000 TPS, billion‑message capacity, 50% resource savings, and advanced features such as transactions, ordered and delayed messaging, and tracing.

Message MiddlewareRabbitMQ MigrationRocketMQ
0 likes · 12 min read
Building and Migrating to RocketMQ-based Message Middleware Platform at vivo
Top Architect
Top Architect
Jul 27, 2022 · Cloud Native

A Comprehensive Guide to Microservice Architecture and Its Technology Stack

This article provides an extensive overview of microservice architecture, tracing its evolution from monolithic to distributed services, detailing the advantages and drawbacks of each stage, and presenting a practical technology stack—including service discovery, API gateways, containerization, orchestration, logging, monitoring, and CI/CD—to help engineers design, implement, and operate modern cloud‑native systems.

CI/CDDockerKubernetes
0 likes · 20 min read
A Comprehensive Guide to Microservice Architecture and Its Technology Stack
dbaplus Community
dbaplus Community
Jul 26, 2022 · Backend Development

Unlocking Elasticsearch: Core Concepts, Architecture, and Performance Tips

This comprehensive guide explains Elasticsearch’s role in searching structured and unstructured data, covers Lucene’s inverted index, details cluster components, shard and replica mechanics, mapping types, installation steps, indexing workflow, storage strategies, and practical performance optimizations for real‑world deployments.

ElasticSearchdistributed systemsindexing
0 likes · 39 min read
Unlocking Elasticsearch: Core Concepts, Architecture, and Performance Tips
Programmer DD
Programmer DD
Jul 26, 2022 · Operations

Mastering Service Governance: From Distributed Systems to Reliable RPC Frameworks

This article explains the fundamentals of service governance in distributed systems, covering RPC communication, common anomalies, replica types, design principles, performance metrics, and the architecture and workflow of RPC frameworks, while also detailing key practices such as registration, discovery, load balancing, traffic shaping, version compatibility, circuit breaking, degradation, and rate limiting.

RPCdistributed systemsload balancing
0 likes · 15 min read
Mastering Service Governance: From Distributed Systems to Reliable RPC Frameworks
Selected Java Interview Questions
Selected Java Interview Questions
Jul 25, 2022 · Backend Development

Four Approaches to Solving Session Management in Distributed Environments

This article examines four strategies for handling session data in distributed backend systems—session replication, client-side storage, hash-based load balancing, and centralized storage with Redis—detailing their principles, advantages, disadvantages, and practical recommendations for different deployment scales.

BackendRedisSession
0 likes · 9 min read
Four Approaches to Solving Session Management in Distributed Environments
Top Architect
Top Architect
Jul 25, 2022 · Backend Development

Monolithic vs Microservice Architecture: Pros, Cons, Service Gateway, Registration, and Configuration Center

This article explains the differences between monolithic and microservice architectures, outlines their advantages and disadvantages, and then dives into essential components such as service gateways, service registration and discovery, and distributed configuration centers, providing practical guidance for building scalable backend systems.

Configuration Centerbackend architecturedistributed systems
0 likes · 26 min read
Monolithic vs Microservice Architecture: Pros, Cons, Service Gateway, Registration, and Configuration Center
FunTester
FunTester
Jul 24, 2022 · Operations

Boost Service Reliability with Chaos Engineering: Practical Steps & Evaluation

Chaos engineering, a discipline for experimenting on distributed systems, helps teams identify hidden weaknesses, improve high‑availability, and build confidence in production by defining stable states, injecting realistic failures, and measuring impact through observability metrics, with practical steps, tool choices, maturity stages, and evaluation methods.

chaos engineeringdistributed systemsfault injection
0 likes · 11 min read
Boost Service Reliability with Chaos Engineering: Practical Steps & Evaluation
Top Architect
Top Architect
Jul 23, 2022 · Cloud Native

Comprehensive Guide to etcd: Overview, Architecture, Deployment, and Usage

This article provides a detailed introduction to etcd, covering its purpose as a highly available distributed key‑value store, core concepts like Raft consensus, key features, common use cases such as service discovery and configuration management, step‑by‑step installation for single‑node and cluster deployments, and essential etcdctl commands for managing data and cluster members.

cloud nativeconfiguration managementdistributed systems
0 likes · 24 min read
Comprehensive Guide to etcd: Overview, Architecture, Deployment, and Usage
IT Architects Alliance
IT Architects Alliance
Jul 21, 2022 · Big Data

Explanation of Kafka Components and Architecture

This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, log structures, replication mechanisms, and the system’s architecture, supplemented with practical visual illustrative diagrams.

Partitioningdistributed systemsmessaging
0 likes · 8 min read
Explanation of Kafka Components and Architecture
Meituan Technology Team
Meituan Technology Team
Jul 21, 2022 · Backend Development

Visualized Full‑Chain Log Tracing for Complex Business Systems

The article analyzes the shortcomings of traditional ELK and distributed tracing for complex business systems, proposes a visualized full‑chain log tracing solution that organizes and dynamically links logs by business chain, and demonstrates its implementation and performance gains at Meituan’s content platform.

BackendDSLMeituan
0 likes · 26 min read
Visualized Full‑Chain Log Tracing for Complex Business Systems
FunTester
FunTester
Jul 21, 2022 · Databases

Scaling Databases with Distributed Sharding and Peak‑Shaving Strategies

The article explains why simply adding hardware cannot keep up with growing database workloads and presents a three‑step approach—business isolation, horizontal sharding, and advanced reporting using PolarDB‑X—to achieve high concurrency, elastic capacity, and efficient caching for modern high‑traffic applications.

CachingDatabase ScalingPeak Shaving
0 likes · 7 min read
Scaling Databases with Distributed Sharding and Peak‑Shaving Strategies
Architecture Digest
Architecture Digest
Jul 21, 2022 · Backend Development

Implementing a Reliable Redis‑Based Delay Queue in Go

This article explains how to design and implement a precise, persistent, and retry‑capable delay queue using Redis ordered sets and Lua scripts, provides a complete Go library with usage examples, and discusses the underlying data structures, atomic operations, and garbage‑collection mechanisms.

GoMessage QueueRedis
0 likes · 11 min read
Implementing a Reliable Redis‑Based Delay Queue in Go
Java High-Performance Architecture
Java High-Performance Architecture
Jul 20, 2022 · Backend Development

Mastering Load Balancing: From Round Robin to Consistent Hashing in Java

This article explains common load‑balancing strategies—including round‑robin, random, weighted, smooth weighted round‑robin, consistent hashing, least‑active, and fastest‑response algorithms—provides Java implementations with code samples, discusses their advantages, disadvantages, and suitable scenarios, and offers practical guidance for choosing the right method in distributed systems.

Javaconsistent hashingdistributed systems
0 likes · 35 min read
Mastering Load Balancing: From Round Robin to Consistent Hashing in Java
Laravel Tech Community
Laravel Tech Community
Jul 19, 2022 · Backend Development

The Evolution and Architecture of China’s 12306 Railway Ticketing System

This article examines the historical development, distributed architecture, and high‑concurrency challenges of China’s 12306 railway ticketing platform, tracing its origins from early Unix‑based systems to modern multi‑layered backend solutions that support hundreds of millions of users during peak travel periods.

High ConcurrencyRailwaybackend architecture
0 likes · 8 min read
The Evolution and Architecture of China’s 12306 Railway Ticketing System
Baidu Geek Talk
Baidu Geek Talk
Jul 19, 2022 · Cloud Native

How OpenTelemetry and Jaeger Power Cloud‑Native Tracing

This article explains cloud‑native observability, defines its three pillars—metrics, tracing, and logging—details the OpenTelemetry tracing data model and Span structure, reviews industry implementations such as Jaeger and Alibaba Eagle Eye, and shares practical challenges and solutions from real‑world production use.

Alibaba Eagle EyeJaegerOpenTelemetry
0 likes · 11 min read
How OpenTelemetry and Jaeger Power Cloud‑Native Tracing
Architect's Guide
Architect's Guide
Jul 19, 2022 · Backend Development

Design and Implementation of a Custom Java RPC Framework

This article presents a comprehensive overview of a hand‑crafted RPC framework built with Spring Boot, Netty, and Zookeeper, covering its core concepts, architecture, custom message protocol, load‑balancing strategies, serialization choices, starter design, deployment steps, and testing procedures.

JavaNettyRPC
0 likes · 15 min read
Design and Implementation of a Custom Java RPC Framework
IT Architects Alliance
IT Architects Alliance
Jul 18, 2022 · Backend Development

Cache Design and Optimization Strategies in High‑Concurrency Distributed Systems

The article explains the benefits, costs, and various update, penetration, no‑hole, avalanche, and hot‑key optimization techniques for caching in high‑concurrency distributed systems, providing practical guidance on choosing appropriate strategies based on consistency requirements and system load.

Cache EvictionCache PenetrationCaching
0 likes · 16 min read
Cache Design and Optimization Strategies in High‑Concurrency Distributed Systems
Top Architect
Top Architect
Jul 18, 2022 · Backend Development

Common Load Balancing Algorithms and Their Java Implementations

This article explains the principles behind popular load‑balancing strategies such as round‑robin, weighted round‑robin, smooth weighted round‑robin, consistent hashing, least‑active, and best‑response, and provides clear Java code examples for each method.

AlgorithmsBackenddistributed systems
0 likes · 34 min read
Common Load Balancing Algorithms and Their Java Implementations
Java High-Performance Architecture
Java High-Performance Architecture
Jul 15, 2022 · Backend Development

How Meituan Built a High‑Performance Distributed Architecture for Instant Logistics

This article explains how Meituan's instant logistics platform evolved from a monolithic system to a highly available, scalable, and AI‑enhanced distributed architecture, detailing the technical challenges, architectural upgrades, fault‑tolerance strategies, and future scalability concerns.

AI integrationHigh Concurrencybackend architecture
0 likes · 10 min read
How Meituan Built a High‑Performance Distributed Architecture for Instant Logistics
Top Architect
Top Architect
Jul 15, 2022 · Backend Development

Design and Evolution of Meituan's Real-Time Logistics Distributed System

This article details Meituan's instant logistics platform architecture, covering its background, distributed system design, high‑availability deployment, AI‑driven optimization, and future challenges, while sharing practical solutions for scalability, fault tolerance, and operational efficiency in a high‑concurrency environment.

Meituandistributed systemshigh availability
0 likes · 9 min read
Design and Evolution of Meituan's Real-Time Logistics Distributed System
IT Architects Alliance
IT Architects Alliance
Jul 14, 2022 · Operations

Common Load Balancing Algorithms and Their Java Implementations

This article reviews common load balancing strategies—including round-robin, random, weighted, smooth weighted round-robin, consistent hashing, least-active and optimal-response algorithms—explains their advantages and drawbacks, and provides complete Java code examples for each method.

AlgorithmsJavaconsistent hashing
0 likes · 33 min read
Common Load Balancing Algorithms and Their Java Implementations
Architecture & Thinking
Architecture & Thinking
Jul 14, 2022 · Fundamentals

Understanding Message Queues: Execution Principles and Choosing the Right MQ

This article explains the fundamentals of message middleware, covering its architecture, components, communication models, advantages, common protocols, major open‑source solutions, detailed feature comparisons, and practical guidance for selecting the most suitable message queue based on system scale, business needs, performance, high availability, and operational considerations.

KafkaMQMessage Queue
0 likes · 21 min read
Understanding Message Queues: Execution Principles and Choosing the Right MQ
Architect
Architect
Jul 12, 2022 · Backend Development

Load Balancing Algorithms: Round Robin, Random, Weighted, Smooth Weighted, Consistent Hashing, Least Active and Optimal Response

This article explains common load‑balancing strategies—including basic round‑robin, random, weighted and smooth weighted algorithms, as well as consistent hashing, least‑active and optimal‑response methods—provides Java implementations for each, discusses their advantages, disadvantages, and suitable scenarios, and concludes with practical recommendations.

Algorithmsconsistent hashingdistributed systems
0 likes · 34 min read
Load Balancing Algorithms: Round Robin, Random, Weighted, Smooth Weighted, Consistent Hashing, Least Active and Optimal Response
Top Architect
Top Architect
Jul 12, 2022 · Backend Development

Understanding Interface Idempotency and Distributed Rate Limiting with Token Bucket, Leaky Bucket, Guava RateLimiter, Nginx, and Redis+Lua

This article explains the concept of interface idempotency, demonstrates how to achieve idempotent update operations using version control and token mechanisms, and provides a comprehensive guide to distributed rate limiting—including time‑window and resource‑based dimensions, token‑bucket and leaky‑bucket algorithms, and practical implementations with Guava RateLimiter, Nginx, and Redis‑Lua scripts.

BackendIdempotencydistributed systems
0 likes · 21 min read
Understanding Interface Idempotency and Distributed Rate Limiting with Token Bucket, Leaky Bucket, Guava RateLimiter, Nginx, and Redis+Lua
vivo Internet Technology
vivo Internet Technology
Jul 6, 2022 · Backend Development

RocketMQ Consumer Startup Process and Message Consumption Mechanisms

RocketMQ consumers initialize by validating configuration, creating subscription data, establishing a client instance, loading offsets, and starting services before registering with the client factory, after which they can receive messages via push (default low‑latency) or pull modes, support ordered processing, and handle acknowledgments with configurable retries and dead‑letter handling.

ConsumerJavaOrdered Messaging
0 likes · 24 min read
RocketMQ Consumer Startup Process and Message Consumption Mechanisms
Top Architect
Top Architect
Jul 4, 2022 · Backend Development

High‑Concurrency Architecture Design and Practical Solutions

This article explains how to design and implement a high‑concurrency system for e‑commerce scenarios, covering server architecture, load balancing, database clustering, caching strategies, concurrency testing tools, message‑queue based async processing, first‑level cache, static data handling, layering, distribution, redundancy and automation, with concrete examples such as user sign‑in, order queries and red‑packet distribution.

CachingHigh Concurrencybackend architecture
0 likes · 20 min read
High‑Concurrency Architecture Design and Practical Solutions
Cognitive Technology Team
Cognitive Technology Team
Jul 3, 2022 · Backend Development

Network Timeouts Do Not Imply Server Failure: Effective Retry, Backoff, and Idempotency Strategies

Network timeouts do not necessarily indicate server‑side failure; handling them with appropriate retry strategies, exponential backoff, and idempotent APIs—combined with mechanisms such as distributed locks and atomic transactions—helps maintain system stability while avoiding duplicate operations and resource exhaustion.

BackendIdempotencyRetry
0 likes · 7 min read
Network Timeouts Do Not Imply Server Failure: Effective Retry, Backoff, and Idempotency Strategies
Bilibili Tech
Bilibili Tech
Jun 24, 2022 · Cloud Native

Evolution and Design of Bilibili's Load‑Testing Platform (Platform 2.0)

Bilibili’s load‑testing platform evolved from ad‑hoc JMeter scripts to a fully automated, self‑service system (Platform 2.0) that uses a custom load client, adaptive scheduling, and flexible scenario modes—including traffic replay and data‑isolated testing—to efficiently stress‑test over a hundred microservices for large‑scale events, with further integration and circuit‑breaker enhancements planned.

Load Testingcloud-nativedistributed systems
0 likes · 27 min read
Evolution and Design of Bilibili's Load‑Testing Platform (Platform 2.0)
High Availability Architecture
High Availability Architecture
Jun 24, 2022 · Backend Development

Improving Cache Invalidation and Consistency at Scale

Meta engineers describe the challenges of cache invalidation and consistency in large‑scale distributed systems, explain why stale caches are problematic, present their Polaris observability service and consistency‑tracking techniques, and detail how they raised TAO’s cache consistency from six‑nines to ten‑nines.

Cache invalidationCachingConsistency
0 likes · 17 min read
Improving Cache Invalidation and Consistency at Scale
macrozheng
macrozheng
Jun 24, 2022 · Backend Development

Choosing the Right Distributed ID Generator: UUID, Snowflake, NanoID

This article examines the trade‑offs of common distributed ID generators—UUID, timestamp‑based schemes, Snowflake, and NanoID—highlighting their size, ordering, performance, and security implications to help developers select the most suitable approach for their systems.

SnowflakeUUIDdistributed systems
0 likes · 6 min read
Choosing the Right Distributed ID Generator: UUID, Snowflake, NanoID
DataFunTalk
DataFunTalk
Jun 23, 2022 · Big Data

Real‑Time Low‑Latency Log Monitoring and Storage at Ctrip: Architecture, Clog System, CAT Tracing, and TSDB

This article details Ctrip's large‑scale, real‑time log monitoring solution, covering the overall monitoring architecture, the Clog log system, the CAT tracing platform, and the TSDB metric store, and explains design choices such as write‑heavy indexing, segment‑based storage, and migration to ClickHouse for high‑cardinality data.

Log MonitoringTraceabilitydistributed systems
0 likes · 11 min read
Real‑Time Low‑Latency Log Monitoring and Storage at Ctrip: Architecture, Clog System, CAT Tracing, and TSDB
NetEase Smart Enterprise Tech+
NetEase Smart Enterprise Tech+
Jun 23, 2022 · Backend Development

Mastering Rate Limiting: Choosing the Right Algorithm for High‑Availability Systems

This article explores the importance of rate limiting in distributed micro‑service architectures, explains four core algorithms—fixed window, sliding window, leaky bucket, and token bucket—and details a practical, Redis‑backed multi‑layer throttling solution for a voice‑bot platform, including trade‑offs and implementation tips.

Redisdistributed systemsmicroservices
0 likes · 15 min read
Mastering Rate Limiting: Choosing the Right Algorithm for High‑Availability Systems
Wukong Talks Architecture
Wukong Talks Architecture
Jun 20, 2022 · Backend Development

Understanding the Eureka Service Heartbeat Mechanism in Microservices

This article explains how Eureka’s heartbeat mechanism works in microservice architectures, covering who sends the heartbeat, the scheduling interval, the request implementation, server-side handling, and the effect on service registration, using code examples and analogies to historical tribute systems.

EurekaJavadistributed systems
0 likes · 6 min read
Understanding the Eureka Service Heartbeat Mechanism in Microservices
转转QA
转转QA
Jun 20, 2022 · Operations

Issue 4: Technical Articles on Full‑Chain Stress Testing, Distributed Web UI Automation, WWDC22 Sessions, Efficient Automated Testing, and AutoDiff Traffic Replay

This issue curates five technical articles covering Gaode's full‑chain stress testing platform, a distributed web UI automation system, a comprehensive WWDC22 session review, ShouQianBa's efficient automated testing practices, and Autohome's AutoDiff traffic replay for integrated testing.

Mobile Developmentdistributed systemsperformance
0 likes · 4 min read
Issue 4: Technical Articles on Full‑Chain Stress Testing, Distributed Web UI Automation, WWDC22 Sessions, Efficient Automated Testing, and AutoDiff Traffic Replay
ITPUB
ITPUB
Jun 19, 2022 · Backend Development

Mastering Cache Design: Solving the 7 Classic Pitfalls in High‑Traffic Systems

This article explores common cache challenges such as centralized expiration, cache penetration, avalanche, hot keys, large keys, data consistency, and concurrent pre‑warming, offering practical design patterns and mitigation strategies to build robust, high‑performance backend systems.

BackendCachingcache design
0 likes · 10 min read
Mastering Cache Design: Solving the 7 Classic Pitfalls in High‑Traffic Systems
Qunar Tech Salon
Qunar Tech Salon
Jun 16, 2022 · Operations

Practical Chaos Engineering Practices at Qunar Travel: Architecture, Scenarios, and Automation

This article details Qunar Travel's mature chaos engineering platform built on chaosblade, covering value analysis, system architecture, shutdown and dependency drills, automated closed‑loop testing, attack‑defense exercises, and the measurable reliability improvements achieved across thousands of services.

chaos engineeringdistributed systemsfault injection
0 likes · 18 min read
Practical Chaos Engineering Practices at Qunar Travel: Architecture, Scenarios, and Automation
Java High-Performance Architecture
Java High-Performance Architecture
Jun 11, 2022 · Backend Development

Essential Microservice Architecture Patterns Every Backend Engineer Should Know

This article explores the core goals of microservice architecture, outlines key design principles such as scalability and resilience, and presents a comprehensive catalog of decomposition, integration, cross‑cutting concern, and observability patterns—including API gateway, Strangler, Bulkhead, Saga, and CQRS—to guide developers in building robust, maintainable backend systems.

Backendarchitecturedistributed systems
0 likes · 24 min read
Essential Microservice Architecture Patterns Every Backend Engineer Should Know
MaGe Linux Operations
MaGe Linux Operations
Jun 10, 2022 · Fundamentals

Demystifying Paxos: How Distributed Systems Achieve Consensus

This article explains the Paxos consensus algorithm—its origins, core concepts, roles of proposers, acceptors and learners, safety and liveness constraints, the two-phase protocol, proposal generation, and practical variations—showing why Paxos remains a foundational solution for fault‑tolerant distributed systems.

Consensus AlgorithmDistributed ConsensusPaxos
0 likes · 16 min read
Demystifying Paxos: How Distributed Systems Achieve Consensus
ITPUB
ITPUB
Jun 10, 2022 · Operations

How Zookeeper Prevents Split‑Brain Failures in Distributed Clusters

This article explains the split‑brain phenomenon in distributed systems, illustrates how it can occur in Zookeeper clusters, and details Zookeeper's quorum‑based solutions—including majority voting, odd‑node deployment, and additional safeguards—to avoid split‑brain and ensure reliable leader election.

Leader Electiondistributed systemsquorum
0 likes · 11 min read
How Zookeeper Prevents Split‑Brain Failures in Distributed Clusters
Laiye Technology Team
Laiye Technology Team
Jun 10, 2022 · Backend Development

Understanding System Failures and Principles for Resilient Architecture

The article analyzes why modern software systems repeatedly collapse—due to growing business complexity, unpredictable changes, and architectural decay—and proposes principles such as decentralization, integration, and diversity, along with practical strategies like service mesh and eBPF, to design more sustainable, observable, and self‑evolving architectures.

ComplexityResiliencearchitecture
0 likes · 12 min read
Understanding System Failures and Principles for Resilient Architecture
Sohu Tech Products
Sohu Tech Products
Jun 8, 2022 · Databases

Cache Working Mechanisms and Consistency Solutions Using Redis

This article explores Redis cache mechanisms, various caching patterns such as Cache‑Aside, Read‑Through, Write‑Through and Write‑Behind, analyzes consistency challenges in write operations, and presents solutions like delayed double deletion, retry mechanisms, and binlog‑based asynchronous cache invalidation to achieve eventual consistency.

Cache AsideRediscache consistency
0 likes · 18 min read
Cache Working Mechanisms and Consistency Solutions Using Redis
Efficient Ops
Efficient Ops
Jun 7, 2022 · Big Data

Visualizing Kafka: Core Concepts Explained with Diagrams

This article visually breaks down Kafka’s fundamental concepts—including topics, partitions, producers, consumers, consumer groups, and cluster architecture—so readers can grasp how messages flow, are stored, and achieve load balancing and ordering within a distributed streaming platform.

KafkaMessage Queuebig-data
0 likes · 6 min read
Visualizing Kafka: Core Concepts Explained with Diagrams
DataFunSummit
DataFunSummit
Jun 3, 2022 · Big Data

Building and Optimizing JD Retail OLAP Platform: Architecture, Management, and Performance Techniques

This article details JD Retail's OLAP platform construction, covering control plane design, architecture, business and operation management, real‑time data updates, materialized view usage, join optimizations, high‑concurrency and high‑throughput scenarios, and promotional preparation strategies, illustrated with diagrams and performance metrics.

ClickHouseOLAPbig data
0 likes · 20 min read
Building and Optimizing JD Retail OLAP Platform: Architecture, Management, and Performance Techniques
Code Ape Tech Column
Code Ape Tech Column
May 27, 2022 · Backend Development

Comparison of Four Popular Open-Source Distributed Message Queues: Kafka, ActiveMQ, RabbitMQ, and RocketMQ

This article introduces and compares four widely used open-source distributed message-queue systems—Kafka, ActiveMQ, RabbitMQ, and RocketMQ—detailing their architectures, deployment requirements, features, high-availability solutions, advantages, disadvantages, and provides guidance for selecting the appropriate middleware in large-scale applications.

ActiveMQKafkaMessage Queue
0 likes · 38 min read
Comparison of Four Popular Open-Source Distributed Message Queues: Kafka, ActiveMQ, RabbitMQ, and RocketMQ
macrozheng
macrozheng
May 26, 2022 · Backend Development

How RocketMQ Uses Queues, Page Cache, and mmap to Achieve High Performance and Scalability

This article explains how RocketMQ tackles registration latency, synchronous coupling, and traffic spikes by introducing an intermediate queue, designing a persistent high‑availability broker, leveraging Linux page cache and memory‑mapped files, and employing topics, tags, and sharding to enable efficient asynchronous processing and scalable consumption.

High PerformanceMessage QueueRocketMQ
0 likes · 28 min read
How RocketMQ Uses Queues, Page Cache, and mmap to Achieve High Performance and Scalability
Sohu Tech Products
Sohu Tech Products
May 25, 2022 · Backend Development

Design Principles of RocketMQ: Broker Architecture, Persistence, High Performance and High Availability

The article explains how RocketMQ tackles growing business traffic by introducing an asynchronous broker layer, using commitlog and consumeQueue files, page‑cache, mmap, topic/tag routing, and a nameserver to achieve high‑throughput, low‑latency, and highly available message delivery.

High PerformanceMessage QueueRocketMQ
0 likes · 30 min read
Design Principles of RocketMQ: Broker Architecture, Persistence, High Performance and High Availability