BestHub
Sign in
Tagged articles

distributed systems

2274 articles · Page 15 of 23
Top Architect
Top Architect
Jan 8, 2021 · Backend Development

Microservice Architecture Communication Design Patterns

This article explains the challenges of cross‑service communication in microservice architectures and presents a comprehensive set of design patterns—including synchronous and asynchronous messaging, event‑driven approaches, saga, event sourcing, CQRS, outbox, CDC, idempotency, eventual consistency, distributed tracing, and service mesh—to help engineers build reliable, scalable distributed systems.

CQRSEvent SourcingSAGA
0 likes · 17 min read
Microservice Architecture Communication Design Patterns
High Availability Architecture
High Availability Architecture
Jan 8, 2021 · Backend Development

Why We Shifted Away from Database-Generated IDs to 64‑Bit Integer IDs

The article explains how decoupling persistence from a specific database engine and moving ID generation to the domain layer using 64‑bit integer identifiers—leveraging the Twitter Snowflake algorithm and the IdGen library—improves scalability, reduces coupling, and avoids the storage overhead of UUIDs.

64-bit integerbackend architecturedatabase decoupling
0 likes · 6 min read
Why We Shifted Away from Database-Generated IDs to 64‑Bit Integer IDs
Top Architect
Top Architect
Jan 7, 2021 · Backend Development

Microservice Architecture and Its 10 Most Important Design Patterns

This article explains microservice architecture, outlines its ten essential design patterns—including database per service, event sourcing, CQRS, saga, BFF, API gateway, strangler, circuit breaker, externalized configuration, and consumer‑driven contract testing—detailing their advantages, drawbacks, usage scenarios, and typical technology stacks.

distributed systemsmicroservices
0 likes · 28 min read
Microservice Architecture and Its 10 Most Important Design Patterns
DataFunTalk
DataFunTalk
Jan 6, 2021 · Big Data

Didi's Presto Engine: Architecture, Optimizations, and Operational Practices

This article presents Didi's three‑year experience with Presto, detailing its architecture, low‑latency design, large‑scale deployment, extensive Hive compatibility work, resource isolation, Druid connector integration, usability enhancements, stability engineering, performance tuning, and future directions for the ad‑hoc query engine.

Druid ConnectorSQL Enginebig data
0 likes · 17 min read
Didi's Presto Engine: Architecture, Optimizations, and Operational Practices
Efficient Ops
Efficient Ops
Jan 5, 2021 · Operations

How to Prevent ZooKeeper Split‑Brain: Best Practices and Fault‑Tolerance Strategies

This article explains why ZooKeeper clusters should use an odd number of nodes, how the majority quorum mechanism avoids split‑brain scenarios, and outlines practical solutions such as quorums, redundant communication, fencing, arbitration, and disk‑lock techniques to ensure reliable distributed coordination.

ZooKeeperdistributed systemsfault tolerance
0 likes · 14 min read
How to Prevent ZooKeeper Split‑Brain: Best Practices and Fault‑Tolerance Strategies
Laravel Tech Community
Laravel Tech Community
Jan 3, 2021 · Backend Development

Apache RocketMQ 4.8.0 Released with Major DLedger Performance Improvements

Apache RocketMQ 4.8.0 has been released, featuring extensive optimizations and bug fixes, with significant performance, functionality, and stability enhancements to the Raft‑based DLedger mode, including asynchronous pipeline processing, batch log replication, and various lock and cache improvements that boost throughput by multiple times.

DLedgerRocketMQdistributed systems
0 likes · 4 min read
Apache RocketMQ 4.8.0 Released with Major DLedger Performance Improvements
Java Architect Essentials
Java Architect Essentials
Jan 3, 2021 · Databases

Understanding Ant Financial’s LDC Architecture: Partitioning, CAP Analysis, and Multi‑Active Disaster Recovery

This article explains how Ant Financial’s logical data center (LDC) architecture uses unitization, database sharding, and CAP‑aware design—including RZone, GZone, and CZone—to achieve tens of millions of TPS during Double‑11, while providing multi‑active disaster recovery and high availability.

CAP theoremLDC architectureOceanBase
0 likes · 38 min read
Understanding Ant Financial’s LDC Architecture: Partitioning, CAP Analysis, and Multi‑Active Disaster Recovery
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jan 1, 2021 · Cloud Computing

Taobao’s Journey from LAMP to Cloud: Architecture Evolution & Migration Secrets

This article chronicles Taobao’s rapid growth from a simple LAMP stack in 2003 to a sophisticated, cloud‑native architecture, detailing each major redesign, the challenges faced, and the best‑practice migration strategies that enabled high availability, scalability, and performance on Alibaba Cloud.

Alibaba CloudCloud Computingarchitecture
0 likes · 10 min read
Taobao’s Journey from LAMP to Cloud: Architecture Evolution & Migration Secrets
Architects Research Society
Architects Research Society
Dec 30, 2020 · Fundamentals

Key Challenges in Designing Distributed Systems

Designing a distributed system involves overcoming major challenges such as heterogeneity, transparency, openness, concurrency, security, scalability, and fault tolerance, each requiring careful consideration of hardware, software, network, and management aspects to build robust, scalable, and secure architectures.

distributed systemsfault tolerancescalability
0 likes · 9 min read
Key Challenges in Designing Distributed Systems
ITPUB
ITPUB
Dec 29, 2020 · Databases

How BaikalDB’s Columnar Storage Boosted Real‑Time Analytics at DTCC2020

This article details how the DTCC2020 guest speaker from Tongcheng‑Elong introduced BaikalDB’s distributed columnar storage, covering internal and external motivations, technology comparison, architecture, implementation tricks, performance gains in production, and future hybrid row‑column research directions.

BaikalDBHTAPcolumnar storage
0 likes · 12 min read
How BaikalDB’s Columnar Storage Boosted Real‑Time Analytics at DTCC2020
MaGe Linux Operations
MaGe Linux Operations
Dec 28, 2020 · Backend Development

Mastering Elasticsearch: Core Concepts and Indexing Workflow Explained

This article introduces Elasticsearch’s core concepts—including clusters, node roles, documents, mappings, and shards—and walks through the complete indexing workflow from client request to replica synchronization, highlighting key settings, routing calculations, and the role of refresh and flush operations.

ClusterElasticSearchbackend development
0 likes · 13 min read
Mastering Elasticsearch: Core Concepts and Indexing Workflow Explained
Tencent Cloud Developer
Tencent Cloud Developer
Dec 24, 2020 · Big Data

Distributed Search Engine Design and Index Management in WeChat Search

The article details WeChat Search’s practical distributed architecture—using a Chubby‑elected leader for shard‑to‑node mapping, hash‑based sharding with dynamic rebalancing, a Lambda‑style batch and near‑real‑time indexing pipeline, relaxed monotonic consistency, and group‑based searcher scaling—to illustrate trade‑offs and lessons for building scalable, reliable search services.

LSMLambda Architecturedistributed systems
0 likes · 28 min read
Distributed Search Engine Design and Index Management in WeChat Search
vivo Internet Technology
vivo Internet Technology
Dec 23, 2020 · Backend Development

How Vivo Scaled Its Order System: Sharding, Migration, and Real‑World Lessons

This article details how Vivo transformed its monolithic e‑commerce order service into a scalable, service‑oriented system by applying data archiving, sharding‑JDBC based sharding, MySQL‑to‑Elasticsearch sync, zero‑downtime migration, and distributed‑transaction techniques, while sharing practical pitfalls and performance results.

Database ScalingElasticSearchMySQL
0 likes · 17 min read
How Vivo Scaled Its Order System: Sharding, Migration, and Real‑World Lessons
vivo Internet Technology
vivo Internet Technology
Dec 23, 2020 · Cloud Native

ZooKeeper: Comprehensive Guide to Distributed Coordination Service

ZooKeeper, Apache’s distributed coordination service, offers a highly available in‑memory hierarchical file system with leader‑follower‑observer clustering and the ZAB protocol, guaranteeing sequential consistency, atomicity and a single view while supporting publish/subscribe, configuration management, distributed locks, master election and queueing for robust distributed applications.

ApacheCoordination ServiceZAB Protocol
0 likes · 20 min read
ZooKeeper: Comprehensive Guide to Distributed Coordination Service
Alibaba Cloud Developer
Alibaba Cloud Developer
Dec 17, 2020 · Big Data

Why GraphScope is Revolutionizing Large-Scale Graph Computing for AI and Big Data

GraphScope, an open‑source one‑stop platform from Alibaba DAMO Academy, unifies interactive queries, graph analytics, and graph learning on massive, rapidly evolving graphs, offering high‑performance distributed memory management, Gremlin optimization, and seamless Python integration to tackle real‑world AI and big‑data challenges.

Pythonbig datadistributed systems
0 likes · 21 min read
Why GraphScope is Revolutionizing Large-Scale Graph Computing for AI and Big Data
Java Architecture Diary
Java Architecture Diary
Dec 17, 2020 · Backend Development

How to Implement Rate Limiting in Microservices with Resilience4j

This article explains why rate limiting is essential for resilient microservices, demonstrates a simple e‑commerce order flow, and provides step‑by‑step code examples using Resilience4j to restrict request throughput, handle overload, and automatically retry failed calls.

Resilience4jdistributed systemsmicroservices
0 likes · 6 min read
How to Implement Rate Limiting in Microservices with Resilience4j
IT Architects Alliance
IT Architects Alliance
Dec 13, 2020 · Backend Development

From Monolith to Microservices: A Practical Journey Through Modern Architecture

This article chronicles the evolution of software architecture from monolithic applications to microservices, detailing each stage's advantages and drawbacks, and enumerates the essential technology stack—including service communication, API gateways, authentication, fault handling, tracing, logging, configuration, containers, orchestration, and CI/CD—that enables building scalable, resilient backend systems.

CI/CDService Mesharchitecture
0 likes · 16 min read
From Monolith to Microservices: A Practical Journey Through Modern Architecture
Top Architect
Top Architect
Dec 13, 2020 · Backend Development

Practical Guide to Application and Database Splitting: Preparation, Implementation, and Stability

This article presents a comprehensive, step‑by‑step guide on why and how to split monolithic applications and databases, covering business complexity analysis, service boundary definition, migration planning, global ID generation, data sync, query refactoring, switch‑over strategies, consistency guarantees, and post‑split stability measures.

application splittingbackend architecturedatabase migration
0 likes · 16 min read
Practical Guide to Application and Database Splitting: Preparation, Implementation, and Stability
Wukong Talks Architecture
Wukong Talks Architecture
Dec 11, 2020 · Fundamentals

Byzantine Generals Problem Illustrated with Three Kingdoms Card Game

This article uses the popular Chinese card game Three Kingdoms to illustrate the Byzantine Generals Problem, explaining its relevance to distributed consensus, outlining four foundational theories and eight protocols, and demonstrating how voting, message tampering, and signature mechanisms affect agreement among nodes.

Byzantine Fault ToleranceThree Kingdomsalgorithm
0 likes · 14 min read
Byzantine Generals Problem Illustrated with Three Kingdoms Card Game
IT Architects Alliance
IT Architects Alliance
Dec 10, 2020 · Industry Insights

How Alipay Handles 540K TPS: Inside LDC’s Unit‑Based Architecture and CAP Strategies

This article analyzes the massive traffic handling of Alipay during Double 11, explaining the LDC (Logical Data Center) unit‑based design, the RZone‑GZone‑CZone hierarchy, traffic steering, disaster‑recovery mechanisms, and how OceanBase and Paxos enable CAP compliance for ultra‑high‑availability payments.

CAP theoremLDC architectureOceanBase
0 likes · 38 min read
How Alipay Handles 540K TPS: Inside LDC’s Unit‑Based Architecture and CAP Strategies
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Dec 10, 2020 · Databases

How Ant Financial’s LDC Architecture Scales to 540k TPS on Double‑11

This article explains how Ant Financial’s logical data center (LDC) architecture, based on user‑sharded RZones, GZones, and CZones, combined with OceanBase’s Paxos‑based consensus, enables massive horizontal scaling, high availability, and disaster‑tolerant processing of over half a million payment transactions per second during Double‑11.

CAP theoremOceanBasedistributed systems
0 likes · 35 min read
How Ant Financial’s LDC Architecture Scales to 540k TPS on Double‑11
Java Architecture Diary
Java Architecture Diary
Dec 9, 2020 · Backend Development

Implementing Retry Patterns in Microservices with Resilience4j

Learn how to design resilient microservices by implementing retry mechanisms using Resilience4j, including configuration, code examples for order and product services, handling exceptions, and testing the automatic retry behavior to improve system availability while noting limitations for non‑idempotent APIs.

Resilience4jRetrydistributed systems
0 likes · 7 min read
Implementing Retry Patterns in Microservices with Resilience4j
MaGe Linux Operations
MaGe Linux Operations
Dec 8, 2020 · Fundamentals

Mastering ZooKeeper: Core Concepts, Architecture, and Guarantees

This article provides a comprehensive overview of ZooKeeper, covering its purpose, design goals, hierarchical data model, session handling, watch mechanism, consistency guarantees, leader election, role workflows, and the Zab protocol that ensures reliable state replication across a distributed cluster.

Coordination ServiceLeader ElectionZAB Protocol
0 likes · 16 min read
Mastering ZooKeeper: Core Concepts, Architecture, and Guarantees
Java Architect Essentials
Java Architect Essentials
Dec 6, 2020 · Backend Development

Why Game Servers Resist Microservices: Real‑Time Constraints Explained

The article analyzes why many game server architectures avoid microservices, highlighting real‑time latency requirements, stateful processing, network overhead, and the mismatch between typical microservice patterns and the high‑performance demands of multiplayer online battle arena games.

backend architecturedistributed systemsgame server
0 likes · 9 min read
Why Game Servers Resist Microservices: Real‑Time Constraints Explained
Selected Java Interview Questions
Selected Java Interview Questions
Dec 3, 2020 · Backend Development

Comprehensive Guide to Java Design Patterns, Distributed Systems, and Core Algorithms

This article provides an extensive overview of common Java design patterns—including Singleton, Factory, Proxy, Observer, and Decorator—along with detailed code examples, followed by discussions of distributed system concepts, CAP theorem, BASE theory, and fundamental algorithms such as sorting and binary search.

AlgorithmsDesign PatternsJava
0 likes · 41 min read
Comprehensive Guide to Java Design Patterns, Distributed Systems, and Core Algorithms
Top Architect
Top Architect
Dec 3, 2020 · Fundamentals

Understanding Distributed Architecture: Concepts, Applications, and Evolution

This article explains the fundamentals of distributed architecture, describing its definition, key characteristics such as cohesion and transparency, common applications like distributed file systems, caches, and databases, and outlines the evolutionary stages from single‑server setups to clusters, load balancing, caching, CDN, NoSQL, and service‑oriented designs.

Cachingarchitecturedistributed systems
0 likes · 10 min read
Understanding Distributed Architecture: Concepts, Applications, and Evolution
IT Architects Alliance
IT Architects Alliance
Dec 2, 2020 · Operations

Understanding High Availability: Sources of Complexity and Decision Strategies

The article explains high availability as a source of system complexity, describing how redundancy, hardware and software failures, external disasters, and state‑decision mechanisms such as dictatorial, negotiated, and democratic approaches affect both compute and storage layers, and discusses trade‑offs like the CAP theorem.

CAP theoremdistributed systemshigh availability
0 likes · 12 min read
Understanding High Availability: Sources of Complexity and Decision Strategies
21CTO
21CTO
Dec 1, 2020 · Big Data

How Kafka Implements Transactions: Inside the TC Service and Producer Workflow

This article provides a comprehensive walkthrough of Kafka's transaction mechanism, covering the transaction coordinator, producer initialization, partition handling, commit and abort processes, state management, high‑availability design, timeout handling, and relevant source code snippets.

JavaKafkaTransaction Coordinator
0 likes · 22 min read
How Kafka Implements Transactions: Inside the TC Service and Producer Workflow
IT Architects Alliance
IT Architects Alliance
Nov 29, 2020 · Backend Development

Why High Performance Makes Software Architecture So Complex—and How to Tame It

The article analyzes how the relentless pursuit of high performance drives both single‑machine and cluster‑level architectural complexity, explaining the evolution from batch processing to multi‑core CPUs, the trade‑offs of processes, threads, SMP/NUMA/MPP, and the challenges of task allocation and decomposition in large‑scale systems.

BackendComplexitydistributed systems
0 likes · 16 min read
Why High Performance Makes Software Architecture So Complex—and How to Tame It
Top Architect
Top Architect
Nov 29, 2020 · Backend Development

Software Architecture Patterns: Traditional Three‑Tier, Cluster, Distributed, and Microservice Architectures

This article explains common software architecture patterns—including traditional three‑tier, cluster (horizontal scaling), distributed (vertical splitting), and microservice (vertical division) architectures—detailing their components, advantages, drawbacks, and configuration examples such as Tomcat clustering with Nginx load balancing.

BackendClusteringdistributed systems
0 likes · 9 min read
Software Architecture Patterns: Traditional Three‑Tier, Cluster, Distributed, and Microservice Architectures
Bitu Technology
Bitu Technology
Nov 27, 2020 · Backend Development

Steps 4–9 of Tubi's Advertising Pipeline: Pacing, Bid Collection, Video Transcoding, Bidding, Rendering, and Integration

The article details Tubi's ad‑serving pipeline from pacing control through bid collection, video transcoding, CPU‑intensive bidding optimization, result rendering, and final integration, highlighting the use of Akka, Spark, CRDTs, and gRPC in a distributed backend architecture.

Ad Techbiddingdistributed systems
0 likes · 7 min read
Steps 4–9 of Tubi's Advertising Pipeline: Pacing, Bid Collection, Video Transcoding, Bidding, Rendering, and Integration
Code Ape Tech Column
Code Ape Tech Column
Nov 26, 2020 · Backend Development

Understanding RabbitMQ: Architecture, Messaging Patterns, Persistence, Clustering, and Flow Control

This article provides a comprehensive overview of RabbitMQ, covering its origins, core components, message publishing and consumption, routing modes, persistence mechanisms, delivery guarantees, RPC support, clustering design, mirrored‑queue architecture, and flow‑control strategies for reliable backend messaging.

AMQPBackendClustering
0 likes · 13 min read
Understanding RabbitMQ: Architecture, Messaging Patterns, Persistence, Clustering, and Flow Control
Architect's Tech Stack
Architect's Tech Stack
Nov 24, 2020 · Backend Development

Understanding RPC: Principles, Architecture, and Common Frameworks

This article explains why RPC is essential for distributed services, defines its core concepts and architecture, compares it with REST, SOAP and SOA, outlines the components and call flow, and reviews key technologies and popular Java‑based RPC frameworks such as Dubbo, Thrift and Avro.

RPCbackend developmentdistributed systems
0 likes · 15 min read
Understanding RPC: Principles, Architecture, and Common Frameworks
DevOps Cloud Academy
DevOps Cloud Academy
Nov 23, 2020 · Cloud Native

How to Set Up an etcd Cluster and Deploy It on Kubernetes

This guide walks through installing etcd, launching a static three‑node pseudo‑cluster on a single host, explains key command‑line flags, and shows how to deploy, configure, and scale the etcd cluster in Kubernetes using a corrected StatefulSet manifest.

ClusterDevOpsdistributed systems
0 likes · 16 min read
How to Set Up an etcd Cluster and Deploy It on Kubernetes
Architecture Digest
Architecture Digest
Nov 22, 2020 · Operations

Stateful Services and High‑Availability Solutions: From Cold Backup to Multi‑Region Active‑Active

This article examines stateful backend services and various high‑availability strategies—including cold backup, active/standby hot backup, same‑city active‑active, cross‑region active‑active, and multi‑active architectures—detailing their advantages, limitations, and practical implementation considerations, and includes real‑world examples from major e‑commerce platforms.

Multi-Activeactive standbycold backup
0 likes · 14 min read
Stateful Services and High‑Availability Solutions: From Cold Backup to Multi‑Region Active‑Active
Architects' Tech Alliance
Architects' Tech Alliance
Nov 20, 2020 · Operations

High‑Availability Deployment: From Cold Backup to Multi‑Active Architecture

This article explains the evolution of high‑availability deployment architectures—from simple cold backups and hot standby to same‑city active‑active, cross‑city active‑active, and finally multi‑active solutions—detailing their advantages, drawbacks, and practical design considerations for large‑scale internet services.

Multi-Activedistributed systemssystem architecture
0 likes · 15 min read
High‑Availability Deployment: From Cold Backup to Multi‑Active Architecture
Tencent Cloud Developer
Tencent Cloud Developer
Nov 19, 2020 · Backend Development

Kafka Message Queue Reliability Design and Implementation

The article thoroughly explains Kafka’s message‑queue reliability design and implementation, covering use‑case scenarios, core concepts, storage format, producer acknowledgment settings, broker replication mechanisms (ISR, HW, LEO), consumer delivery semantics, the epoch solution for synchronization, and practical configuration guidelines for various consistency and availability requirements.

ConsistencyConsumerKafka
0 likes · 15 min read
Kafka Message Queue Reliability Design and Implementation
Amap Tech
Amap Tech
Nov 19, 2020 · Operations

TestPG Load‑Testing Platform: Precise Pressure Control Architecture and Practice

The TestPG load‑testing platform, built on a master‑slave architecture with Redis‑driven dynamic configuration, delivers fine‑grained, cluster‑ and interface‑level pressure control that automates load‑generator allocation, shortens holiday testing cycles to three days, and produces realistic traffic models for Gaode’s nationwide services.

Load Testingautomationdistributed systems
0 likes · 14 min read
TestPG Load‑Testing Platform: Precise Pressure Control Architecture and Practice
Programmer DD
Programmer DD
Nov 19, 2020 · Backend Development

Why and How to Split a Monolithic Application: Practical Guide

This article explains why monolithic systems need to be split, outlines multi‑dimensional preparation steps, details database vertical and horizontal partitioning, global ID generation, cut‑over strategies, consistency handling, and operational safeguards to ensure a smooth migration.

application splittingbackend architecturedatabase migration
0 likes · 17 min read
Why and How to Split a Monolithic Application: Practical Guide
Java High-Performance Architecture
Java High-Performance Architecture
Nov 18, 2020 · Big Data

Why Pulsar Might Outperform Kafka: Key Advantages and Drawbacks

This article examines Apache Pulsar, an open‑source messaging platform created by Yahoo, compares it with Kafka by outlining Kafka’s common pain points, highlights Pulsar’s multi‑tenant architecture, layered storage, built‑in functions, and security features, and discusses the trade‑offs of each solution.

Apache PulsarKafkabig data
0 likes · 6 min read
Why Pulsar Might Outperform Kafka: Key Advantages and Drawbacks
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Nov 17, 2020 · Backend Development

How to Become a Software Coach: A Step‑by‑Step Learning Roadmap

This guide outlines a multi‑stage roadmap for developers to grow into software coaches, covering essential Java fundamentals, agile practices, algorithms, testing, design patterns, JVM internals, distributed middleware, big‑data ecosystems, architecture design, performance tuning, and emerging fields like AI and IoT.

Design PatternsJavacareer development
0 likes · 11 min read
How to Become a Software Coach: A Step‑by‑Step Learning Roadmap
Architecture Digest
Architecture Digest
Nov 15, 2020 · Cloud Native

Ele.me's Multi‑Active Architecture: Design Principles, Core Components and Implementation Overview

This article explains how Ele.me built a multi‑active, geographically distributed system that enables elastic scaling and data‑center‑level disaster recovery by partitioning services, routing traffic, replicating data in real time, and enforcing strict consistency and availability principles.

Multi-Activedata replicationdistributed systems
0 likes · 18 min read
Ele.me's Multi‑Active Architecture: Design Principles, Core Components and Implementation Overview
JD Tech Talk
JD Tech Talk
Nov 13, 2020 · Artificial Intelligence

Practical Engineering Guide to Federated Learning: Deployment, Training, and Inference

This article provides a comprehensive engineering overview of federated learning, covering its core distributed‑learning concept, Docker‑based deployment, detailed training‑service architecture with validation, scheduling, metadata, and model‑management components, as well as a complete inference framework and workflow for production use.

AI engineeringDockerdistributed systems
0 likes · 12 min read
Practical Engineering Guide to Federated Learning: Deployment, Training, and Inference
Practical DevOps Architecture
Practical DevOps Architecture
Nov 10, 2020 · Databases

Design of Ant Financial's Logical Data Center (LDC) and Unitization for High‑TPS Payments

The article explains how Ant Financial’s Logical Data Center (LDC) and unit‑based architecture, combined with sharding, CAP analysis, and OceanBase’s Paxos‑based consensus, enable the payment platform to sustain tens of millions of transactions per second during Double‑11 events while ensuring high availability and disaster recovery.

CAP theoremHigh TPSOceanBase
0 likes · 42 min read
Design of Ant Financial's Logical Data Center (LDC) and Unitization for High‑TPS Payments
IT Architects Alliance
IT Architects Alliance
Nov 5, 2020 · Industry Insights

How Do Massive Websites Scale? Key Architecture Patterns Unveiled

This article examines the defining traits of large‑scale web systems and walks through the step‑by‑step evolution of their architecture—from single‑server LAMP setups to multi‑layer, distributed, and automated designs—highlighting performance, availability, scalability, and security considerations.

Cachingarchitecturedistributed systems
0 likes · 18 min read
How Do Massive Websites Scale? Key Architecture Patterns Unveiled
Programmer DD
Programmer DD
Nov 4, 2020 · Fundamentals

What Starbucks Can Teach Us About Asynchronous Messaging and Two‑Phase Commit

The article uses Starbucks' coffee‑ordering workflow as a real‑world analogy to explain asynchronous messaging patterns, correlation challenges, exception handling strategies, and why two‑phase commit can hinder scalability, illustrating how everyday processes inspire robust distributed system designs.

Asynchronous Messagingcompensationcorrelation
0 likes · 8 min read
What Starbucks Can Teach Us About Asynchronous Messaging and Two‑Phase Commit
Architecture Digest
Architecture Digest
Nov 3, 2020 · Backend Development

Data Consistency in Microservices: Transaction Management and Implementation Patterns

This article introduces the limitations of traditional local and distributed transactions for microservices, explains the BASE theory, and details four practical patterns—reliable event notification, maximum‑effort notification, business compensation, and TCC—providing code examples, diagrams, and a comparative table to guide developers in achieving eventual consistency across microservice architectures.

BASE theoryTCCdata consistency
0 likes · 19 min read
Data Consistency in Microservices: Transaction Management and Implementation Patterns
Top Architect
Top Architect
Nov 2, 2020 · Backend Development

Evolution of Taobao Backend Architecture: From Single‑Server to Cloud‑Native Scalability

This article uses Taobao's backend as a case study to illustrate how a system evolves from a single‑machine deployment to a multi‑layer, highly available, cloud‑native architecture capable of handling millions of concurrent users, covering concepts such as distribution, load balancing, caching, database sharding, micro‑services, containerization, and cloud platforms.

Backendarchitecturecloud
0 likes · 20 min read
Evolution of Taobao Backend Architecture: From Single‑Server to Cloud‑Native Scalability
High Availability Architecture
High Availability Architecture
Oct 27, 2020 · Fundamentals

Quorum in Distributed Systems: Concepts, Variants, and Impact on Availability and Latency

Quorum, the core principle behind majority read/write and Paxos, can be defined in various ways—including weighted, hierarchical, and non‑majority quorums—to trade off system availability, latency, and fault tolerance, with examples illustrating how different quorum designs affect performance in distributed storage and coordination services.

ConsensusPaxosavailability
0 likes · 18 min read
Quorum in Distributed Systems: Concepts, Variants, and Impact on Availability and Latency
Architecture Digest
Architecture Digest
Oct 26, 2020 · Fundamentals

How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges

This article outlines why distributed systems are needed, explains how they address cost and high‑availability issues by coordinating cheap nodes, and discusses the new coordination challenges such as service discovery, load balancing, fault isolation, monitoring, data partitioning, replication, and distributed transactions, providing a roadmap for further study.

data replicationdistributed systems
0 likes · 11 min read
How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Oct 22, 2020 · Backend Development

Core Concepts and Architecture of RocketMQ

This article introduces RocketMQ’s core concepts, including its deployment architecture, naming server, broker and client roles, subscription model, consumption modes, queue allocation algorithms, rebalancing, offset storage, transaction and delayed messages, as well as filtering mechanisms, providing a solid foundation for further practice.

BackendConsumer GroupMessage Queue
0 likes · 13 min read
Core Concepts and Architecture of RocketMQ
Architect
Architect
Oct 13, 2020 · Fundamentals

Distributed ID Generation Schemes and the rpcxio/did Service

This article reviews various ID generation methods—including UUID/GUID, auto‑increment integers, random numbers, Snowflake, and MongoDB ObjectID—explains their advantages and drawbacks, and introduces the rpcxio/did distributed ID service with performance benchmarks and deployment considerations.

SnowflakeUUIDdistributed systems
0 likes · 12 min read
Distributed ID Generation Schemes and the rpcxio/did Service
ITPUB
ITPUB
Oct 12, 2020 · Databases

Why ClickHouse Outperforms Other Databases: Core Features Unveiled

This article explains how ClickHouse’s column‑oriented storage, vectorized execution engine, rich DBMS capabilities, flexible table engines, and carefully designed distributed architecture enable it to handle massive workloads with sub‑second query latency, making it a standout OLAP solution.

ClickHouseColumnar DatabaseOLAP
0 likes · 29 min read
Why ClickHouse Outperforms Other Databases: Core Features Unveiled
Tuhu Marketing Technology Team
Tuhu Marketing Technology Team
Oct 10, 2020 · Backend Development

Ensuring Idempotency in Distributed Systems: Strategies and Code Samples

This article explains the concept of idempotency, examines common failure scenarios such as duplicate order creation, coupon redemption, and inventory deduction, and presents practical solutions—including unique identifiers, locking, database constraints, and state‑machine approaches—accompanied by concrete SQL and pseudo‑code examples.

Code ExamplesIdempotencybackend development
0 likes · 12 min read
Ensuring Idempotency in Distributed Systems: Strategies and Code Samples
Selected Java Interview Questions
Selected Java Interview Questions
Oct 9, 2020 · Cloud Native

Why Learn Spring Cloud: Core Concepts, Architecture, Projects and Best Practices

This article explains the motivations for adopting Spring Cloud, defines its components and design goals, compares it with Spring Boot and other frameworks, outlines its main sub‑projects, versioning scheme, and provides practical guidance on configuration, service discovery, load balancing, fault tolerance, and gateway development for cloud‑native microservices.

BackendJavaSpring Boot
0 likes · 21 min read
Why Learn Spring Cloud: Core Concepts, Architecture, Projects and Best Practices
Top Architect
Top Architect
Oct 8, 2020 · Backend Development

Flash Sale (秒杀) System Architecture, Technical Challenges and Solutions

This article analyses the complete flash‑sale business flow, enumerates its unique characteristics and technical challenges such as high concurrency, bandwidth pressure, inventory overselling, and then presents a layered architecture—including frontend static pages, site‑level throttling, service‑level queuing, database sharding, caching, and anti‑cheat mechanisms—along with concrete Java code examples and best‑practice recommendations for building a reliable, high‑performance flash‑sale system.

High Concurrencydistributed systemsflash sale
0 likes · 32 min read
Flash Sale (秒杀) System Architecture, Technical Challenges and Solutions
Architects' Tech Alliance
Architects' Tech Alliance
Oct 7, 2020 · Fundamentals

Understanding Software Architecture: Concepts, Layers, Types, Evolution, and Common Pitfalls

This article explains the fundamental concepts of software architecture, distinguishes systems, subsystems, modules and components, describes various architectural layers such as business, application, data, code, technical and deployment, outlines evolution from monoliths to micro‑services, and highlights common misconceptions and measurement criteria for a sound architecture.

architecture patternsdistributed systemsmicroservices
0 likes · 29 min read
Understanding Software Architecture: Concepts, Layers, Types, Evolution, and Common Pitfalls
Java Architect Essentials
Java Architect Essentials
Oct 5, 2020 · Backend Development

Implementing Distributed Rate Limiting in Spring Cloud Gateway with Token Bucket and Lua Script

This article explains how Spring Cloud Gateway uses a token‑bucket algorithm backed by Redis and a Lua script to perform distributed rate limiting, reviews common limiting algorithms, provides detailed Java and Lua code examples, and analyzes each step of the implementation for high‑concurrency systems.

LuaSpring Cloud Gatewaydistributed systems
0 likes · 7 min read
Implementing Distributed Rate Limiting in Spring Cloud Gateway with Token Bucket and Lua Script
Big Data Technology Architecture
Big Data Technology Architecture
Sep 30, 2020 · Databases

Core Technologies of OLAP Systems: Storage, Computation, Optimizer, and Emerging Trends

This article systematically examines the core technologies of OLAP systems, covering storage models, columnar formats, indexing, distributed storage architectures, query execution steps, optimizer designs, and emerging trends such as real‑time analytics, HTAP, cloud‑native deployment, and hardware acceleration.

OLAPcolumnar storagedistributed systems
0 likes · 23 min read
Core Technologies of OLAP Systems: Storage, Computation, Optimizer, and Emerging Trends
MaGe Linux Operations
MaGe Linux Operations
Sep 29, 2020 · Backend Development

Understanding Message Middleware: Core Architecture and Kafka Basics

This article explains the fundamental architecture of message middleware, its key roles such as peak shaving, asynchronous processing and decoupling, the two consumption models (publish‑subscribe and point‑to‑point), and introduces core Kafka concepts with practical Java code examples.

JavaKafkaMessage Queue
0 likes · 7 min read
Understanding Message Middleware: Core Architecture and Kafka Basics
New Oriental Technology
New Oriental Technology
Sep 28, 2020 · Fundamentals

Understanding Distributed Systems: CAP, BASE, Caching, Message Queues, and Practical Improvements in New Oriental's Mobile App

This article explains the fundamentals of distributed systems, covering the CAP and BASE theorems, caching strategies, message queues, database choices, JVM optimization, and practical architectural improvements applied to New Oriental's mobile app to enhance availability and performance.

CAP theoremCachingMessage Queue
0 likes · 20 min read
Understanding Distributed Systems: CAP, BASE, Caching, Message Queues, and Practical Improvements in New Oriental's Mobile App
Wukong Talks Architecture
Wukong Talks Architecture
Sep 24, 2020 · Fundamentals

Common Pitfalls in Distributed Systems: Message Queues, Caches, Sharding, and Transactions

This article systematically explains the fundamental concepts and typical pitfalls of distributed systems—including CAP and BASE theories, message‑queue reliability issues, distributed cache challenges, sharding strategies, and transaction models—while offering practical mitigation techniques for each problem.

CAP theoremdistributed systemsdistributed transaction
0 likes · 24 min read
Common Pitfalls in Distributed Systems: Message Queues, Caches, Sharding, and Transactions
dbaplus Community
dbaplus Community
Sep 23, 2020 · Databases

How JinS Achieves Multi‑Region Data Consistency and High Performance

Facing scalability limits, disaster risks, and latency in single‑region setups, OPPO built the JinS data‑sync framework, detailing its multi‑region challenges, design principles, modular architecture, consistency models, crash‑safe 2PC mechanisms, file‑queue optimizations, relay‑log handling, and performance gains over open‑source and commercial alternatives.

ConsistencyDatabase ReplicationJinS
0 likes · 21 min read
How JinS Achieves Multi‑Region Data Consistency and High Performance
JD Tech Talk
JD Tech Talk
Sep 21, 2020 · Blockchain

JD Digits' JACOBI Blockchain Innovation Lab Announces Major Research Achievements Including Dumbo Asynchronous Consensus and Identity Management Protocols

JD Digits' JACOBI Blockchain Innovation Lab unveiled a series of breakthrough research results—such as the Dumbo and Dumbo‑MVBA asynchronous consensus protocols, a blockchain identity management scheme, and a storage‑time proof—demonstrating leading academic contributions across consensus, cryptography, and distributed applications.

ConsensusDumbo ProtocolJD Digits
0 likes · 8 min read
JD Digits' JACOBI Blockchain Innovation Lab Announces Major Research Achievements Including Dumbo Asynchronous Consensus and Identity Management Protocols
IT Architects Alliance
IT Architects Alliance
Sep 20, 2020 · Industry Insights

What Is Middleware? History, Types, and the Chinese Market Landscape

This article explains middleware as foundational software for distributed systems, outlines its evolution from early transaction monitors to modern Java and .NET stacks, categorizes its various types, and analyzes global and Chinese market sizes while profiling leading domestic vendors.

Chinese vendorsdistributed systemsmarket analysis
0 likes · 15 min read
What Is Middleware? History, Types, and the Chinese Market Landscape
Architects' Tech Alliance
Architects' Tech Alliance
Sep 19, 2020 · Fundamentals

How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges

This article outlines why distributed systems are needed, explains how they address cost and high‑availability issues through coordinated nodes, and discusses the new challenges such as service discovery, load balancing, avalanche prevention, monitoring, data sharding, replication, and distributed transactions, while offering practical and theoretical learning paths.

CAP theoremLearning Guidedata replication
0 likes · 10 min read
How to Systematically Learn Distributed Systems: Problems, Solutions, and Emerging Challenges
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Sep 19, 2020 · Backend Development

An Introduction to Apache RocketMQ: Concepts, Architecture, Message Types, and Best Practices

This article provides a comprehensive overview of Apache RocketMQ, covering its core concepts, architecture, various message types, reasons for adoption such as asynchronous decoupling and peak‑shaving, as well as best practices and local transaction patterns for reliable distributed messaging.

Message QueueRocketMQTransaction Messaging
0 likes · 17 min read
An Introduction to Apache RocketMQ: Concepts, Architecture, Message Types, and Best Practices
IT Architects Alliance
IT Architects Alliance
Sep 19, 2020 · Cloud Native

Inside Eastern Securities' Multi-Language gRPC-Nebula Platform for Microservice Governance

This article examines Eastern Securities' transition to a microservice architecture by detailing the design, implementation, and performance of its gRPC‑Nebula service‑governance framework and the Star‑Chen platform, covering challenges such as heterogeneous interfaces, service registration, load balancing, fault tolerance, traffic control, multi‑registry support, and real‑world deployment results.

Service Governancecloud nativedistributed systems
0 likes · 34 min read
Inside Eastern Securities' Multi-Language gRPC-Nebula Platform for Microservice Governance
Big Data Technology & Architecture
Big Data Technology & Architecture
Sep 18, 2020 · Big Data

Understanding the Elasticsearch Master Election Process

This article explains when Elasticsearch triggers a master election, describes each election stage—including active master and candidate selection, Bully algorithm comparison, and master node responsibilities—while providing code excerpts that illustrate the underlying implementation details.

ElasticSearchMaster Electionbig data
0 likes · 8 min read
Understanding the Elasticsearch Master Election Process
Full-Stack DevOps & Kubernetes
Full-Stack DevOps & Kubernetes
Sep 18, 2020 · Cloud Native

Why Etcd Clusters Use Odd Nodes & What Happens During Leader Election

This article explains etcd’s Raft‑based consensus, why odd‑numbered nodes are recommended, details the leader election process with log excerpts, discusses split‑brain and consistency guarantees, and provides step‑by‑step instructions for generating certificates, deploying an etcd cluster, and using etcdctl commands.

Cluster DeploymentKubernetesRaft
0 likes · 19 min read
Why Etcd Clusters Use Odd Nodes & What Happens During Leader Election
Tencent Cloud Developer
Tencent Cloud Developer
Sep 17, 2020 · Cloud Computing

Evolution and Performance Optimization of Tencent Cloud Block Storage (CBS)

Tencent Cloud Block Storage (CBS) has evolved through three generations—apllo, atlas, and HiSTOR—adopting a client‑direct, distributed architecture, SPDK, RDMA and user‑space TCP to cut latency to sub‑microseconds while delivering exabyte‑scale throughput, high IOPS, and reliable multi‑copy replication for cloud VM workloads.

Cloud StorageRDMASPDK
0 likes · 24 min read
Evolution and Performance Optimization of Tencent Cloud Block Storage (CBS)
Top Architect
Top Architect
Sep 17, 2020 · Backend Development

Cache Consistency Strategies: Cache‑Aside Pattern, Deleting vs. Updating Cache, and Queue‑Based Solutions for High Concurrency

The article explains how distributed cache‑aside patterns work, why deleting stale cache entries is often preferable to updating them, analyzes basic and complex cache‑database inconsistency scenarios, and proposes a JVM‑queue‑driven, single‑threaded update mechanism with practical considerations for high‑concurrency environments.

BackendCache AsideConsistency
0 likes · 11 min read
Cache Consistency Strategies: Cache‑Aside Pattern, Deleting vs. Updating Cache, and Queue‑Based Solutions for High Concurrency
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Sep 17, 2020 · Fundamentals

Why Distributed Systems Matter: Core Concepts, Design Trade‑offs & CAP

This article explores the fundamentals of distributed systems, explaining what they are, why they’re used, design considerations such as replication and partitioning, the implications of the CAP theorem, common distribution strategies, typical architectural patterns, and the advantages and challenges of building and operating such systems.

CAP theoremdistributed systemsscalability
0 likes · 14 min read
Why Distributed Systems Matter: Core Concepts, Design Trade‑offs & CAP
Java Backend Technology
Java Backend Technology
Sep 13, 2020 · Backend Development

How to Build a Robust Idempotent Framework for Distributed Systems

This article explains why idempotency is essential, presents simple database‑based and concurrency‑safe implementations, and then details a generic, annotation‑driven idempotent framework with multi‑level storage, code examples, and deployment guidelines for Java backend services.

BackendIdempotencyannotation
0 likes · 12 min read
How to Build a Robust Idempotent Framework for Distributed Systems
iQIYI Technical Product Team
iQIYI Technical Product Team
Sep 11, 2020 · Cloud Native

Chaos Engineering Framework and Practices in iQIYI FinTech Team

The iQIYI FinTech team implemented a Chaos Engineering framework, using a purpose‑driven Chaos Monkey to inject controlled failures, validate high‑availability, isolation, and self‑healing of payment services, derive architectural improvements, build a fault‑case library, and transition from fault detection to proactive system robustness.

Chaos MonkeyFinTechchaos engineering
0 likes · 9 min read
Chaos Engineering Framework and Practices in iQIYI FinTech Team
Java Backend Technology
Java Backend Technology
Sep 10, 2020 · Backend Development

How to Prevent Duplicate Order Numbers in High-Concurrency Java Applications

This article analyzes a real incident where duplicate order numbers were generated under high concurrency, critiques the original timestamp‑based approach, and presents a thread‑safe Java solution using AtomicInteger, Java 8 date formatting, and optional IP suffixes to ensure globally unique identifiers.

atomicintegerdistributed systemsorder-number
0 likes · 9 min read
How to Prevent Duplicate Order Numbers in High-Concurrency Java Applications
Architect
Architect
Sep 9, 2020 · Backend Development

Cache Aside Pattern and Solutions for Cache‑Database Consistency in High‑Concurrency Environments

The article explains the classic Cache Aside pattern, why deleting rather than updating cache is preferred, analyzes basic and complex cache inconsistency scenarios, and proposes a queue‑based lazy update solution with practical considerations for read‑write blocking, request routing, and hotspot handling in high‑traffic systems.

Cache AsideConsistencyHigh Concurrency
0 likes · 11 min read
Cache Aside Pattern and Solutions for Cache‑Database Consistency in High‑Concurrency Environments
Architect's Tech Stack
Architect's Tech Stack
Sep 9, 2020 · Databases

How Redis Sentinel Implements Automatic Failover

This article explains how Redis Sentinel provides automatic failover by combining multi‑replica deployment, health monitoring, leader election, and distributed consensus to detect master failures, select a new master, promote it, and notify clients, ensuring high availability for Redis databases.

Database ReplicationRedisSentinel
0 likes · 10 min read
How Redis Sentinel Implements Automatic Failover
Selected Java Interview Questions
Selected Java Interview Questions
Sep 6, 2020 · Backend Development

Redis Interview Questions and High‑Availability Distributed System Overview

This article compiles common Redis interview questions, compares Redis with Memcached, explains eviction policies, and provides a concise introduction to distributed systems, high‑availability architectures, master‑slave replication, synchronization methods, and Redis‑based distributed lock solutions.

Rediscachedistributed systems
0 likes · 12 min read
Redis Interview Questions and High‑Availability Distributed System Overview