Tagged articles

distributed systems

2274 articles · Page 7 of 23
Architect
Architect
Oct 15, 2023 · Backend Development

Reflections on Microservices: Promises, Realities, and Trade‑offs

The article examines the alluring promises of microservices—such as faster deployments, independent scaling, and team autonomy—while revealing the hidden complexities like deployment chaos, service discovery, data consistency, latency, and the nostalgic appeal of monolithic architectures, ultimately offering three key takeaways for architects.

backend architecturedistributed systemsmicroservices
0 likes · 10 min read
Reflections on Microservices: Promises, Realities, and Trade‑offs
Wukong Talks Architecture
Wukong Talks Architecture
Oct 13, 2023 · Backend Development

7 Common Message Queue Scenarios and Their Implementations

This article explains seven typical message‑queue use cases—including ordinary, ordered, delayed, transactional, trace, dead‑letter, and priority messages—detailing their business motivations, implementation challenges, and concrete code examples for Kafka, RocketMQ, Pulsar, and RabbitMQ.

KafkaMessage QueuePulsar
0 likes · 11 min read
7 Common Message Queue Scenarios and Their Implementations
MaGe Linux Operations
MaGe Linux Operations
Oct 8, 2023 · Big Data

Understanding Kafka: Core Concepts, Architecture, and Performance Secrets

This article explains Kafka’s fundamental role as a message system, detailing topics, partitions, producers, consumers, replica management, consumer groups, the controller, Zookeeper coordination, and performance optimizations such as sequential writes, zero‑copy, log segmentation, and network design, providing a comprehensive overview for big‑data practitioners.

Consumer GroupKafkaMessage Queue
0 likes · 11 min read
Understanding Kafka: Core Concepts, Architecture, and Performance Secrets
Practical DevOps Architecture
Practical DevOps Architecture
Oct 8, 2023 · Backend Development

Comprehensive RocketMQ Course: Source Code Deep Dive, Advanced Features, Performance Tuning, and Real‑World Projects

This course provides an in‑depth study of RocketMQ, covering its fundamentals, source‑code analysis, advanced features such as transactional and ordered messages, performance optimization, operational monitoring, and hands‑on projects that guide learners through installation, configuration, clustering, and integration with Spring Boot.

Message QueuePractical projectsRocketMQ
0 likes · 4 min read
Comprehensive RocketMQ Course: Source Code Deep Dive, Advanced Features, Performance Tuning, and Real‑World Projects
Efficient Ops
Efficient Ops
Oct 7, 2023 · Big Data

Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture

This article explains Kafka's role as a messaging system, covering core concepts such as topics, partitions, producers, consumers, messages, cluster architecture, replicas, consumer groups, controller coordination with Zookeeper, and performance optimizations like sequential writes and zero‑copy networking.

Consumer GroupKafkaMessage Queue
0 likes · 11 min read
Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture
Liangxu Linux
Liangxu Linux
Oct 5, 2023 · Fundamentals

Why ULID Beats UUID: A Deep Dive into Lexicographically Sortable IDs

This article explains the limitations of UUID, introduces ULID as a time‑and‑randomness based identifier with 1.21×10⁻²⁴ unique values per millisecond, details its specification, binary layout, and shows how to generate and manipulate ULIDs in Python for distributed systems.

PythonUUIDdistributed systems
0 likes · 7 min read
Why ULID Beats UUID: A Deep Dive into Lexicographically Sortable IDs
Architects' Tech Alliance
Architects' Tech Alliance
Oct 3, 2023 · Fundamentals

Survey on In‑Network Storage Systems

This survey systematically reviews the research progress of in‑network storage systems, covering programmable network hardware characteristics, the two main challenges of building high‑performance solutions, task‑based classification of existing systems, representative designs, and future research directions such as switch‑NIC collaboration, multi‑tenant support, security, and automatic offloading.

ConsistencyIn‑Network StorageNetwork Acceleration
0 likes · 12 min read
Survey on In‑Network Storage Systems
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Sep 28, 2023 · Backend Development

Comprehensive 12306 Railway Ticket System Project for Learning Distributed Backend Development

This article introduces the 12306 railway ticket system project, detailing its purpose for student learning, two deployment versions, extensive backend architecture, technology stack, code repository structure, design challenges, and resources to help learners master high‑concurrency distributed systems.

High ConcurrencyJavaSpringBoot
0 likes · 15 min read
Comprehensive 12306 Railway Ticket System Project for Learning Distributed Backend Development
Efficient Ops
Efficient Ops
Sep 24, 2023 · Big Data

Mastering Kafka: From Basics to Advanced Operations and Performance Tuning

This article provides a comprehensive overview of Apache Kafka, covering its architecture, core concepts such as topics, partitions, and replicas, common operational commands, and practical performance‑tuning tips for high‑throughput, low‑latency streaming workloads.

Kafkadistributed systemsmessage queues
0 likes · 23 min read
Mastering Kafka: From Basics to Advanced Operations and Performance Tuning
ITPUB
ITPUB
Sep 22, 2023 · Databases

Where Does Database Innovation Come From? Exploring the Future of Distributed Databases

The article examines the driving forces behind database innovation, emphasizing the role of inherent shortcomings, AI integration, and the emergence of third‑generation distributed databases that aim for minimal usability, controllable latency high availability, and 100% data correctness.

data correctnessdatabasesdistributed systems
0 likes · 11 min read
Where Does Database Innovation Come From? Exploring the Future of Distributed Databases
Sanyou's Java Diary
Sanyou's Java Diary
Sep 21, 2023 · Big Data

Understanding Kafka: Core Concepts, Architecture, and Reliability Explained

This article provides a comprehensive overview of Kafka, covering its overall architecture, key components such as brokers, producers, consumers, topics, partitions, replicas, and ZooKeeper, as well as logical and physical storage mechanisms, producer and consumer workflows, configuration parameters, partition assignment strategies, rebalancing, and the replication model that ensures data reliability.

Data StreamingKafkadistributed systems
0 likes · 18 min read
Understanding Kafka: Core Concepts, Architecture, and Reliability Explained
DevOps Coach
DevOps Coach
Sep 21, 2023 · Operations

Why Observability Engineering Is Essential for Modern Software Systems

The article examines the concept of observability engineering, highlighting its importance for complex distributed systems, the cultural shift toward DevOps collaboration, key principles from the book “Observability Engineering,” and practical guidance for developers, SREs, managers, and executives to improve reliability, performance, and security.

distributed systemssoftware reliability
0 likes · 14 min read
Why Observability Engineering Is Essential for Modern Software Systems
Huolala Tech
Huolala Tech
Sep 21, 2023 · Big Data

How We Built a Scalable Data Migration Framework for Billions of Transactions

This article details the design and implementation of a custom, high‑throughput data migration framework that handles petabyte‑scale transaction data, supports heterogeneous source/target schemas, ensures zero‑downtime operation, and provides robust scheduling, checkpointing, and fault‑tolerance mechanisms.

Redisbig datadata migration
0 likes · 17 min read
How We Built a Scalable Data Migration Framework for Billions of Transactions
Wukong Talks Architecture
Wukong Talks Architecture
Sep 21, 2023 · Backend Development

Detecting and Preventing Message Loss in Kafka Message Queues

This article explains how to detect, diagnose, and prevent message loss in Kafka-based message queue systems by covering system decoupling, traffic control, data consistency challenges, producer, broker, and consumer issues, and offering configuration, monitoring, and operational best‑practice solutions.

KafkaMessage Queuedata consistency
0 likes · 12 min read
Detecting and Preventing Message Loss in Kafka Message Queues
Top Architect
Top Architect
Sep 20, 2023 · Operations

Design and Implementation of a Distributed Log Service: Tianyan vs ELK

This article examines the challenges of building a high‑performance log service for distributed systems, compares the traditional ELK stack with the Tianyan platform, details Tianyan's architecture—including ingest, storage, and consumer components, SDK and Minos collection methods, high‑throughput transmission with Disruptor and Bigpipe, log retrieval, resource isolation, dynamic cleaning, and best‑practice recommendations.

BigpipeDisruptorELK
0 likes · 27 min read
Design and Implementation of a Distributed Log Service: Tianyan vs ELK
dbaplus Community
dbaplus Community
Sep 19, 2023 · Cloud Native

How REDck Transformed ClickHouse into a Scalable Cloud‑Native Real‑Time Data Warehouse

REDck, a cloud‑native real‑time data warehouse built on open‑source ClickHouse, overcomes the original MPP architecture’s scaling and maintenance limits by separating compute and storage, introducing unified metadata, multi‑level caching, bucket‑based sharding, and distributed transaction support, delivering petabyte‑scale, 99.9% availability and ten‑fold cost and performance gains for Xiaohongshu’s diverse workloads.

ClickHouseCompute-Storage SeparationReal-time OLAP
0 likes · 22 min read
How REDck Transformed ClickHouse into a Scalable Cloud‑Native Real‑Time Data Warehouse
Architect
Architect
Sep 19, 2023 · Big Data

How Tianyan Beats ELK: Inside a High‑Performance Distributed Log Service

This article analyzes the challenges of logging in distributed services, compares the traditional ELK stack with Baidu's Tianyan platform, and details Tianyan's architecture, data collection, high‑throughput transmission, storage, retrieval, resource isolation, dynamic cleanup, and best‑practice recommendations, complete with code examples and performance insights.

ELKElasticSearchHigh Concurrency
0 likes · 30 min read
How Tianyan Beats ELK: Inside a High‑Performance Distributed Log Service
Su San Talks Tech
Su San Talks Tech
Sep 15, 2023 · Backend Development

What Is Microservices? Architecture, Challenges, and Popular Solutions Explained

This article introduces microservices as a lightweight, autonomous architecture, compares it with monolithic and SOA approaches, outlines the complexities it brings, and reviews the most common open‑source solutions, registration and configuration centers, remote‑call mechanisms, resilience patterns, load‑balancing algorithms, tracing, and monitoring tools.

Backenddistributed systemsservice discovery
0 likes · 44 min read
What Is Microservices? Architecture, Challenges, and Popular Solutions Explained
Practical DevOps Architecture
Practical DevOps Architecture
Sep 14, 2023 · Cloud Native

Spring Cloud Alibaba Comprehensive Learning Path – Video, Documentation, and Code Examples

This article presents a detailed Spring Cloud Alibaba curriculum covering microservice architecture, service registration with Nacos, rate limiting with Sentinel, distributed transaction solutions, and practical hands‑on labs, providing video tutorials, documentation, and complete code samples for developers.

NacosSentinelSpring Cloud Alibaba
0 likes · 10 min read
Spring Cloud Alibaba Comprehensive Learning Path – Video, Documentation, and Code Examples
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Sep 14, 2023 · Backend Development

Building a Multi‑Level Cache Consistency Framework for Live‑Streaming Platforms

This article describes how a social live‑streaming platform designed and implemented a custom multi‑level cache consistency framework, detailing the background challenges, the architecture of a cache pipeline with Zookeeper‑based node discovery and retry‑enabled execution, and the integration SDKs that enable transparent cache clearing across services.

Multi-level CacheZooKeeperbackend development
0 likes · 10 min read
Building a Multi‑Level Cache Consistency Framework for Live‑Streaming Platforms
vivo Internet Technology
vivo Internet Technology
Sep 13, 2023 · Operations

Network Quality Monitoring Center: Architecture, Design, and Implementation for Large-Scale Data Center Latency Measurement

The Network Quality Monitoring Center is a large‑scale system that deploys lightweight agents on every server to issue coordinated ICMP ping probes, a controller to generate and distribute topology‑aware PingLists, and a storage‑analysis module that aggregates latency and loss data for real‑time visualization, alerting and troubleshooting, while addressing load‑balance, ingestion concurrency, and future extensions such as UDP/TCP probes.

ICMP pingdistributed systemslatency measurement
0 likes · 12 min read
Network Quality Monitoring Center: Architecture, Design, and Implementation for Large-Scale Data Center Latency Measurement
360 Smart Cloud
360 Smart Cloud
Sep 13, 2023 · Backend Development

Introduction to Apache Pulsar Architecture and Features

This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.

Apache PulsarMessage QueueReplication
0 likes · 20 min read
Introduction to Apache Pulsar Architecture and Features
Architect
Architect
Sep 11, 2023 · Databases

How eBay Scaled ClickHouse with Read/Write Separation and Keeper

This article details eBay's event monitoring platform architecture, explains the challenges of high‑load OLAP workloads on ClickHouse clusters, describes the design and implementation of read/write separation and multi‑shard Keeper coordination, and shares concrete configuration snippets, performance observations, and production lessons learned.

ClickHouseDatabase ScalingKeeper
0 likes · 20 min read
How eBay Scaled ClickHouse with Read/Write Separation and Keeper
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 7, 2023 · Backend Development

Comprehensive Overview of Message Queues: Types, Core Concepts, and Comparison of Kafka, RocketMQ, and RabbitMQ

This article provides a detailed overview of popular message queue systems, explains their core concepts such as decoupling and eventual consistency, and compares the advantages and disadvantages of Kafka, RocketMQ, RabbitMQ, and other notable MQ solutions for high‑concurrency scenarios.

KafkaMessage QueueRabbitMQ
0 likes · 7 min read
Comprehensive Overview of Message Queues: Types, Core Concepts, and Comparison of Kafka, RocketMQ, and RabbitMQ
Java Architect Essentials
Java Architect Essentials
Sep 6, 2023 · Backend Development

Achieve WebSocket Load Balancing Across Microservice Instances with a Single Annotation

This article explains how to solve the WebSocket message delivery problem in microservice architectures by using a lightweight library that provides an @EnableWebSocketLoadBalanceConcept annotation, detailing its design, connection management, message routing, and customizable selectors for targeted delivery.

JavaSpring CloudWebSocket
0 likes · 13 min read
Achieve WebSocket Load Balancing Across Microservice Instances with a Single Annotation
Didi Tech
Didi Tech
Sep 5, 2023 · Operations

Observability and Stability Engineering in Didi Ride‑Hailing Platform

At Didi, observability and stability engineering combine automated, AI‑driven alarm generation, distributed tracing, and ChatOps‑based fault handling to manage micro‑service complexity, massive traffic spikes, and cross‑region operations, emphasizing systematic investment, AIOps evolution, and a recruitment call for backend and test engineers.

AIOpsDididistributed systems
0 likes · 16 min read
Observability and Stability Engineering in Didi Ride‑Hailing Platform
Shepherd Advanced Notes
Shepherd Advanced Notes
Sep 1, 2023 · Big Data

Visual Guide to Kafka’s Architecture and Core Principles

This article explains Kafka’s architecture in depth, covering components such as producers, consumers, topics, partitions, replication, Zookeeper coordination, the Controller’s election and responsibilities, state machines, and the NIO‑based network model, using clear diagrams and analogies.

ControllerKafkaNetwork Model
0 likes · 14 min read
Visual Guide to Kafka’s Architecture and Core Principles
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 28, 2023 · Backend Development

Understanding Dubbo: Core Functions, Architecture Layers, and Call Process of the RPC Framework

This article explains Dubbo's three core capabilities—remote method invocation, intelligent fault tolerance with load balancing, and service registration/discovery—details its main components and ten architectural layers, and walks through the eight-step RPC call flow, providing a comprehensive overview of the backend framework.

RPCbackend developmentdistributed systems
0 likes · 7 min read
Understanding Dubbo: Core Functions, Architecture Layers, and Call Process of the RPC Framework
MaGe Linux Operations
MaGe Linux Operations
Aug 26, 2023 · Backend Development

How Tencent’s PC & Mobile Payment Architecture Evolved to Support Billions

This article traces the evolution of Tencent's payment platform from its early PC‑centric design through three mobile payment phases, detailing architectural generations, availability measures, multi‑active strategies, and cloud‑native innovations that enable massive, reliable transaction processing.

availabilitybackend developmentcloud native
0 likes · 14 min read
How Tencent’s PC & Mobile Payment Architecture Evolved to Support Billions
JD Cloud Developers
JD Cloud Developers
Aug 24, 2023 · Backend Development

Mastering Java Locks: From ReentrantLock to Distributed Redisson & Zookeeper

This article explains the fundamentals and practical usage of various Java locking mechanisms—including ReentrantLock, synchronized, ReentrantReadWriteLock, and the Atomic and Concurrent families—then explores distributed lock solutions such as Redisson’s multiple lock types and Zookeeper/Curator, comparing their performance, consistency, and suitability for different scenarios.

JavaLocksRedisson
0 likes · 22 min read
Mastering Java Locks: From ReentrantLock to Distributed Redisson & Zookeeper
政采云技术
政采云技术
Aug 23, 2023 · Big Data

Step-by-Step Guide to Building a Hadoop Big Data Cluster on ARM Architecture

This comprehensive tutorial details the process of deploying a complete Hadoop-based big data ecosystem on ARM architecture, covering the installation and configuration of essential components including Java, Zookeeper, Hadoop, MySQL, Hive, and Spark with practical code examples.

ARM architectureCluster DeploymentHadoop
0 likes · 19 min read
Step-by-Step Guide to Building a Hadoop Big Data Cluster on ARM Architecture
DeWu Technology
DeWu Technology
Aug 21, 2023 · Backend Development

Design and Implementation of DGraph: A High‑Performance Recommendation Engine

DGraph, a C++ recommendation engine launched in 2022 for 得物, combines an index layer with a service layer, uses lock‑free RCU structures, a custom mmap‑based D‑Allocator, RoaringBitmap invert indexes, and a multi‑operator fusion scheduler to achieve high‑performance, eventually consistent, scalable recommendations.

C++RCURecommendation Engine
0 likes · 12 min read
Design and Implementation of DGraph: A High‑Performance Recommendation Engine
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 17, 2023 · Backend Development

Comprehensive Introduction to Message Queues

This article provides a thorough overview of message queues, covering their definition, core components, types (point‑to‑point and publish/subscribe), key characteristics such as asynchrony, loose coupling, distribution and reliability, selection criteria among popular MQ products, and typical application scenarios in high‑concurrency systems.

Message Queueasynchronousbackend architecture
0 likes · 9 min read
Comprehensive Introduction to Message Queues
Code Ape Tech Column
Code Ape Tech Column
Aug 15, 2023 · Operations

High‑Availability Architecture for a Billion‑Scale Membership System: Dual‑Center ES, Redis, and MySQL Solutions

This article details the design and implementation of a highly available, high‑performance membership system serving over a billion users, covering dual‑center Elasticsearch clusters, traffic‑isolated three‑cluster ES architecture, Redis dual‑center caching, MySQL partitioned clusters, migration strategies, and refined flow‑control and degradation mechanisms.

ElasticSearchMySQLdistributed systems
0 likes · 20 min read
High‑Availability Architecture for a Billion‑Scale Membership System: Dual‑Center ES, Redis, and MySQL Solutions
Didi Tech
Didi Tech
Aug 7, 2023 · Backend Development

How Didi Achieved Cross‑Datacenter Elasticsearch Replication for Strong Consistency

This article explains Didi's self‑developed DCDR system that replicates Elasticsearch indices across data‑center clusters, detailing its design goals, core mechanisms, chain construction, historical data recovery, real‑time sync, and data‑quality validation to ensure high availability and strong consistency.

DCDRElasticSearchcross-datacenter replication
0 likes · 15 min read
How Didi Achieved Cross‑Datacenter Elasticsearch Replication for Strong Consistency
Architects Research Society
Architects Research Society
Aug 5, 2023 · Big Data

Getting Started with Data Mesh: A Quick‑Start Guide

This guide introduces the concept of a data mesh, explains why modern data‑driven organizations need domain‑driven self‑serve design, outlines its three core principles, and provides a curated reading list to help teams transition from monolithic data lakes to distributed, observable data products.

Domain‑Driven Designdata governancedistributed systems
0 likes · 10 min read
Getting Started with Data Mesh: A Quick‑Start Guide
Tencent Cloud Developer
Tencent Cloud Developer
Aug 2, 2023 · Backend Development

How to Do Architecture Design Well: A Tencent Architect's Experience

A Tencent architect explains that effective software architecture requires clear distinctions between systems, subsystems, modules and components, understanding frameworks versus structural design, applying TOGAF classifications, evolving from monoliths to microservices, and following fifteen practical principles while avoiding common misconceptions such as over‑design and technology‑driven choices.

Architecture PrinciplesTOGAFdistributed systems
0 likes · 20 min read
How to Do Architecture Design Well: A Tencent Architect's Experience
DaTaobao Tech
DaTaobao Tech
Jul 26, 2023 · Backend Development

Design and Implementation of a Netty‑Based Microservice Communication Module

The article walks Java developers through constructing a lightweight Netty‑based RPC framework—using RocketMQ’s NettyRemotingServer and NettyRemotingClient to handle synchronous, asynchronous and one‑way calls, routing request codes to dedicated processors and thread pools, exposing services via dynamic proxies, and outlining extensions such as service‑registry integration for a full microservice communication solution.

JavaNettyRPC
0 likes · 28 min read
Design and Implementation of a Netty‑Based Microservice Communication Module
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 26, 2023 · Backend Development

How a New Cache Design Boosted Logistics Pricing QPS Five‑Fold

This article reviews the performance challenges of the logistics pricing engine, explains the limitations of the previous 1.0 optimizations, and details the design and implementation of a new 2.0 cache strategy using Tair and local caches, key‑value modeling, pre‑heating, updates, and bottleneck mitigation, achieving the required QPS.

BackendCachingTair
0 likes · 19 min read
How a New Cache Design Boosted Logistics Pricing QPS Five‑Fold
Java High-Performance Architecture
Java High-Performance Architecture
Jul 24, 2023 · Backend Development

Business Compensation in Distributed Systems: Rollback, Retry, and Consistency

This article explains how distributed systems handle business inconsistencies through compensation mechanisms, detailing rollback versus retry approaches, their implementation patterns such as explicit/implicit rollback, various retry strategies, and the trade‑offs between ACID and BASE consistency models for achieving eventual consistency.

ConsistencyRetrybusiness compensation
0 likes · 11 min read
Business Compensation in Distributed Systems: Rollback, Retry, and Consistency
Tech Architecture Stories
Tech Architecture Stories
Jul 23, 2023 · Backend Development

Beyond Scale: Rethinking Architecture Boundaries for Massive Services

This article reflects on years of designing large‑scale backend systems at Tencent, discussing how to define clear architecture boundaries, ensure high availability, integrate diverse technologies, and use observability and monitoring to continuously evolve and improve massive service architectures.

architecturedistributed systemshigh availability
0 likes · 25 min read
Beyond Scale: Rethinking Architecture Boundaries for Massive Services
Su San Talks Tech
Su San Talks Tech
Jul 22, 2023 · Backend Development

How Bilibili Scaled Its Relationship Chain Service from MySQL to KV and Redis

This article details how Bilibili’s relationship‑chain service evolved from a MySQL‑based design to a KV‑store with asynchronous writes, introduced multi‑layer caching with memcached, Redis hash and KV, added bloom‑filter optimization, and implemented hotspot mitigation to support millions of QPS.

BackendCachingdatabase migration
0 likes · 16 min read
How Bilibili Scaled Its Relationship Chain Service from MySQL to KV and Redis
Sohu Tech Products
Sohu Tech Products
Jul 19, 2023 · Backend Development

Understanding RocketMQ Consumption Logic in Version 4.9.x

This article provides a comprehensive walkthrough of RocketMQ 4.9.x consumption architecture, covering the four core roles, publish‑subscribe model, storage structures, load‑balancing, long‑polling, concurrent and ordered consumption flows, progress persistence, and retry mechanisms, with illustrative diagrams and code snippets.

ConsumerMessage QueueRetry
0 likes · 28 min read
Understanding RocketMQ Consumption Logic in Version 4.9.x
21CTO
21CTO
Jul 19, 2023 · Operations

Scaling a Fast‑Growing Supply Chain Platform: Architecture and Ops Insights

This article details how a rapidly expanding B2B fresh‑food company restructured its R&D organization, adopted a matrix management model, and built a comprehensive distributed infrastructure—including task scheduling, service discovery, messaging, logging, file storage, CDN, configuration, sharding, search, caching, and monitoring—to support nationwide warehouse operations and future growth.

DevOpsbackend developmentdistributed systems
0 likes · 7 min read
Scaling a Fast‑Growing Supply Chain Platform: Architecture and Ops Insights
Weimob Technology Center
Weimob Technology Center
Jul 18, 2023 · Backend Development

How MOAT Enables Lightweight, Multi‑Dimensional Rate Limiting for Scalable Systems

MOAT is a lightweight, multi‑dimensional rate‑limiting component designed to ensure system stability amid traffic spikes, offering configurable rules, automatic blacklisting, and a closed‑loop control flow, with detailed architecture spanning access, logic, data, and logging layers, plus client‑side SDK integration.

Javadistributed systemsmicroservices
0 likes · 11 min read
How MOAT Enables Lightweight, Multi‑Dimensional Rate Limiting for Scalable Systems
Selected Java Interview Questions
Selected Java Interview Questions
Jul 15, 2023 · Operations

High‑Availability Architecture for a Large‑Scale Membership System

The article describes how a membership system serving billions of users across multiple platforms achieves high performance and high availability through dual‑center Elasticsearch clusters, traffic‑isolated three‑cluster ES architecture, Redis caching with distributed locks, dual‑center MySQL partitioning, and fine‑grained flow‑control and degradation strategies.

ElasticSearchMySQLRedis
0 likes · 25 min read
High‑Availability Architecture for a Large‑Scale Membership System
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jul 10, 2023 · Big Data

Design and Implementation of the Log Reporting, Collection, and Distribution Pipeline in NetEase Cloud Music's Corona Front‑end Monitoring System

The article details NetEase Cloud Music’s Corona monitoring pipeline, explaining how SDKs report logs via an HTTP service, how a transmission layer normalizes and stores them, how a Flume‑like collector forwards logs to HBase and Kafka, and how Flink tasks shard and filter streams for various monitoring services while handling traffic spikes and offering an independent Node.js channel for other business units.

FlinkKafkaLog Monitoring
0 likes · 10 min read
Design and Implementation of the Log Reporting, Collection, and Distribution Pipeline in NetEase Cloud Music's Corona Front‑end Monitoring System
Architects Research Society
Architects Research Society
Jul 7, 2023 · Operations

Design Patterns and Principles for Building Large‑Scale Systems

This article outlines key design patterns and principles—such as scalability, idempotency, asynchronous processing, health checks, circuit breakers, feature flags, bulkheads, service discovery, retries, metrics, rate limiting, back‑pressure, and canary releases—that enable large‑scale, reliable, and resilient distributed systems.

distributed systemsobservabilityreliability
0 likes · 16 min read
Design Patterns and Principles for Building Large‑Scale Systems
政采云技术
政采云技术
Jun 29, 2023 · Backend Development

Understanding RocketMQ: Architecture, Modules, and Deployment Essentials

This article provides a comprehensive overview of RocketMQ, covering its origin, core concepts, component roles, cluster deployment architecture, workflow, feature details, persistence mechanisms, and cleanup policies, offering developers a solid foundation for using this high‑performance messaging middleware.

ApacheMessage QueueRocketMQ
0 likes · 18 min read
Understanding RocketMQ: Architecture, Modules, and Deployment Essentials
Alibaba Cloud Native
Alibaba Cloud Native
Jun 26, 2023 · Cloud Native

How RocketMQ Evolved Its High‑Availability Architecture for Cloud‑Native Deployments

This article examines RocketMQ's high‑availability evolution—from early master‑slave and Raft‑based designs to the v5 DLedger fusion model—detailing replica groups, data sharding, election mechanisms, replication strategies, metric trade‑offs, log‑divergence handling, controller roles, heartbeat optimizations, and comparisons with Kafka and Pulsar, all illustrated with diagrams and code snippets.

DLedgerRaftReplication
0 likes · 36 min read
How RocketMQ Evolved Its High‑Availability Architecture for Cloud‑Native Deployments
DataFunSummit
DataFunSummit
Jun 21, 2023 · Databases

Forum on Building Ultra‑Scale Storage Systems: Insights from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud

The forum gathers senior experts from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud to share practical experiences and future trends on constructing ultra‑large‑scale file, block, KV and NoSQL storage systems, focusing on low‑cost, high‑performance solutions and architectural challenges.

KV storageStorageblock storage
0 likes · 8 min read
Forum on Building Ultra‑Scale Storage Systems: Insights from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud
dbaplus Community
dbaplus Community
Jun 20, 2023 · Operations

How Agricultural Bank Built a Chaos Engineering Platform for Resilience

The article outlines the Agricultural Bank of China's initiative to adopt chaos engineering, describing the challenges of modern distributed systems, the design and capabilities of their in‑house chaos platform, product research, industry comparisons, practical use cases across development, operations and disaster recovery, and future development directions.

Platform Developmentchaos engineeringcloud native
0 likes · 14 min read
How Agricultural Bank Built a Chaos Engineering Platform for Resilience
Open Source Linux
Open Source Linux
Jun 20, 2023 · Operations

Mastering Load Balancing: Types, Architectures, and Algorithms Explained

This article explains why high‑performance clusters are complex, introduces the three main load‑balancing categories—DNS, hardware, and software—describes their definitions, advantages, and drawbacks, outlines typical combined architectures, and reviews common load‑balancing algorithms such as round‑robin, weighted round‑robin, least‑load, performance‑optimal, and hash‑based methods.

AlgorithmsHardwaredistributed systems
0 likes · 6 min read
Mastering Load Balancing: Types, Architectures, and Algorithms Explained
FunTester
FunTester
Jun 19, 2023 · Big Data

Kafka Architecture and Core Concepts: Brokers, Producers, Consumers, Topics, Partitions, Replicas, and Reliability

This article provides a comprehensive overview of Kafka's architecture and fundamental concepts, covering its overall structure, key components such as brokers, producers, consumers, topics, partitions, replicas, leader‑follower synchronization, offset handling, message storage at both logical and physical layers, as well as producer and consumer workflows, partition assignment strategies, rebalancing, log management, zero‑copy I/O, and reliability mechanisms.

KafkaLog Managementconsumer groups
0 likes · 22 min read
Kafka Architecture and Core Concepts: Brokers, Producers, Consumers, Topics, Partitions, Replicas, and Reliability
Baidu Geek Talk
Baidu Geek Talk
Jun 19, 2023 · Operations

How Baidu’s Tianyan Log Service Overcomes ELK’s Scaling and Performance Limits

This article examines the challenges of logging in distributed services, compares the traditional ELK stack with Baidu's Tianyan solution, details Tianyan's architecture—including Ingest, Store, Consumer, Elastic Agent, Fleet, APM, Beats, and Disruptor‑based high‑throughput pipelines—covers resource isolation, dynamic cleanup, and best‑practice recommendations for building a scalable, low‑latency log platform.

Elastic StackHigh ConcurrencyLog Management
0 likes · 26 min read
How Baidu’s Tianyan Log Service Overcomes ELK’s Scaling and Performance Limits
Open Source Linux
Open Source Linux
Jun 16, 2023 · Backend Development

How Netflix’s Cloud Gateway Cuts Errors with Adaptive Load Balancing

Netflix’s cloud‑gateway team redesigned its load‑balancing stack—combining client latency, server utilization, and probabilistic choice‑of‑2 algorithms—to dramatically lower error rates, improve request distribution, and enhance fault‑tolerance for millions of requests per second.

Netflixadaptive algorithmsbackend infrastructure
0 likes · 19 min read
How Netflix’s Cloud Gateway Cuts Errors with Adaptive Load Balancing
ITPUB
ITPUB
Jun 15, 2023 · Databases

How Domestic Databases Are Shaping China’s Financial Digital Transformation

Amid China’s push for digital and domestic technology, the article examines the evolution of native database products, the opportunities and challenges they face—especially in the financial sector—and how policy, cloud‑native architectures, distributed systems, and multi‑cloud demands are driving the next wave of innovation.

Chinacloud-nativedatabases
0 likes · 10 min read
How Domestic Databases Are Shaping China’s Financial Digital Transformation
Sanyou's Java Diary
Sanyou's Java Diary
Jun 12, 2023 · Backend Development

Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies

This article walks through RocketMQ 4.9.x’s consumption architecture, explaining the roles of NameServer, Broker, Producer and Consumer, the publish‑subscribe model, storage structures, load‑balancing algorithms, long‑polling, concurrent and ordered consumption, progress persistence, and the built‑in retry mechanism.

ConsumerMessage QueueRetry Mechanism
0 likes · 28 min read
Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies
DeWu Technology
DeWu Technology
Jun 7, 2023 · Backend Development

Ensuring Data Consistency Across Microservices: Strategies and Design Principles

This article examines why data consistency between microservices is critical, defines key terminology, and presents two practical approaches—business‑side final consistency and platform‑side final consistency—detailing their core ideas, design principles, workflow diagrams, and real‑world implementation considerations such as idempotency, storage choices, latency tolerance, state‑machine design, concurrency control, and observability.

Idempotencybackend designconcurrency
0 likes · 17 min read
Ensuring Data Consistency Across Microservices: Strategies and Design Principles
Code Ape Tech Column
Code Ape Tech Column
Jun 6, 2023 · Backend Development

Business Compensation Mechanisms: Rollback and Retry Strategies in Distributed Systems

The article explains business compensation mechanisms in distributed microservice architectures, detailing rollback and retry approaches, their implementation patterns, strategies, and practical considerations for achieving eventual consistency while handling failures and outlines best practices for idempotency, monitoring, and workflow engine design.

Retrybusiness compensationdistributed systems
0 likes · 14 min read
Business Compensation Mechanisms: Rollback and Retry Strategies in Distributed Systems
Top Architect
Top Architect
Jun 5, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core concepts, architecture, and the techniques it employs—such as ack strategies, replica synchronization, high‑watermark, leader‑epoch, zero‑copy, batch sending, compression, and reactor‑based networking—to achieve both strong reliability and high throughput in distributed messaging systems.

KafkaMessage Queuedistributed systems
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
Alibaba Cloud Developer
Alibaba Cloud Developer
Jun 5, 2023 · Databases

Mastering Cache Consistency: Strategies to Prevent Stale Data in High‑Concurrency Systems

This article examines why cache‑database consistency problems arise under high concurrency, compares common update orders, explains delayed double‑delete and cache‑aside patterns, and presents practical solutions such as retry mechanisms, message queues, and MySQL binlog subscription to keep data synchronized.

Cache Asidecache consistencydistributed systems
0 likes · 11 min read
Mastering Cache Consistency: Strategies to Prevent Stale Data in High‑Concurrency Systems
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jun 5, 2023 · Artificial Intelligence

How Alibaba’s DGS Enables Real‑Time GNN Inference on Massive Dynamic Graphs

The Dynamic Graph Sampling (DGS) service, built on GraphLearn, delivers sub‑20 ms latency for real‑time GNN inference on large, constantly evolving graphs by separating storage from computation, using event‑driven pre‑sampling, lazy multi‑hop concatenation, and a publish‑subscribe architecture that scales linearly across distributed workers.

Alibaba CloudGraphLearndistributed systems
0 likes · 12 min read
How Alibaba’s DGS Enables Real‑Time GNN Inference on Massive Dynamic Graphs
Architects Research Society
Architects Research Society
Jun 4, 2023 · Big Data

Understanding Transactions in Apache Kafka

This article explains the design, semantics, and practical usage of Apache Kafka's transaction API, covering why transactions are needed for exactly‑once processing, the underlying atomic multi‑partition writes, zombie fencing, consumer guarantees, Java API details, performance considerations, and operational best practices.

Apache KafkaExactly-OnceJava
0 likes · 19 min read
Understanding Transactions in Apache Kafka
MaGe Linux Operations
MaGe Linux Operations
Jun 1, 2023 · Backend Development

How Netflix’s New Load‑Balancing Algorithm Cuts Errors by Orders of Magnitude

Netflix’s cloud‑gateway team redesigned Zuul’s load‑balancing using a combination of client latency, server utilization, choice‑of‑2 and Join‑the‑Shortest‑Queue algorithms, adding server‑reported metrics, adaptive thresholds and statistical decay, which dramatically reduced error rates, latency and improved traffic distribution in production.

Netflixdistributed systemsperformance
0 likes · 20 min read
How Netflix’s New Load‑Balancing Algorithm Cuts Errors by Orders of Magnitude
Liangxu Linux
Liangxu Linux
May 28, 2023 · Backend Development

Preventing Redis Cache Penetration, Avalanche, and Thundering Herd

This article explains the causes of Redis cache penetration, avalanche, and thundering herd, and provides practical mitigation strategies such as caching null values, using white‑lists, Bloom filters, pre‑warming hot keys, staggered expirations, multi‑level caching, and lock mechanisms.

BackendCaching StrategiesRedis
0 likes · 7 min read
Preventing Redis Cache Penetration, Avalanche, and Thundering Herd
Didi Tech
Didi Tech
May 26, 2023 · Big Data

Design and Optimization of Didi's Spatial‑Temporal Supply‑Demand System

Didi’s redesigned Spatial‑Temporal Supply‑Demand System replaces a single‑Redis bottleneck with a multi‑cluster routing layer, semantic sharding, multi‑level caching and delayed queues, achieving higher horizontal scalability, fault isolation, ~30 % latency reduction, increased cache hit rates, fewer query nodes, and faster, code‑free feature configuration.

configuration managementdistributed systemsgolang
0 likes · 19 min read
Design and Optimization of Didi's Spatial‑Temporal Supply‑Demand System
dbaplus Community
dbaplus Community
May 25, 2023 · Databases

15 Powerful Redis Patterns for Scalable Backend Systems

This article presents fifteen practical Redis usage patterns—including caching, distributed sessions, locks, global IDs, counters, bitmaps, shopping carts, timelines, message queues, lotteries, likes, product tags, filtering, follow relationships, and ranking—illustrating how each can be implemented with commands and code snippets to build efficient, scalable backend services.

Data Structuresdistributed systems
0 likes · 9 min read
15 Powerful Redis Patterns for Scalable Backend Systems
Code Ape Tech Column
Code Ape Tech Column
May 22, 2023 · Backend Development

Vertical Performance Optimization: Load Balancing Architecture and Practices

This article explores the evolution of load‑balancing architectures from Alibaba’s early systems to modern micro‑service meshes, detailing DNS, hardware, and software solutions, common algorithms, and real‑world case studies such as Double‑11, China Railway 12306, WeChat red packets, and Douyin, highlighting performance, scalability, and reliability considerations.

distributed systemsservice mesh
0 likes · 17 min read
Vertical Performance Optimization: Load Balancing Architecture and Practices
DataFunTalk
DataFunTalk
May 21, 2023 · Databases

Graph Database Storage Techniques and Practices with Galaxybase

This article introduces RDF and property graph models, explains the core goals of graph database storage, compares mainstream storage solutions such as array, linked‑list and LSM‑Tree approaches, and presents practical deployment experiences of the Galaxybase distributed graph database.

GalaxybaseProperty GraphRDF
0 likes · 23 min read
Graph Database Storage Techniques and Practices with Galaxybase
Selected Java Interview Questions
Selected Java Interview Questions
May 17, 2023 · Backend Development

Effective Cache Strategies for Large Distributed Systems

This article explains how to design and use various client‑side, CDN, and server‑side caching techniques—including HTTP Cache‑Control, Redis data structures, cache consistency patterns, and mitigation of cache penetration, breakdown, and avalanche—to improve performance and reliability of high‑traffic distributed applications.

CDNRediscache consistency
0 likes · 23 min read
Effective Cache Strategies for Large Distributed Systems
ITPUB
ITPUB
May 10, 2023 · Cloud Native

How Meituan’s MStore Achieves Scalable Storage‑Compute Separation in Cloud‑Native Environments

This article explains how Meituan’s storage team designed the MStore distributed storage platform to separate storage and compute, addressing scaling, cost, and reliability challenges of monolithic architectures, and details its cloud‑native components, data model, performance optimizations, observability, and the derived EBS block‑storage service.

MStoreStoragecloud-native
0 likes · 16 min read
How Meituan’s MStore Achieves Scalable Storage‑Compute Separation in Cloud‑Native Environments
HelloTech
HelloTech
May 8, 2023 · Artificial Intelligence

One‑Stop AI Platform for Cloud, Edge, Mobile, Flink, and Application Intelligence: Architecture, Challenges, and Solutions

The article presents a comprehensive one‑stop AI platform that unifies training, model, feature, and decision services across cloud, edge, mobile, Flink, and application environments, detailing its architecture, the limitations of cloud‑centric inference, the advantages of localized inference, and the challenges and solutions for model and feature localization, SDK design, and future AutoML enhancements.

AI platformFlinkdistributed systems
0 likes · 17 min read
One‑Stop AI Platform for Cloud, Edge, Mobile, Flink, and Application Intelligence: Architecture, Challenges, and Solutions
Architects Research Society
Architects Research Society
May 6, 2023 · Databases

Understanding Eventual Consistency in Apache CouchDB

This article explains how Apache CouchDB achieves eventual consistency through its MVCC architecture, CAP theorem trade‑offs, incremental replication, and document‑level versioning, illustrating concepts such as local consistency, conflict resolution, and practical use‑cases for building scalable distributed systems.

CouchDBMVCCReplication
0 likes · 21 min read
Understanding Eventual Consistency in Apache CouchDB
Top Architect
Top Architect
May 3, 2023 · Backend Development

Understanding RPC: Principles, Implementation Details, and Code Walkthrough

This article explains the fundamentals of Remote Procedure Call (RPC), covering its definition, core challenges, service registration and discovery with Zookeeper, client proxy generation, network transmission using Netty, serialization and compression, server-side request handling via reflection or Javassist, and performance comparisons between proxy strategies.

JavaJavassistNetty
0 likes · 24 min read
Understanding RPC: Principles, Implementation Details, and Code Walkthrough
Top Architect
Top Architect
Apr 30, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance, and Operational Practices

This article provides a comprehensive overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, log storage mechanisms, zero‑copy data transfer, high‑throughput and high‑availability design, consumer group behavior, rebalance strategies, and practical operational commands for managing topics, partitions, and offsets.

BackendKafkaMessage Queue
0 likes · 31 min read
Kafka Core Concepts, Architecture, Performance, and Operational Practices
AntTech
AntTech
Apr 28, 2023 · Information Security

Threshold Proxy Re‑Encryption (TPRE) with National Cryptographic Algorithms for Secure Data Sharing

The article explains how cryptographic access control, especially a hybrid‑encrypted Threshold Proxy Re‑Encryption scheme built on national SM2/SM3/SM4 algorithms, offers high‑strength, decentralized, and efficient data authorization and sharing, addressing the limitations of traditional role‑based models.

access controlcryptographydata security
0 likes · 5 min read
Threshold Proxy Re‑Encryption (TPRE) with National Cryptographic Algorithms for Secure Data Sharing
Architecture Digest
Architecture Digest
Apr 23, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide

This article provides a comprehensive technical overview of Kafka, covering its core message‑queue value, architecture components such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, resource planning for disks, memory, CPU and network, operational tools and commands, consumer‑group management, rebalance strategies, and internal scheduling mechanisms such as the time‑wheel.

KafkaMessage QueueReplication
0 likes · 30 min read
Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide
Big Data Technology Architecture
Big Data Technology Architecture
Apr 22, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core architecture, explaining how asynchronous decoupling and traffic shaping are achieved, detailing the roles of producers, brokers, consumers, and ZooKeeper, and analyzing the reliability and performance techniques such as ACK policies, replication, idempotent and transactional producers, page‑cache flushing, zero‑copy, compression, batching, and load‑balancing strategies.

Message Queuedistributed systemsreliability
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
JD Retail Technology
JD Retail Technology
Apr 19, 2023 · Databases

Understanding Distributed Data Consistency: CAP, BASE, and Transaction Solutions

This article explains why achieving data consistency in modern distributed systems is challenging, reviews ACID properties of local databases, discusses the CAP and BASE theorems, examines event ordering mechanisms, and compares practical solutions such as two‑phase commit, XA, local message tables, and MQ‑based transaction models.

BASE theoremCAP theoremdata consistency
0 likes · 19 min read
Understanding Distributed Data Consistency: CAP, BASE, and Transaction Solutions
Huolala Tech
Huolala Tech
Apr 17, 2023 · Big Data

How HuoLala Accelerated Ad‑hoc Queries with a Hybrid Offline Engine

This article describes how HuoLala identified slow ad‑hoc query performance in its Hive‑on‑Tez stack, surveyed comparable industry solutions, and built a multi‑engine hybrid offline service that dramatically improves query latency, outlines its architecture, key design decisions, production impact, and future roadmap.

SQL Routingad-hoc querybig data
0 likes · 12 min read
How HuoLala Accelerated Ad‑hoc Queries with a Hybrid Offline Engine
Sanyou's Java Diary
Sanyou's Java Diary
Apr 13, 2023 · Backend Development

Master Dubbo: High‑Performance Java RPC Framework Explained

This comprehensive guide introduces Dubbo, a high‑performance Java RPC framework, covering its core concepts, architecture, configuration methods, load‑balancing and fault‑tolerance strategies, underlying communication mechanisms, and extension points, helping developers build robust distributed applications.

DubboJava RPCbackend development
0 likes · 24 min read
Master Dubbo: High‑Performance Java RPC Framework Explained
ITPUB
ITPUB
Apr 13, 2023 · Fundamentals

Mastering Distributed Transactions: From CAP to BASE and Practical Solutions

This article explains distributed transactions, the reasons they arise, the CAP and BASE theories that guide consistency trade‑offs, and outlines strong, eventual, and weak consistency solutions along with popular frameworks for implementing them in modern distributed systems.

BASE theoryCAP theoryconsistency models
0 likes · 11 min read
Mastering Distributed Transactions: From CAP to BASE and Practical Solutions
政采云技术
政采云技术
Apr 13, 2023 · Backend Development

Understanding the AKF Scale Cube: X, Y, Z Axes for System Scalability and Their Application to Kafka and Redis

The article explains the AKF Scale Cube model—horizontal replication (X axis), functional decomposition (Y axis), and data/service partitioning (Z axis)—and demonstrates how these three scaling dimensions can be applied to backend systems such as Kafka and Redis to achieve high availability, performance, and fault isolation.

AKF Scale CubeKafkaRedis
0 likes · 19 min read
Understanding the AKF Scale Cube: X, Y, Z Axes for System Scalability and Their Application to Kafka and Redis
IT Architects Alliance
IT Architects Alliance
Apr 13, 2023 · Backend Development

WebSocket Load Balancing Across Microservices Using a Single Annotation

This article explains how to solve the WebSocket message‑delivery problem in a micro‑service environment by introducing a lightweight library that uses a custom annotation to automatically forward messages between service instances, with detailed design, configuration, and code examples.

BackendJavaSpring Cloud
0 likes · 12 min read
WebSocket Load Balancing Across Microservices Using a Single Annotation
Java Architect Essentials
Java Architect Essentials
Apr 12, 2023 · Operations

High‑Availability Architecture for a Billion‑Scale Membership System

This article details the design and implementation of a high‑availability, billion‑scale membership system, covering Elasticsearch dual‑center clusters, traffic‑isolated architectures, deep ES optimizations, Redis caching strategies, MySQL migration with dual‑center partitioning, abnormal member relationship handling, and future fine‑grained flow‑control and degradation plans.

ElasticSearchFlow ControlMySQL
0 likes · 20 min read
High‑Availability Architecture for a Billion‑Scale Membership System