Tagged articles

distributed systems

2274 articles · Page 22 of 23
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Nov 20, 2016 · Backend Development

How Meizu Scales Real‑Time Push to 600 M Messages/min: Architecture, Pitfalls & Solutions

The article details Meizu’s real‑time push system that supports 25 million online users and 6 million messages per minute, describing its four‑layer architecture, power‑saving strategies, network‑instability fixes, massive‑connection handling, monitoring practices, and gray‑release deployment techniques.

High Concurrencydistributed systemsmonitoring
0 likes · 12 min read
How Meizu Scales Real‑Time Push to 600 M Messages/min: Architecture, Pitfalls & Solutions
Architecture Digest
Architecture Digest
Nov 19, 2016 · Backend Development

Why Distributed Systems Are Essential for Scaling Internet Services and How to Build Them

The article explains that massive user traffic forces servers to adopt distributed systems to achieve high throughput, concurrency, low latency, and load balancing, and it details architectural patterns, concurrency models, caching, storage, coordination, messaging, transaction, deployment, and monitoring techniques for building and managing such systems.

BackendCachingMessage Queue
0 likes · 39 min read
Why Distributed Systems Are Essential for Scaling Internet Services and How to Build Them
Meituan Technology Team
Meituan Technology Team
Nov 11, 2016 · Operations

Common Service Fault Tolerance Patterns

The article explains how Meituan‑Dianping applies classic fault‑tolerance patterns—timeout and retry, rate limiting/load shedding, circuit breaker, bulkhead isolation, and fallback—to design for failure, prevent cascading service outages, and enhance system stability and high‑availability in a service‑oriented architecture.

Retrybulkheadcircuit breaker
0 likes · 14 min read
Common Service Fault Tolerance Patterns
Architecture Digest
Architecture Digest
Nov 10, 2016 · Operations

Interview with Lu Pengcheng on Mogu Street’s Monitoring System Architecture and Evolution

In this interview, Lu Pengcheng, a platform architect at Mogu Street, discusses the company’s large‑scale e‑commerce architecture, the evolution of its monitoring platform, design choices for high‑availability distributed systems, and future open‑source plans, providing practical insights for engineers and technical managers.

C++distributed systemshigh availability
0 likes · 9 min read
Interview with Lu Pengcheng on Mogu Street’s Monitoring System Architecture and Evolution
dbaplus Community
dbaplus Community
Nov 10, 2016 · Backend Development

Why Distributed Systems Are Essential for Scaling Modern Web Services

The article explains why distributed systems are fundamental for handling massive web traffic, detailing concepts such as high throughput, concurrency, low latency, load balancing, layered architectures, concurrency models, caching, NoSQL storage, fault tolerance, scaling, deployment, and monitoring, while highlighting practical techniques and challenges.

NoSQLconcurrencydistributed systems
0 likes · 23 min read
Why Distributed Systems Are Essential for Scaling Modern Web Services
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Nov 5, 2016 · Operations

Distributed vs Cluster: What’s the Real Difference and When to Use Each?

This article explains the core differences between distributed systems and clusters, detailing their architectures, efficiency goals, typical use cases such as Hadoop MapReduce and load‑balancing clusters, and outlines key concepts like scalability, high availability, load balancing, and error recovery.

Cluster ComputingHPCdistributed systems
0 likes · 10 min read
Distributed vs Cluster: What’s the Real Difference and When to Use Each?
Architects' Tech Alliance
Architects' Tech Alliance
Nov 3, 2016 · Industry Insights

Scaling Billion‑Level Ads: Architecture Lessons from Sogou’s Senior Engineer

In this interview, Sogou architect Liu Jian shares how his team built a highly available, scalable commercial advertising platform, discusses the evolution of its infrastructure, offers practical advice for engineers aspiring to become architects, and reflects on emerging technologies and time‑management strategies.

Sogouarchitecturebig data
0 likes · 10 min read
Scaling Billion‑Level Ads: Architecture Lessons from Sogou’s Senior Engineer
Meituan Technology Team
Meituan Technology Team
Oct 28, 2016 · Big Data

Design and Architecture of the CAT Real-Time Monitoring System

The CAT real‑time monitoring system, open‑sourced in 2014 for Java applications, combines a lightweight ThreadLocal‑based client SDK, Netty‑driven asynchronous transport, and a highly scalable backend that processes ~100 TB of logs daily across 70 machines, using custom binary serialization, in‑memory modeling, segmented storage with 48‑bit indexing, and hourly aggregation to provide near‑full‑volume fault detection, localization, and performance analysis.

Javaarchitecturedistributed systems
0 likes · 18 min read
Design and Architecture of the CAT Real-Time Monitoring System
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 27, 2016 · Big Data

Inside Taobao’s Massive Data Architecture: How 1.5 PB Daily Is Processed and Served

The article explains Taobao’s five‑layer data product architecture—covering data sources, compute, storage, query, and product layers—and describes how massive volumes of data are ingested, processed in batch and streaming, stored in MySQL and HBase clusters, and served efficiently through a unified middle‑layer and sophisticated caching mechanisms.

CachingHBaseHadoop
0 likes · 15 min read
Inside Taobao’s Massive Data Architecture: How 1.5 PB Daily Is Processed and Served
ITPUB
ITPUB
Oct 22, 2016 · Backend Development

Designing Scalable High‑Concurrency Architecture: Practical Strategies and Patterns

This guide explains how to design and test high‑concurrency systems by choosing appropriate server architectures, load‑balancing, database clustering, caching layers, message queues, first‑level caches, and static data strategies to ensure smooth operation under heavy user traffic.

CachingHigh ConcurrencyLoad Testing
0 likes · 12 min read
Designing Scalable High‑Concurrency Architecture: Practical Strategies and Patterns
High Availability Architecture
High Availability Architecture
Oct 20, 2016 · Big Data

Understanding HDFS EditLog Format and Quorum Journal Manager Recovery Process

This article explains the HDFS EditLog file structure, the design of the Quorum Journal Manager for high‑availability, the write‑path optimizations such as batch flushing and double‑buffering, and the detailed Multi‑Paxos based recovery algorithm including isolation, segment selection, prepare and accept phases, and handling journal node failures.

EditLogHDFSPaxos
0 likes · 12 min read
Understanding HDFS EditLog Format and Quorum Journal Manager Recovery Process
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 16, 2016 · Big Data

Mastering Data Sync, Real-Time Analytics, and Scalable Storage for Modern Systems

This article explains how to design and implement heterogeneous data synchronization, leverage batch and stream processing frameworks like Hadoop and Storm for large‑scale analysis, and choose appropriate storage solutions—from in‑memory databases to distributed column‑family stores—while addressing performance, reliability, and monitoring in complex distributed environments.

big datadata synchronizationdatabases
0 likes · 26 min read
Mastering Data Sync, Real-Time Analytics, and Scalable Storage for Modern Systems
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 15, 2016 · Operations

How E‑Commerce Platforms Achieve High Availability and Scalability: Architecture Practices

This article outlines comprehensive e‑commerce platform architecture practices—including caching strategies, indexing, parallel and distributed computing, load balancing, sharding, high availability, monitoring, resource optimization, and messaging—to improve system performance, scalability, and reliability under high concurrency.

Cachingarchitecturedistributed systems
0 likes · 28 min read
How E‑Commerce Platforms Achieve High Availability and Scalability: Architecture Practices
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 8, 2016 · Fundamentals

Mastering Distributed Systems: Overcoming Network Challenges and Consistency Trade‑offs

This article explores the core difficulties of distributed systems—including network latency, failures, the CAP theorem, consistency models, and common techniques such as consistent hashing, quorum, vector clocks, lease mechanisms, gossip protocols, and distributed transaction protocols—providing practical insights and references for building robust scalable architectures.

CAP theoremNWR quorumconsistency models
0 likes · 22 min read
Mastering Distributed Systems: Overcoming Network Challenges and Consistency Trade‑offs
Nightwalker Tech
Nightwalker Tech
Sep 12, 2016 · Databases

Technical Discussion on Learning Strategies, MySQL Replication, High Availability, PHP Coroutines, and Nginx Proxy

A community discussion covers practical ways to improve personal skills, detailed MySQL master‑slave and high‑availability setups, PHP coroutine mechanisms, and the behavior of Nginx when proxying image resources, providing insights into learning, database management, concurrency, and proxy configurations.

MySQLPHPdistributed systems
0 likes · 12 min read
Technical Discussion on Learning Strategies, MySQL Replication, High Availability, PHP Coroutines, and Nginx Proxy
Architecture Digest
Architecture Digest
Sep 9, 2016 · Backend Development

Designing a High‑Concurrency, Reliable Backend Architecture for JD E‑Commerce

The article examines how JD’s e‑commerce platform tackles massive traffic spikes and high concurrency by employing modular system decomposition, distributed architecture, API‑centric services, performance tuning, and virtual elasticity to ensure stability, scalability, and a smooth user experience during major promotional events.

API ServiceHigh Concurrencybackend architecture
0 likes · 7 min read
Designing a High‑Concurrency, Reliable Backend Architecture for JD E‑Commerce
dbaplus Community
dbaplus Community
Sep 6, 2016 · Big Data

Choosing the Right Log Collection Framework for Massive Data Streams

This article reviews major open‑source log collection tools—Chukwa, Scribe, Flume, Logstash, Kafka, and TT—examining their architectures, strengths, and limitations to help engineers select the most suitable solution for high‑volume, low‑latency data pipelines.

Apache FlumeKafkaLog Collection
0 likes · 13 min read
Choosing the Right Log Collection Framework for Massive Data Streams
Efficient Ops
Efficient Ops
Sep 5, 2016 · Operations

Inside Google’s Data Centers: How SRE Manages Hardware, Borg, and Global Services

This article explains how Google’s Site Reliability Engineering team designs and operates uniform hardware in its data centers, uses the Borg cluster manager, implements storage layers, SDN networking, monitoring, and a sample Shakespeare search service to achieve high‑availability, scalable production services.

BorgGoogle SREInfrastructure
0 likes · 21 min read
Inside Google’s Data Centers: How SRE Manages Hardware, Borg, and Global Services
ITPUB
ITPUB
Aug 30, 2016 · Databases

How to Build a Distributed KV Store with Full ACID Guarantees

This talk walks through the evolution of databases, explains the challenges of building a distributed key‑value system that provides full ACID properties, and details the architectural components, sharding, migration, snapshot isolation, two‑phase commit, timestamp handling, and distributed transaction processing techniques.

ACIDNewSQLRaft
0 likes · 13 min read
How to Build a Distributed KV Store with Full ACID Guarantees
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Aug 23, 2016 · Fundamentals

Why Git Beats SVN: Real‑World Scenarios Every Developer Should Know

The article explains the three main types of version control systems, contrasts centralized tools like SVN with distributed ones like Git, and illustrates through three developer scenarios how Git’s branching and conflict‑resolution features simplify collaboration, speed up workflows, and avoid common pitfalls.

Gitdistributed systemsversion control
0 likes · 5 min read
Why Git Beats SVN: Real‑World Scenarios Every Developer Should Know
Java High-Performance Architecture
Java High-Performance Architecture
Aug 21, 2016 · Fundamentals

How ZooKeeper Leader Election Ensures High Availability in Distributed Systems

ZooKeeper's leader election mechanism creates temporary sequential nodes under a shared /ELECTION path, allowing services to elect a primary node, monitor predecessor nodes, and automatically re-elect a new leader when the current one fails, ensuring continuous high availability across distributed applications.

Leader ElectionZooKeeperdistributed systems
0 likes · 6 min read
How ZooKeeper Leader Election Ensures High Availability in Distributed Systems
Efficient Ops
Efficient Ops
Aug 1, 2016 · Operations

How Tencent Shifted 70M Users During Tianjin Explosion – A Multi‑Active Ops Playbook

This article details how Tencent's operations team orchestrated a seamless, zero‑impact migration of over 70 million users across three data centers during the 2015 Tianjin explosion, highlighting the four key capabilities—distribution, scheduling, data synchronization, and automated operations—that enabled multi‑active disaster recovery at massive scale.

data synchronizationdisaster recoverydistributed systems
0 likes · 22 min read
How Tencent Shifted 70M Users During Tianjin Explosion – A Multi‑Active Ops Playbook
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Aug 1, 2016 · Databases

What Is NFV and Why Databases Are Its Brain?

This article explains Network Function Virtualization (NFV), its advantages over traditional telecom hardware, the critical role of distributed high‑performance databases in enabling elastic scaling, rapid service rollout, and telecom‑grade reliability, and outlines the challenges of unifying database solutions for NFV.

NFVNetwork Function Virtualizationdistributed systems
0 likes · 6 min read
What Is NFV and Why Databases Are Its Brain?
Architect
Architect
Jul 14, 2016 · Backend Development

Using Multiple Streams and Groups in Apache Storm Topology

This article explains how to declare and emit multiple stream IDs in Apache Storm, demonstrates code examples for MultiStream and MultiGroup patterns, discusses common pitfalls, and shows how to abstract stream declarations and bolt configurations for more flexible and dynamic topologies.

Apache StormJavadistributed systems
0 likes · 9 min read
Using Multiple Streams and Groups in Apache Storm Topology

Designing a Business‑Oriented High Availability Architecture for a Game Access System

The article presents a business‑centric high‑availability solution for a large‑scale game access platform, detailing measurable goals, a three‑dimensional architecture that includes client‑side retry, HTTP‑DNS, functional separation, multi‑region active‑active deployment, and automated, visual monitoring to achieve rapid problem detection, recovery, and minimal outage frequency.

business continuitydistributed systemsfault tolerance
0 likes · 23 min read
Designing a Business‑Oriented High Availability Architecture for a Game Access System
DevOps
DevOps
Jul 8, 2016 · Fundamentals

Understanding Version Control Systems: From Manual Practices to Distributed VCS

This article explains the principles of version control systems, illustrating the evolution from manual file‑locking methods to modern distributed workflows with checkout, check‑in, merging, branching, and collaborative features exemplified by the custom Hit and HitHub platforms.

Gitcollaborationdistributed systems
0 likes · 11 min read
Understanding Version Control Systems: From Manual Practices to Distributed VCS
Baidu Intelligent Testing
Baidu Intelligent Testing
Jul 7, 2016 · Operations

Challenges and Pain Points of Distributed System Integration Testing

This article examines the common pain points of integration testing in distributed systems, including weak cross‑coupling coverage, lack of clear standards, chaotic composite scenarios, and insufficient risk assessment, and discusses current mitigation approaches and open questions for future exploration.

distributed systemsintegration testingrisk assessment
0 likes · 7 min read
Challenges and Pain Points of Distributed System Integration Testing
Architecture Digest
Architecture Digest
Jul 6, 2016 · Backend Development

Designing a Message Queue: Key Considerations and Architecture

The article explains why and when to use message queues, then walks through designing one from scratch, covering decoupling, eventual consistency, broadcast, flow control, RPC protocols, high availability, storage choices, consumer relationships, reliable delivery, transactions, performance optimizations, and push versus pull models.

Message QueueRPCasynchronous
0 likes · 35 min read
Designing a Message Queue: Key Considerations and Architecture
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jul 4, 2016 · Backend Development

Understanding Microservice Architecture: Principles, Characteristics, and Deployment

The article explains microservice architecture as a lightweight, service‑oriented approach where each service performs a single, well‑defined function, runs in its own process with an independent database, can be deployed separately on various platforms, and communicates via HTTP or other lightweight protocols, highlighting its key characteristics and benefits.

distributed systemsmicroservicesservice-oriented architecture
0 likes · 13 min read
Understanding Microservice Architecture: Principles, Characteristics, and Deployment
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 30, 2016 · Backend Development

Evolution of 58.com Architecture: From a Single‑Server All‑In‑One to a Scalable Service‑Oriented System

The article chronicles how 58.com’s website architecture evolved from a tiny, single‑machine setup to a distributed, service‑oriented platform by progressively addressing scaling challenges with LAMP, read/write separation, vertical business splitting, caching, cloud‑native services, and automation, illustrating the practical steps needed as traffic grows from tens of thousands to billions of requests.

Backendarchitecturedistributed systems
0 likes · 15 min read
Evolution of 58.com Architecture: From a Single‑Server All‑In‑One to a Scalable Service‑Oriented System
dbaplus Community
dbaplus Community
Jun 27, 2016 · Backend Development

Why Monoliths Struggle and How Service‑Oriented Architecture Can Help

The article examines the high development and operational costs of traditional monolithic applications, outlines service‑oriented solutions such as splitting, decoupling, and layering, details practical implementation techniques like subscription‑publish mechanisms, fault isolation, and governance, and discusses the limits and future evolution toward microservices.

DevOpsService Governancedistributed systems
0 likes · 23 min read
Why Monoliths Struggle and How Service‑Oriented Architecture Can Help
Qunar Tech Salon
Qunar Tech Salon
Jun 24, 2016 · Backend Development

Overview of Alibaba's Open Source Projects

This article provides a comprehensive overview of Alibaba's numerous open‑source projects, ranging from high‑performance service frameworks and databases to messaging middleware, frontend tools, testing platforms, and infrastructure utilities, highlighting their key features and typical use cases.

AlibabaBackendbig data
0 likes · 22 min read
Overview of Alibaba's Open Source Projects
dbaplus Community
dbaplus Community
Jun 23, 2016 · Backend Development

Mastering Rate Limiting: Algorithms, Application, Distributed and Edge Strategies

This article provides a comprehensive guide to rate limiting in high‑concurrency systems, covering core concepts, token‑bucket and leaky‑bucket algorithms, application‑level techniques with Guava, distributed implementations using Redis+Lua and Nginx+Lua, and edge‑layer controls via Nginx modules, complete with configuration examples and test results.

Guavadistributed systemsleaky-bucket
0 likes · 28 min read
Mastering Rate Limiting: Algorithms, Application, Distributed and Edge Strategies
WeChat Client Technology Team
WeChat Client Technology Team
Jun 22, 2016 · Fundamentals

Understanding Production‑Grade Paxos: How PhxPaxos Works and Its Engineering Secrets

This article explains the core principles and engineering details of the production‑grade Paxos library PhxPaxos, covering consistency concepts, the roles of proposer, acceptor and learner, instance management, state‑machine integration, performance optimizations, checkpointing, and correctness verification in distributed asynchronous environments.

ConsensusPaxosPhxPaxos
0 likes · 29 min read
Understanding Production‑Grade Paxos: How PhxPaxos Works and Its Engineering Secrets
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 19, 2016 · Backend Development

Master Rate Limiting: Token & Leaky Buckets, Distributed Strategies

This article explains how caching, degradation, and especially rate limiting—using token bucket, leaky bucket, and counter‑based methods—protect high‑concurrency systems, covering algorithm basics, application‑level techniques, and distributed implementations with Redis+Lua and Nginx+Lua.

distributed systemsleaky-bucketrate limiting
0 likes · 18 min read
Master Rate Limiting: Token & Leaky Buckets, Distributed Strategies
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 19, 2016 · Backend Development

How to Tackle Common Cache Problems in Distributed Systems

This article explores typical cache challenges in distributed systems—including data consistency, high availability, cache avalanche, and cache penetration—explaining their causes, real‑world scenarios, and practical mitigation strategies to ensure reliable and efficient caching.

Cache AvalancheCache Penetrationcache
0 likes · 9 min read
How to Tackle Common Cache Problems in Distributed Systems
Tencent Music Tech Team
Tencent Music Tech Team
Jun 17, 2016 · Backend Development

Design Considerations for a High‑Scale Messaging System: Capacity Estimation, Consistency Guarantees, and Avalanche Prevention

Designing Quanmin K‑Song’s high‑scale messaging system requires careful capacity estimation of throughput, storage and network traffic, robust consistency via unique transaction IDs and operation logs, and avalanche prevention through selective retries, scaling and priority‑based throttling to maintain reliability under load.

Consistencyavalanche preventionbackend design
0 likes · 7 min read
Design Considerations for a High‑Scale Messaging System: Capacity Estimation, Consistency Guarantees, and Avalanche Prevention
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 16, 2016 · Backend Development

Optimizing Large‑Scale E‑Commerce Site Architecture: Business Splitting, Clustering, Caching & SSO

This article examines the analysis and optimization of a high‑traffic e‑commerce website, covering problems such as server waste and tight coupling, and presenting solutions including business splitting, application clustering, multi‑level caching, distributed sessions, and deployment diagrams to improve scalability and reliability.

BackendCachingSession Management
0 likes · 7 min read
Optimizing Large‑Scale E‑Commerce Site Architecture: Business Splitting, Clustering, Caching & SSO
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 12, 2016 · Backend Development

Designing a Scalable E‑Commerce Architecture: From Simple Setup to Distributed Systems

This article walks through the functional and non‑functional requirements of a B2C e‑commerce platform, illustrates a progression from a three‑server starter architecture to a clustered high‑availability design, and details capacity‑planning calculations for supporting millions of users and peak traffic spikes.

Backendarchitecturecapacity planning
0 likes · 9 min read
Designing a Scalable E‑Commerce Architecture: From Simple Setup to Distributed Systems
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 9, 2016 · Operations

Mastering Load Balancing: Principles, Types, and Practical Tips

This article explains how load balancing solves high‑traffic, high‑concurrency challenges by distributing requests across multiple servers, covering its core principles, vertical and horizontal scaling, various classification methods such as DNS, IP, link‑layer, and hybrid approaches, along with their advantages, drawbacks, and deployment recommendations.

distributed systemshigh availabilityhorizontal scaling
0 likes · 10 min read
Mastering Load Balancing: Principles, Types, and Practical Tips
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 9, 2016 · Fundamentals

Distributed vs Cluster: Key Differences and When to Use Each

This article explains the core distinctions between distributed systems and clusters, covering their architectures, efficiency goals, typical use cases, and examples such as Hadoop MapReduce and load‑balancing clusters, while also detailing cluster types, high‑availability, load balancing, and high‑performance computing.

Cluster Computingdistributed systemshigh availability
0 likes · 10 min read
Distributed vs Cluster: Key Differences and When to Use Each
21CTO
21CTO
Jun 7, 2016 · Operations

Mastering Load Balancing: Lessons from Alibaba’s VIPServer Journey

This article explores the fundamentals and advanced techniques of load balancing, compares DNS round‑robin with dedicated load balancers, discusses scaling strategies, health‑check mechanisms, and introduces Alibaba’s VIPServer as a modern mid‑tier solution addressing real‑world operational challenges.

Cloud OperationsVIPServerdistributed systems
0 likes · 21 min read
Mastering Load Balancing: Lessons from Alibaba’s VIPServer Journey
Architecture Digest
Architecture Digest
Jun 5, 2016 · Backend Development

Web System Load Balancing, Caching, and Scaling Strategies for High Traffic

This article explains how to design and optimize web system architecture—including load‑balancing methods, multi‑level caching, MySQL scaling, distributed deployment, and disaster‑recovery techniques—to handle traffic growth from hundreds of thousands to hundreds of millions of daily visits.

CachingMySQLWeb Scaling
0 likes · 19 min read
Web System Load Balancing, Caching, and Scaling Strategies for High Traffic
Architecture Digest
Architecture Digest
May 24, 2016 · Game Development

Evolution of Game Server Architectures: From Early MUDs to Modern Action MMOs

This article traces the historical progression of game server architectures—from simple HTTP‑based servers for low‑interaction mobile games, through the first‑generation MUDOS engine, second‑generation database‑driven designs, third‑generation seamless world nodes with dynamic load balancing, to specialized Battle.net, casual, and modern action MMO server models—highlighting the technical motivations and challenges at each stage.

MMONetworkingdistributed systems
0 likes · 18 min read
Evolution of Game Server Architectures: From Early MUDs to Modern Action MMOs
Java High-Performance Architecture
Java High-Performance Architecture
May 23, 2016 · Cloud Native

What Uber’s Microservices Reveal About the Pros and Cons of Distributed Architecture

Uber’s adoption of microservices showcases both the flexibility of using multiple languages and independent release cycles, while also exposing challenges such as duplicated effort across teams, type‑unsafe JSON interfaces, and the need for rigorous failure testing, offering valuable lessons for large‑scale system design.

Type SafetyUberarchitecture
0 likes · 5 min read
What Uber’s Microservices Reveal About the Pros and Cons of Distributed Architecture
Architecture Digest
Architecture Digest
May 22, 2016 · Big Data

Design and Architecture of Youzan Unified Log Platform

The article details the design, components, and operational challenges of Youzan's unified log platform, describing its multi‑layer architecture, ingestion methods using rsyslog/logstash and Flume‑NG, Kafka‑based log center, processing pipelines with Storm/Spark, and storage in HDFS and Elasticsearch.

FlumeKafkadistributed systems
0 likes · 10 min read
Design and Architecture of Youzan Unified Log Platform
Architecture Digest
Architecture Digest
May 19, 2016 · Backend Development

Design Principles and Practices for Scalable Distributed Web Systems

This article explains the key design principles—availability, performance, reliability, scalability, manageability and cost—and practical techniques such as service decomposition, redundancy, partitioning, caching, proxying, indexing, load balancing and queuing that enable large‑scale web applications to remain fast, reliable and cost‑effective.

Cachingdistributed systemsload balancing
0 likes · 34 min read
Design Principles and Practices for Scalable Distributed Web Systems
Architect
Architect
May 16, 2016 · Operations

Centralized Log Collection for Distributed Docker Services Using Flume and Kafka

This article presents a practical architecture for centrally collecting dispersed logs from Docker‑based services in a distributed environment by leveraging Flume NG as a non‑intrusive log agent, Kafka as a high‑throughput message bus, and custom sinks to partition logs by service, module, and day.

DockerKafkaLog Collection
0 likes · 15 min read
Centralized Log Collection for Distributed Docker Services Using Flume and Kafka
ITPUB
ITPUB
May 12, 2016 · Databases

How a Chinese FinTech Built a Scalable MySQL Cloud Platform for Billions of Transactions

Facing rapid growth and regulatory pressure in 2015, a leading Chinese internet finance firm partnered with Shanghai Aikesheng to design a multi‑stage, MySQL‑based cloud database solution—starting with a private cloud trial, then disaster‑recovery, distributed clustering for massive red‑packet traffic, and finally evolving into an enterprise‑grade PaaS offering.

DBaaSDatabase CloudFinTech
0 likes · 9 min read
How a Chinese FinTech Built a Scalable MySQL Cloud Platform for Billions of Transactions
Big Data and Microservices
Big Data and Microservices
May 12, 2016 · Industry Insights

How 58 Daojia Built a Scalable Real‑Time Messaging Platform: Architecture Deep Dive

This article dissects the design of 58 Daojia’s universal real‑time messaging platform, detailing the challenges of end‑to‑cloud, cloud‑to‑end, and end‑to‑end communication, the shortcomings of traditional HTTP and push solutions, and the optimized TCP, message‑bus, RPC, and protocol extensions that achieve scalability, reliability, and cross‑account chat.

Message QueueProtocol DesignReal-time messaging
0 likes · 12 min read
How 58 Daojia Built a Scalable Real‑Time Messaging Platform: Architecture Deep Dive
Architect
Architect
May 9, 2016 · Backend Development

Understanding Distributed Caching and the memcached Architecture

This article explains the fundamentals of caching, describes how memcached works as a distributed in‑memory cache, and details the hashing algorithms—including remainder hashing and consistent hashing with virtual nodes—used by clients to achieve scalable cache distribution.

CachingMemcachedconsistent hashing
0 likes · 7 min read
Understanding Distributed Caching and the memcached Architecture
Big Data and Microservices
Big Data and Microservices
May 9, 2016 · Industry Insights

How Major E‑Commerce Sites Evolve Their Architecture for Scale and Performance

This article traces the step‑by‑step evolution of large‑scale website architectures—from single‑server setups to distributed services—highlighting key techniques such as server clustering, caching, load balancing, database sharding, CDN usage, and the adoption of NoSQL and micro‑service frameworks.

Cachingarchitecturedatabase sharding
0 likes · 9 min read
How Major E‑Commerce Sites Evolve Their Architecture for Scale and Performance

How eBay Scales to Billions: 7 Proven Practices for Massive Web Systems

This article outlines eBay's seven key scalability best practices—including functional partitioning, horizontal sharding, avoiding distributed transactions, asynchronous decoupling, stream processing, virtualization, and strategic caching—to illustrate how large‑scale web platforms can achieve linear resource growth and high availability.

Cachingarchitectureasynchronous
0 likes · 14 min read
How eBay Scales to Billions: 7 Proven Practices for Massive Web Systems
Architecture Digest
Architecture Digest
May 5, 2016 · Fundamentals

Understanding Distributed Systems and Cluster Architectures: Concepts, Examples, and Strategies

This article explains the fundamental differences between distributed systems and clusters, illustrates them with real‑world examples such as Dubbo, Elasticsearch and Git, and details various cluster types, high‑availability and load‑balancing strategies, as well as fault‑tolerance mechanisms.

DubboElasticSearchdistributed systems
0 likes · 12 min read
Understanding Distributed Systems and Cluster Architectures: Concepts, Examples, and Strategies
21CTO
21CTO
May 4, 2016 · Operations

Mastering Load Balancing: Principles, Types, and Algorithms Explained

This article provides a comprehensive overview of load balancing, covering its core principles, the distinction between vertical and horizontal scaling, various classifications such as DNS, HTTP, IP, link‑layer, and hybrid approaches, as well as common algorithms and hardware considerations for high‑availability, high‑performance systems.

distributed systemshigh availabilityload balancing
0 likes · 11 min read
Mastering Load Balancing: Principles, Types, and Algorithms Explained
Architecture Digest
Architecture Digest
May 3, 2016 · Backend Development

Message Patterns and Their Application in Distributed Enterprise Systems

The article examines various messaging patterns—Message Channel, Publisher‑Subscriber, Message Router, and others—explaining their principles, advantages, and implementation details, and illustrates their use in enterprise distributed architectures through concrete code examples and case studies such as CIMS and a medical system.

Message QueueRabbitMQdistributed systems
0 likes · 31 min read
Message Patterns and Their Application in Distributed Enterprise Systems
Architect
Architect
Apr 27, 2016 · Backend Development

Understanding the Layered Architecture of the Dubbo Distributed Service Framework

This article explains Dubbo’s ten‑layer architecture, detailing each layer’s responsibilities, the service definition, registration, monitoring, communication protocols, and the package structure that together enable a flexible, decoupled distributed RPC system for backend development.

distributed systemsservice architecture
0 likes · 10 min read
Understanding the Layered Architecture of the Dubbo Distributed Service Framework
21CTO
21CTO
Apr 19, 2016 · Backend Development

How Alibaba’s Notify and MetaQ Power Massive E‑Commerce Messaging

This article explains the design principles, architecture, and performance optimizations of Alibaba's Notify and MetaQ message middleware, illustrating how they achieve reliable asynchronous communication, high scalability, and low latency for billions of messages during peak e‑commerce events like Double 11.

Message Queuebackend architecturedistributed systems
0 likes · 14 min read
How Alibaba’s Notify and MetaQ Power Massive E‑Commerce Messaging
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Apr 15, 2016 · Cloud Computing

How Meizu Optimized Cloud Sync: Architecture, Protocols, and Performance Insights

This article provides an in‑depth technical overview of Meizu's cloud sync service, covering its business scenarios, the evolution of its core SyncML‑based protocols, modular architecture across multiple data centers, performance optimizations such as traffic reduction and connection handling, as well as high‑availability, security, and future SDK‑API extensions.

Protocol Designcloud syncdistributed systems
0 likes · 25 min read
How Meizu Optimized Cloud Sync: Architecture, Protocols, and Performance Insights
21CTO
21CTO
Apr 14, 2016 · Cloud Computing

How Netflix’s EVCache Powers Global Low‑Latency Caching Across Regions

This article explains how Netflix uses the open‑source EVCache system, built on Memcached and Kafka, to provide highly reliable, low‑latency caching for its micro‑services architecture across multiple AWS regions, handling billions of objects and millions of requests per second.

CachingCloud ComputingEVCache
0 likes · 9 min read
How Netflix’s EVCache Powers Global Low‑Latency Caching Across Regions
Architect
Architect
Apr 13, 2016 · Backend Development

Understanding Diamond: Alibaba’s Distributed Persistent Configuration System

The article explains Diamond, Alibaba’s internal distributed configuration management system, covering its purpose, core features, persistence and disaster‑recovery mechanisms, architectural diagram, and detailed client‑side implementation including subscription workflow and key code components.

AlibabaJavadistributed systems
0 likes · 6 min read
Understanding Diamond: Alibaba’s Distributed Persistent Configuration System
21CTO
21CTO
Apr 8, 2016 · Backend Development

Mastering Flash Sale Systems: Architecture, Challenges, and High‑Concurrency Solutions

This article explores the complete design of a flash‑sale (秒杀) system, covering business flow, technical bottlenecks, architectural principles, frontend, site and service layer designs, database sharding, caching, overload protection, anti‑cheating measures, and data‑safety strategies for handling massive concurrent traffic.

CachingOptimistic Lockingdistributed systems
0 likes · 34 min read
Mastering Flash Sale Systems: Architecture, Challenges, and High‑Concurrency Solutions
Architecture Digest
Architecture Digest
Apr 8, 2016 · Operations

Practical Fault‑Tolerance Practices in a Large‑Scale Activity Operations Platform

This article shares the author’s experience building fault‑tolerance for Tencent’s activity operations platform, covering retry strategies, automatic removal of unhealthy machines, timeout tuning, asynchronous processing, anti‑replay mechanisms, service degradation, service decoupling, and business‑level safeguards to reduce manual alarm handling and improve system robustness.

Retrydistributed systemsfault tolerance
0 likes · 21 min read
Practical Fault‑Tolerance Practices in a Large‑Scale Activity Operations Platform

Typical Use Cases and Implementation Details of etcd in Distributed Systems

This article introduces etcd, a highly‑available key‑value store based on the Raft algorithm, and explores its classic use cases such as service discovery, messaging, load balancing, distributed coordination, locks, queues, monitoring, leader election, and compares it with ZooKeeper, highlighting its simplicity, security, and cloud‑native advantages.

Raftcloud nativedistributed systems
0 likes · 19 min read
Typical Use Cases and Implementation Details of etcd in Distributed Systems
Architecture Digest
Architecture Digest
Apr 7, 2016 · Backend Development

Evolution of 58 Bangbang IM System Architecture Across Four Phases

This article chronicles the four-stage evolution of the 58 Bangbang instant messaging platform’s architecture—from a traditional IM system to a merchant management platform, then to a mobile marketing tool, and finally to a high‑throughput mobile push solution—detailing design choices, scaling strategies, and technology stacks used.

IM architecturebackend designdistributed systems
0 likes · 11 min read
Evolution of 58 Bangbang IM System Architecture Across Four Phases
Architecture Digest
Architecture Digest
Apr 3, 2016 · Backend Development

Design and Implementation of Albianj Distributed Framework Components

The article details the design and implementation of Albianj's core backend components—including distributed lock considerations, unique ID generators, logging, caching, dynamic configuration, and RESTful services—highlighting their architecture, operational principles, and the practical benefits observed in real-world deployments.

AlbianjCachingRESTful
0 likes · 22 min read
Design and Implementation of Albianj Distributed Framework Components
21CTO
21CTO
Mar 25, 2016 · Operations

How Different Load‑Balancing Strategies Impact Reliability in Distributed Systems

This article examines common load‑balancing algorithms—round‑robin, random, minimum response time, minimum concurrency, and hash—analyzing their fault‑tolerance in distributed clusters, deriving success‑rate formulas, and showing why strategies like minimum concurrency outperform simple methods under node failures.

distributed systemsfault toleranceload balancing
0 likes · 12 min read
How Different Load‑Balancing Strategies Impact Reliability in Distributed Systems
MaGe Linux Operations
MaGe Linux Operations
Mar 24, 2016 · Backend Development

Boost System Performance: Mastering Message Queues and Their Use Cases

This article explains the fundamentals of message queue middleware, outlines common scenarios such as asynchronous processing, application decoupling, traffic shaping, logging, and communication, and provides concrete examples and architectural diagrams illustrating how queues improve performance, scalability, and reliability in distributed systems.

asynchronous-processingdistributed systemssystem architecture
0 likes · 10 min read
Boost System Performance: Mastering Message Queues and Their Use Cases
21CTO
21CTO
Mar 24, 2016 · Backend Development

How to Build a Reliable Java Delayed Queue for Scalable Backend Systems

This article explains the design, architecture, and implementation details of a Java-based delayed queue, covering use cases, core components, message lifecycle, protocol, current topology, shortcomings, and future improvements for reliable backend processing.

Message Queuebackend architecturedelayed queue
0 likes · 10 min read
How to Build a Reliable Java Delayed Queue for Scalable Backend Systems
Architecture Digest
Architecture Digest
Mar 23, 2016 · Backend Development

Design and Challenges of a High‑Concurrency Flash‑Sale (Seckill) System

This article analyses the business characteristics of flash‑sale (seckill) activities, identifies technical challenges such as request spikes, database load, network bandwidth, and cheating, and presents a layered architecture with frontend, site, service, and database designs, concurrency‑queue choices, code examples, and mitigation strategies for high‑concurrency environments.

CachingHigh ConcurrencyJava
0 likes · 32 min read
Design and Challenges of a High‑Concurrency Flash‑Sale (Seckill) System
Architecture Digest
Architecture Digest
Mar 22, 2016 · Backend Development

Evolution of LinkedIn’s Backend Architecture: From the Leo Monolith to a Scalable Service‑Oriented Platform

The article chronicles LinkedIn’s journey from a single‑server Leo monolith to a highly distributed, service‑oriented backend architecture, detailing the introduction of member graphs, read‑only replicas, caching layers, Kafka pipelines, Rest.li APIs, super‑blocks, and multi‑data‑center deployments to support billions of daily requests.

KafkaLinkedInRest.li
0 likes · 9 min read
Evolution of LinkedIn’s Backend Architecture: From the Leo Monolith to a Scalable Service‑Oriented Platform
21CTO
21CTO
Mar 20, 2016 · Backend Development

How LinkedIn Scaled to 350 Million Users: From Leo Monolith to 750+ Microservices

LinkedIn grew from a single monolithic Leo server handling all web requests to a complex ecosystem of over 750 independent services, employing graph databases, read replicas, caching layers, Kafka pipelines, Rest.li APIs, and multi‑data‑center deployments to support billions of daily queries.

CachingKafkaRest.li
0 likes · 9 min read
How LinkedIn Scaled to 350 Million Users: From Leo Monolith to 750+ Microservices
Architecture Digest
Architecture Digest
Mar 20, 2016 · Backend Development

Microservices: Defining the New Architectural Style

This article explains the concept of microservices, contrasts it with monolithic architectures, outlines nine characteristic principles such as componentization, business‑capability‑oriented teams, product thinking, smart endpoints, decentralized governance, polyglot persistence, infrastructure automation, fault‑tolerance, and evolutionary design, and discusses the benefits, challenges, and practical considerations of adopting this style.

distributed systemsmicroservicesscalability
0 likes · 39 min read
Microservices: Defining the New Architectural Style
21CTO
21CTO
Mar 17, 2016 · Operations

How Vipshop’s Three‑Tier Monitoring System Keeps Services Running Smoothly

This article explains Vipshop’s multi‑layer monitoring architecture, detailing system‑level metrics, application‑level tracing with the Mercury platform, and business‑level KPI dashboards, while describing the data pipelines that collect, process, and alert on distributed logs to ensure reliable operations.

Vipshopdistributed systemslog-aggregation
0 likes · 4 min read
How Vipshop’s Three‑Tier Monitoring System Keeps Services Running Smoothly
Java High-Performance Architecture
Java High-Performance Architecture
Mar 16, 2016 · Operations

How Vipshop’s Three‑Tier Monitoring System Keeps Services Running Smoothly

Vipshop’s three‑tier monitoring system—covering system, application (Mercury), and business layers—collects and analyzes logs from distributed components, providing real‑time metrics, slow‑call detection, error tracing, and configurable alerts to help engineers quickly pinpoint and resolve performance issues.

APMAlertingdistributed systems
0 likes · 4 min read
How Vipshop’s Three‑Tier Monitoring System Keeps Services Running Smoothly
21CTO
21CTO
Mar 15, 2016 · Backend Development

Why Multi‑Datacenter Architecture Is Essential for High‑Availability Services

The article explains how multi‑datacenter architectures prevent total service loss, improve latency by placing services near users, and balance the CAP trade‑offs through models like AC, CP, and AP, while outlining practical design, sharding, monitoring, and failover strategies for large‑scale backend systems.

CAP theoremdata consistencydistributed systems
0 likes · 14 min read
Why Multi‑Datacenter Architecture Is Essential for High‑Availability Services
21CTO
21CTO
Mar 12, 2016 · Backend Development

Designing Scalable Asynchronous Message Queues: Ctrip’s Hermes Architecture Deep Dive

This article examines Ctrip's Hermes asynchronous messaging system, detailing its evolution from a simple Mongo‑backed queue to a broker‑centric, partitioned architecture with lease‑based cluster management, and shares practical techniques for building high‑performance, low‑latency message queues in large‑scale distributed environments.

HermesMessage Queuebackend architecture
0 likes · 21 min read
Designing Scalable Asynchronous Message Queues: Ctrip’s Hermes Architecture Deep Dive
Architect
Architect
Mar 12, 2016 · Backend Development

Design and Evolution of Ctrip's Hermes Message Queue System

This article presents a detailed overview of Ctrip's Hermes message queue system, covering its architectural evolution from a simple Mongo‑based design to a broker‑centric, multi‑storage solution with meta‑server coordination, and discusses practical techniques for building high‑performance, scalable messaging infrastructure.

CtripHermesKafka
0 likes · 21 min read
Design and Evolution of Ctrip's Hermes Message Queue System
21CTO
21CTO
Mar 4, 2016 · Backend Development

Inside Taobao’s Billion-Request Engine: Load Balancing, CDN & Big Data

This article explains how Taobao scales to billions of daily page views using DNS‑based load balancing, LVS, domain sharding, CDN nodes, a distributed file system, sophisticated search processing, and massive data storage and real‑time log pipelines.

CDNdistributed systemsload balancing
0 likes · 9 min read
Inside Taobao’s Billion-Request Engine: Load Balancing, CDN & Big Data
21CTO
21CTO
Mar 3, 2016 · Backend Development

Choosing the Right Load Balancing for Microservices: Centralized, In‑Process, Independent

The article explains three primary load‑balancing and service‑discovery patterns for microservice architectures—centralized external load balancers, client‑side soft load balancing, and independent host‑level LB processes—detailing their mechanisms, advantages, drawbacks, and real‑world examples such as F5/HAProxy, Netflix Eureka/Ribbon, and Airbnb SmartStack.

backend architecturedistributed systemsload balancing
0 likes · 5 min read
Choosing the Right Load Balancing for Microservices: Centralized, In‑Process, Independent
Architect
Architect
Feb 29, 2016 · Big Data

Design Principles of Real-Time Distributed Streaming Systems: A Comparison of Spark and Storm

This article examines the design considerations of real-time distributed streaming systems, outlines their background and characteristics, compares the architectures of Spark Streaming and Storm, discusses primitives, message passing, high availability, storage models, and integration with production environments, providing practical insights for architects.

SparkStormdistributed systems
0 likes · 20 min read
Design Principles of Real-Time Distributed Streaming Systems: A Comparison of Spark and Storm
21CTO
21CTO
Feb 27, 2016 · Operations

Mastering Load Balancing: Principles, Types, Algorithms, and Hardware Solutions

Load balancing distributes incoming traffic across multiple servers to enhance performance, ensure high availability, and enable horizontal scaling, with various implementations such as DNS, HTTP, IP, link‑layer, and hybrid methods, each employing algorithms like round‑robin, random, least connections, hash, and weighted distribution, plus hardware options.

Hardwaredistributed systemshigh availability
0 likes · 14 min read
Mastering Load Balancing: Principles, Types, Algorithms, and Hardware Solutions
21CTO
21CTO
Feb 24, 2016 · Backend Development

Designing Scalable E‑Commerce Architecture: From Single‑Server to Distributed Systems

This article presents a comprehensive e‑commerce website architecture case study, detailing functional and non‑functional requirements, initial single‑server design, capacity estimation, and progressive evolution toward a distributed, high‑availability architecture with clustering, caching, load balancing, service‑orientation, and database sharding.

Cachingarchitecturedistributed systems
0 likes · 14 min read
Designing Scalable E‑Commerce Architecture: From Single‑Server to Distributed Systems
Java High-Performance Architecture
Java High-Performance Architecture
Feb 19, 2016 · Fundamentals

How ZooKeeper Powers Distributed Systems: Architecture and Operations Explained

ZooKeeper is an open‑source distributed coordination service that provides high‑performance, reliable primitives such as naming, configuration management, leader election, locks and queues, and its internal design features a leader‑based server cluster, in‑memory hierarchical namespace, and transparent client routing for read/write operations.

Distributed CoordinationLeader ElectionZooKeeper
0 likes · 4 min read
How ZooKeeper Powers Distributed Systems: Architecture and Operations Explained
Java High-Performance Architecture
Java High-Performance Architecture
Feb 14, 2016 · Backend Development

Why Distributed Message Queues Are Essential for Scalable Systems

The article explains the core concepts of message queues and distributed systems, describes how queues act as intermediaries to decouple producers and consumers, outlines benefits such as faster response, reliability, and scalability, and details why a distributed architecture is needed for multi‑system collaboration and fault tolerance.

backend architecturedistributed systemsscalability
0 likes · 3 min read
Why Distributed Message Queues Are Essential for Scalable Systems
21CTO
21CTO
Feb 12, 2016 · Backend Development

Key Challenges in Building High‑Traffic Data‑Intensive Web Platforms

This article examines the critical issues of massive data handling, concurrency, file storage, relational design, indexing, distributed processing, AJAX usage, security, clustering, and OpenAPI trends that developers must address when architecting large, high‑interaction web sites.

Backenddata architecturedistributed systems
0 likes · 8 min read
Key Challenges in Building High‑Traffic Data‑Intensive Web Platforms
Java High-Performance Architecture
Java High-Performance Architecture
Feb 12, 2016 · Backend Development

Mastering Distributed Configuration Management with Zookeeper

Learn how distributed configuration management works—why large systems need a central store, the role of publish/subscribe, and how Zookeeper provides a robust solution for real‑time feature toggling without service restarts, ensuring high availability and seamless operations across micro‑services.

BackendDevOpsconfiguration management
0 likes · 4 min read
Mastering Distributed Configuration Management with Zookeeper
21CTO
21CTO
Feb 9, 2016 · Cloud Computing

How Tencent Cloud Powers WeChat’s Massive New Year Red Envelope Storm

During the Chinese New Year, Tencent Cloud handled billions of WeChat red‑envelope transactions by employing multi‑region load balancing, disaster‑recovery architectures, database sharding, and high‑throughput caching to ensure seamless, high‑availability service for millions of concurrent users.

distributed systemshigh availability
0 likes · 5 min read
How Tencent Cloud Powers WeChat’s Massive New Year Red Envelope Storm