BestHub
Sign in
Tagged articles

distributed systems

2274 articles · Page 23 of 23
21CTO
21CTO
Feb 4, 2016 · Backend Development

Key Principles for Building Scalable Distributed Web Systems

This article outlines essential design principles for large‑scale web architectures—including availability, performance, reliability, scalability, manageability and cost—and demonstrates their application through a detailed image‑hosting service example, covering services, redundancy, partitioning, caching, proxies, indexing, load balancing, and queuing to achieve efficient, scalable data access.

CachingData Partitioningdistributed systems
0 likes · 37 min read
Key Principles for Building Scalable Distributed Web Systems
21CTO
21CTO
Feb 4, 2016 · Backend Development

How Tumblr Scaled to 5 Billion Page Views: Inside Their Distributed Architecture

This article examines how Tumblr handled rapid growth—processing 5 billion daily page views, 40 k requests per second, and terabytes of data—by evolving from a LAMP stack to a Scala‑based, Finagle‑driven distributed system with HBase, Redis, Kafka, and a cell architecture that supports massive real‑time dashboards.

FinagleRedisScala
0 likes · 21 min read
How Tumblr Scaled to 5 Billion Page Views: Inside Their Distributed Architecture
21CTO
21CTO
Feb 4, 2016 · Backend Development

How to Detect Hotspots with a Rate‑Limiting System Using Concurrent LRU Maps

This article explains how a rate‑limiting system can identify hot‑spot resources by using time‑window statistics, a concurrent LRU hash map, and cluster‑wide aggregation to efficiently track and evict low‑frequency keys while maintaining high throughput.

Backend Performanceconcurrent data structuresdistributed systems
0 likes · 9 min read
How to Detect Hotspots with a Rate‑Limiting System Using Concurrent LRU Maps
dbaplus Community
dbaplus Community
Feb 2, 2016 · Databases

Redis Deep Dive: Features, Architecture, and Cluster Management

This article provides a comprehensive overview of Redis, covering its primary use cases, internal network and memory models, data consistency, supported data types, client libraries, replication mechanisms, read‑write separation, eviction policies, cluster architecture, node communication, redirection handling, online reconfiguration, and fault‑tolerance strategies.

ClusterData EvictionReplication
0 likes · 26 min read
Redis Deep Dive: Features, Architecture, and Cluster Management
Efficient Ops
Efficient Ops
Jan 31, 2016 · Cloud Computing

How Meizu Scales Cloud Sync for Millions: Protocols, Architecture, and Data Strategies

This article details Meizu's cloud synchronization service, covering its custom MZ‑SyncML protocol, semi‑sync mechanisms, file and one‑sync protocols, failure handling, service architecture, modular design, massive data routing, multi‑datacenter deployment, traffic optimization, and practical lessons learned.

Protocol Designcloud syncdata routing
0 likes · 14 min read
How Meizu Scales Cloud Sync for Millions: Protocols, Architecture, and Data Strategies
21CTO
21CTO
Jan 28, 2016 · Databases

How LinkedIn Scales Data: Inside Its Multi‑Phase Database Architecture

This article explains how LinkedIn manages real‑time profile updates, news feeds, and social graph data through a three‑phase architecture that combines RDBMS, NoSQL stores, caching, and Lucene indexes to achieve high consistency, availability, and partition tolerance at massive scale.

LinkedInNoSQLdata architecture
0 likes · 11 min read
How LinkedIn Scales Data: Inside Its Multi‑Phase Database Architecture
Qunar Tech Salon
Qunar Tech Salon
Jan 20, 2016 · Cloud Computing

Technical Architecture of Alipay and Ant Huabei for Large-Scale Promotional Events

The article explains how Alipay's multi-layered cloud architecture, logical data center design, distributed data strategies, and flexible transaction framework enable high availability, horizontal scalability, and rapid deployment for massive promotional traffic such as Double‑11, illustrated with the Ant Huabei case study.

AlipayFinancial Technologybig data
0 likes · 21 min read
Technical Architecture of Alipay and Ant Huabei for Large-Scale Promotional Events
Efficient Ops
Efficient Ops
Jan 19, 2016 · Operations

How QQ Achieves Massive Multi‑Region Scheduling and Resilient Operations

This article details Tencent’s QQ large‑scale scheduling architecture, covering multi‑site distribution, rapid dispatch mechanisms, cross‑region data synchronization, automated operation platform ZhiYun, flexible services, overload protection, rapid scaling, and comprehensive monitoring that together enable resilient, high‑performance social services.

Large-Scale SchedulingTencentdistributed systems
0 likes · 15 min read
How QQ Achieves Massive Multi‑Region Scheduling and Resilient Operations
Qunar Tech Salon
Qunar Tech Salon
Jan 16, 2016 · Backend Development

From Zero to One: The Evolution of WeChat’s Backend System Architecture

This article chronicles the two‑month development of WeChat’s backend from its inception, detailing the design of its message model, data‑sync protocol, three‑tier architecture, asynchronous queues, rapid scaling, platformization, multi‑data‑center deployment, disaster‑recovery strategies, performance optimizations, security hardening, and emerging resource‑scheduling challenges.

WeChatdata synchronizationdistributed systems
0 likes · 28 min read
From Zero to One: The Evolution of WeChat’s Backend System Architecture
21CTO
21CTO
Jan 9, 2016 · Backend Development

What Jeff Dean Really Built: From MapReduce to Spanner

This article debunks humorous "facts" about Jeff Dean while highlighting his real contributions to Google’s infrastructure—such as MapReduce, the Google File System, BigTable, and Spanner—and explains how his work shaped modern backend development and big data processing.

BigtableJeff DeanMapReduce
0 likes · 13 min read
What Jeff Dean Really Built: From MapReduce to Spanner
21CTO
21CTO
Dec 30, 2015 · Big Data

Mastering Massive Data: MapReduce, Hadoop, and Taobao’s Architecture

This article introduces the fundamental MapReduce model and Hadoop framework, explains their roles in large‑scale data processing, and then examines Taobao’s massive‑data product architecture—including its data source, compute, storage, query, and product layers, as well as the MyFOX, Prom, and Glider components and caching strategies.

HadoopMapReduceTaobao
0 likes · 16 min read
Mastering Massive Data: MapReduce, Hadoop, and Taobao’s Architecture
Architect
Architect
Dec 30, 2015 · Backend Development

Snapdeal Ads System Architecture: Scaling to 5 Billion Daily Requests

The article details how Snapdeal built a high‑performance, low‑latency ad‑serving platform that handles billions of daily requests by employing horizontal and vertical scaling, AP‑focused CAP choices, in‑memory data structures, and a suite of open‑source backend technologies.

Ad TechBackendHigh Performance
0 likes · 6 min read
Snapdeal Ads System Architecture: Scaling to 5 Billion Daily Requests
21CTO
21CTO
Dec 21, 2015 · Backend Development

How JD.com Scaled Its Product Detail Pages to Billions of Views

This article details JD.com's evolution of product detail page architecture—from early IIS/C# monoliths to a distributed, cache‑heavy, Nginx+Lua system—covering front‑end dimensions, performance metrics, design principles, scaling challenges, storage engine choices, multi‑datacenter deployment, and the lessons learned from numerous production pitfalls.

LuaNginxProduct Detail Page
0 likes · 24 min read
How JD.com Scaled Its Product Detail Pages to Billions of Views
Architect
Architect
Dec 18, 2015 · Fundamentals

Understanding Distributed Consistency: Importance, Models, and Challenges

The article explains why consistency is essential in distributed systems, describes the CAP theorem, outlines various consistency models such as strong, weak, and eventual consistency, and discusses the trade‑offs between data correctness and system performance.

CAP theoremConsistencyconsistency models
0 likes · 9 min read
Understanding Distributed Consistency: Importance, Models, and Challenges
21CTO
21CTO
Dec 9, 2015 · Big Data

Mastering Hadoop: From MapReduce Basics to Taobao’s Massive Data Architecture

This article introduces the fundamental MapReduce model and Hadoop framework, explains their components such as HDFS, MapReduce, and HBase, and then examines Taobao’s large‑scale data product architecture—including storage, computation, query, and caching layers—to illustrate practical big‑data processing techniques.

HadoopMapReducedata architecture
0 likes · 17 min read
Mastering Hadoop: From MapReduce Basics to Taobao’s Massive Data Architecture
Qunar Tech Salon
Qunar Tech Salon
Dec 4, 2015 · Databases

Scaling Massive Data at Alibaba: From Oracle to MySQL Sharding and Distributed Solutions

The article details how Alibaba tackled explosive data growth by migrating from a single Oracle instance to a multi‑source architecture using horizontal and vertical sharding, MySQL clusters, KV stores, and proprietary tools such as Erosa, Otter, and Cobar to achieve high availability, consistency, and performance across multiple IDC sites.

AlibabaData ScalingMySQL
0 likes · 16 min read
Scaling Massive Data at Alibaba: From Oracle to MySQL Sharding and Distributed Solutions
21CTO
21CTO
Nov 25, 2015 · Backend Development

Why Alipay Chose MetaQ: Inside Its High‑Performance Distributed Messaging System

Metamorphosis (MetaQ), Alipay’s open‑source Java‑based distributed messaging middleware, offers high throughput, ordered storage, transaction support, and HA replication, positioning itself as a Kafka‑like solution tailored for massive log, broadcast, and sequential data flows, now powering billions of daily messages for Alipay and Taobao.

JavaKafka AlternativeMetaQ
0 likes · 6 min read
Why Alipay Chose MetaQ: Inside Its High‑Performance Distributed Messaging System
21CTO
21CTO
Nov 21, 2015 · Backend Development

How Large-Scale Websites Evolve Their Architecture for Performance and Scalability

This article traces the evolution of large‑scale website architectures—from single‑server setups to distributed services—detailing how separation of concerns, caching, load balancing, database sharding, CDN, reverse proxies, NoSQL, and service decomposition collectively improve performance, scalability, and reliability.

Cachingdistributed systemsload balancing
0 likes · 8 min read
How Large-Scale Websites Evolve Their Architecture for Performance and Scalability
Architect
Architect
Nov 19, 2015 · Backend Development

Optimizing Traditional Commercial Bank Architecture in the Era of Internet Finance

The article analyzes how rapid changes such as big data, cloud computing, and distributed architectures challenge traditional core banking systems and proposes a multi‑step strategy—including mainframe transaction off‑loading, service‑oriented design, open platform development, and big‑data integration—to modernize and improve performance, cost efficiency, and scalability.

Cloud Computingbanking architecturecore banking
0 likes · 12 min read
Optimizing Traditional Commercial Bank Architecture in the Era of Internet Finance
21CTO
21CTO
Nov 18, 2015 · Backend Development

How Xiaomi Engineered a High‑Performance Flash‑Sale System for the 2014 Mi Fan Festival

This article details Xiaomi's step‑by‑step design and evolution of its flash‑sale platform, covering the initial PHP‑Redis solution, the challenges of extreme concurrency, and the later Go‑based architecture that enabled millions of users to purchase smartphones reliably during the 2014 Mi Fan Festival.

GoHigh ConcurrencyRedis
0 likes · 15 min read
How Xiaomi Engineered a High‑Performance Flash‑Sale System for the 2014 Mi Fan Festival
ITPUB
ITPUB
Nov 18, 2015 · Backend Development

How to Build a High‑Throughput Flash‑Sale System Without Overselling

Design a flash‑sale (秒杀) platform that handles millions of concurrent purchase requests without overselling by combining web‑server load shedding, ZooKeeper‑based inventory quotas, message‑queue consumers, stored‑procedure database updates, slot‑based row locking, and hot‑item isolation, all detailed with code examples.

High ConcurrencyZooKeeperdatabase optimization
0 likes · 8 min read
How to Build a High‑Throughput Flash‑Sale System Without Overselling
21CTO
21CTO
Nov 17, 2015 · Operations

How JD Scaled Its Order Fulfillment Center to Handle Millions of Orders

JD’s Order Fulfillment Center (OFC) evolved from a small data‑transfer team into a highly scalable, distributed architecture that handles massive order volumes during events like 618 and Double‑11, employing Java migration, service decomposition, flow control, and robust operations to ensure data consistency and rapid delivery.

Java migrationdistributed systemse-commerce
0 likes · 23 min read
How JD Scaled Its Order Fulfillment Center to Handle Millions of Orders
21CTO
21CTO
Nov 14, 2015 · Backend Development

How WeChat’s Red Packet System Handles Millions of Claims in Real Time

This article explains the backend architecture behind WeChat’s red‑packet feature, detailing how the system stores packet data, uses cache‑level atomic operations for grabbing, separates claim and settlement steps, and ensures high‑throughput, fault‑tolerant processing during peak usage.

BackendWeChatcache
0 likes · 6 min read
How WeChat’s Red Packet System Handles Millions of Claims in Real Time
Architect
Architect
Nov 12, 2015 · Backend Development

JD.com Multi‑Center Transaction System Architecture for the 11.11 Shopping Festival

The article explains how JD.com designed and deployed a multi‑center transaction architecture, using a high‑performance data bus and strict consistency and routing controls, to handle the massive traffic spikes of the 11.11 e‑commerce event while ensuring scalability and disaster recovery.

backend scalabilitydata replicationdistributed systems
0 likes · 9 min read
JD.com Multi‑Center Transaction System Architecture for the 11.11 Shopping Festival
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Nov 9, 2015 · Operations

Designing a Business‑Oriented High‑Availability Architecture for Game Access Systems

The article presents a comprehensive, business‑centric high‑availability architecture for a game access platform, detailing measurable goals, a three‑layered design, client‑side retry with HTTP‑DNS, functional separation and degradation, multi‑region active‑active deployment, and automated, visual monitoring to achieve rapid issue detection, recovery, and minimal downtime.

business reliabilitydistributed systemsfault tolerance
0 likes · 23 min read
Designing a Business‑Oriented High‑Availability Architecture for Game Access Systems
21CTO
21CTO
Nov 2, 2015 · Backend Development

How WeChat Scales: Backend Architecture for Ultra‑Low Latency Messaging

The article outlines WeChat’s backend design that achieves seamless, low‑latency messaging through a minimalist sync protocol, efficient notification mechanisms, a three‑tier RPC framework, user‑level thread concurrency, and globally distributed IDC architecture ensuring high availability and eventual consistency.

High ConcurrencyRPCWeChat
0 likes · 7 min read
How WeChat Scales: Backend Architecture for Ultra‑Low Latency Messaging
Architect
Architect
Oct 26, 2015 · Backend Development

Evolution of 58.com Architecture from Small Traffic to Billion‑Scale

The talk outlines how 58.com’s website architecture evolved through stages—from a single‑machine, low‑traffic setup to a distributed, Java‑based, high‑availability system handling over a billion visits—detailing the challenges faced and the technical solutions adopted at each scale.

Backendclouddistributed systems
0 likes · 13 min read
Evolution of 58.com Architecture from Small Traffic to Billion‑Scale
21CTO
21CTO
Oct 24, 2015 · Backend Development

How to Build Scalable, High‑Performance Large‑Scale Websites: Architecture Evolution

This article examines the core challenges of massive web platforms—huge user bases, high concurrency, and massive data—and walks through a step‑by‑step evolution of architecture from a single‑server setup to distributed caching, clustering, read/write separation, CDN, and micro‑service strategies for achieving high availability, performance, and security.

Cachingbackend architecturedistributed systems
0 likes · 10 min read
How to Build Scalable, High‑Performance Large‑Scale Websites: Architecture Evolution
Architect
Architect
Oct 24, 2015 · Backend Development

Designing a Complete Distributed Server Cluster Architecture for Large Websites

This article outlines a comprehensive distributed server cluster architecture for large‑scale websites, covering the evolution from simple three‑tier setups to high‑availability load‑balancing with HAProxy/Keepalived, Redis caching, NoSQL storage, and future distributed MySQL considerations.

HAProxyRedisdistributed systems
0 likes · 8 min read
Designing a Complete Distributed Server Cluster Architecture for Large Websites
Architect
Architect
Oct 21, 2015 · Backend Development

WeChat Backend Architecture: Synchronization Protocol, RPC Framework, and Multi-IDC Design

The article outlines WeChat’s backend architecture, detailing extreme business requirements such as low latency and power efficiency, challenges of synchronizing diverse data across terminals, and solutions including a minimal sync protocol, high‑efficiency notification mechanisms, a three‑tier backend, unified RPC framework, coroutine‑based high‑concurrency RPC, and multi‑IDC distribution with strong consistency and disaster‑recovery strategies.

RPCWeChatdistributed systems
0 likes · 7 min read
WeChat Backend Architecture: Synchronization Protocol, RPC Framework, and Multi-IDC Design
MaGe Linux Operations
MaGe Linux Operations
Oct 21, 2015 · Operations

How JobCenter Transforms Distributed Task Scheduling in E‑Commerce

JobCenter is a distributed task coordination platform that replaces crontab with a unified scheduling, monitoring, and alerting system, enabling e‑commerce teams to manage thousands of web‑service‑based jobs, ensure reliable execution, and gain clear visibility into task performance.

automationdistributed systemsmonitoring
0 likes · 7 min read
How JobCenter Transforms Distributed Task Scheduling in E‑Commerce
21CTO
21CTO
Oct 20, 2015 · Backend Development

Scaling a Web System to 100M Daily Visits: Load Balancing, Caching, and Architecture

This article explains how a web system can grow from 100,000 to 100 million daily visits by introducing multi‑level caching, various load‑balancing strategies, MySQL performance tuning, distributed database setups, and geographic deployment to maintain stability and performance under massive traffic.

CachingMySQLRedis
0 likes · 21 min read
Scaling a Web System to 100M Daily Visits: Load Balancing, Caching, and Architecture
Architect
Architect
Oct 18, 2015 · Cloud Computing

Practices and Reflections on Enterprise Cloud Platforms

The article shares the author’s experience designing and operating enterprise‑grade cloud platforms, covering resource and application management, the Platform EGO architecture, comparisons with Mesos, Yarn and Kubernetes, and practical insights on scaling, scheduling, security, and architectural evolution.

Cloud Computingauto-scalingdistributed systems
0 likes · 18 min read
Practices and Reflections on Enterprise Cloud Platforms
21CTO
21CTO
Oct 16, 2015 · Backend Development

Inside Uber's Real‑Time Dispatch: How the Company Scales Its Marketplace

This article details Uber's rapid growth and the engineering choices behind its real‑time dispatch platform, covering geospatial indexing, microservice architecture, scaling techniques like Ringpop and TChannel, and strategies for availability and fault tolerance.

Uberdistributed systemsgeospatial indexing
0 likes · 18 min read
Inside Uber's Real‑Time Dispatch: How the Company Scales Its Marketplace
21CTO
21CTO
Oct 10, 2015 · Backend Development

How to Choose the Right Session Management Strategy for Scalable Web Applications

With growing website traffic, single‑machine deployments struggle, so this article examines four session‑management strategies—session stickiness, replication, centralized storage, and cookie‑based approaches—detailing their mechanisms, advantages, and drawbacks to help you select the best solution for scalable web applications.

Session Managementbackend scalingdistributed systems
0 likes · 6 min read
How to Choose the Right Session Management Strategy for Scalable Web Applications
21CTO
21CTO
Sep 26, 2015 · Backend Development

Architecting High‑Traffic Web 2.0 Sites: Solving Data, Concurrency & Storage

This article examines the key challenges of building large‑scale, high‑interaction web 2.0 platforms—including massive data processing, concurrency control, file storage, indexing, distributed architecture, AJAX usage, security, synchronization, clustering, and OpenAPI integration—offering practical considerations for robust backend design.

Storageconcurrencydata management
0 likes · 8 min read
Architecting High‑Traffic Web 2.0 Sites: Solving Data, Concurrency & Storage
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Sep 25, 2015 · Big Data

Understanding Storm: A Distributed Real-Time Computation System

The article explains the need for low‑latency, high‑performance, distributed real‑time processing, outlines the challenges such systems must address, and introduces Storm as a Hadoop‑like framework for stream processing, detailing its architecture, fault‑tolerance mechanisms, transactional topology, and large‑scale deployment at Taobao.

Stormbig datadistributed systems
0 likes · 14 min read
Understanding Storm: A Distributed Real-Time Computation System
Efficient Ops
Efficient Ops
Sep 23, 2015 · Operations

How Tencent Powers Millions with SET‑Based NoSQL Clusters

Tencent’s operations team explains how its SET‑based NoSQL clusters deliver ultra‑low latency, high availability, and seamless disaster recovery for billions of users, detailing deployment models, synchronization mechanisms, cost‑saving techniques, and the Data‑as‑Service approach that underpins its massive social platforms.

Data as a ServiceNoSQLcost optimization
0 likes · 12 min read
How Tencent Powers Millions with SET‑Based NoSQL Clusters
21CTO
21CTO
Sep 14, 2015 · Backend Development

Why Simple‑Looking Sites Like Taobao Need Hundreds of Top Engineers

Although sites like Taobao appear simple to users, they rely on massive distributed search, caching, storage, load‑balancing, CDN, logging, and data‑analysis systems that demand sophisticated backend engineering, massive infrastructure, and specialized algorithms, explaining why countless top engineers are required to keep them running.

Cachingbig datadistributed systems
0 likes · 12 min read
Why Simple‑Looking Sites Like Taobao Need Hundreds of Top Engineers
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Sep 14, 2015 · Industry Insights

Why Kafka Dominates Distributed Messaging: Architecture, Features, and Best Practices

This article provides an in‑depth examination of Apache Kafka’s origins, design goals, core concepts such as brokers, topics, partitions, producers and consumers, compares it with other message queues, explains its storage format, configuration options, delivery guarantees, and includes practical Java code examples for partitioning and consumption.

JavaKafkaMessage Queue
0 likes · 22 min read
Why Kafka Dominates Distributed Messaging: Architecture, Features, and Best Practices
21CTO
21CTO
Sep 2, 2015 · Cloud Computing

What I Learned Building a Hybrid Cloud System: Restful APIs, RabbitMQ, Redis & More

After two months of deep involvement in a distributed hybrid‑cloud project, I share practical insights on using Restful APIs, RabbitMQ, Redis, logging, component‑based development, testing strategies, coding standards, and cross‑team communication, highlighting challenges and solutions encountered while integrating C#, Java, and Python services.

Component DevelopmentRabbitMQdistributed systems
0 likes · 12 min read
What I Learned Building a Hybrid Cloud System: Restful APIs, RabbitMQ, Redis & More
21CTO
21CTO
Aug 24, 2015 · Databases

Mastering Distributed Consistency: Strategies Behind NoSQL Replication

This article systematically explores the distributed characteristics of NoSQL databases, covering consistency trade‑offs, replication techniques, anti‑entropy protocols, data placement strategies, failure detection, and coordinator election, while illustrating each concept with diagrams and practical examples.

Anti-entropyConsistencyNoSQL
0 likes · 32 min read
Mastering Distributed Consistency: Strategies Behind NoSQL Replication
21CTO
21CTO
Aug 18, 2015 · Cloud Computing

What I Learned Building a Hybrid Cloud System: Architecture, Tools, and Best Practices

Over the past two months I helped develop a distributed hybrid‑cloud platform, tackling challenges from OS differences and network ports to message queues, logging, multi‑language integration, and testing, and I share the architectural decisions, tooling choices, and practical lessons learned for building robust backend systems.

RabbitMQbackend architecturedistributed systems
0 likes · 12 min read
What I Learned Building a Hybrid Cloud System: Architecture, Tools, and Best Practices
21CTO
21CTO
Aug 14, 2015 · Backend Development

Ensuring Data Consistency: From Local Transactions to Distributed 2PC and Message Queues

This article explores how to maintain data consistency across services by using local transactions, two‑phase commit distributed transactions, and reliable message‑queue patterns, illustrating each method with an Alipay‑to‑YuEBao transfer example and discussing their trade‑offs.

Message Queuedata consistencydistributed systems
0 likes · 11 min read
Ensuring Data Consistency: From Local Transactions to Distributed 2PC and Message Queues
21CTO
21CTO
Aug 8, 2015 · Backend Development

How to Build Horizontally Scalable Systems: Load Balancing, Caching, and More

The article distills Will Larson’s insights on designing horizontally scalable systems, covering linear capacity growth, redundancy, load‑balancing strategies, caching layers, CDN usage, offline processing with message queues, Map‑Reduce for big data, and the benefits of introducing a platform layer to improve robustness and reusability.

Cachingdistributed systemsload balancing
0 likes · 12 min read
How to Build Horizontally Scalable Systems: Load Balancing, Caching, and More
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Aug 5, 2015 · Databases

Challenges and Strategies for Metadata Protection in Cloud Object Storage

This article examines the problems and trade‑offs of metadata protection in cloud object storage, highlighting the importance of reliability, availability, and consistency, and comparing primary‑secondary and multi‑replica models, including the WRN algorithm and practical operational considerations.

ConsistencyObject StorageReplication
0 likes · 28 min read
Challenges and Strategies for Metadata Protection in Cloud Object Storage
Architect
Architect
Jul 24, 2015 · Operations

Distributed Cache Strategies for High‑Traffic Flash‑Sale Scenarios

The article reviews a 2014 Double‑11 flash‑sale caching solution, analyzing traffic spikes, evaluating scaling versus caching approaches, and proposing a sentinel‑based distributed cache that pre‑emptively refreshes data to avoid cache penetration and ensure high‑concurrency reliability.

BackendSentineldistributed systems
0 likes · 8 min read
Distributed Cache Strategies for High‑Traffic Flash‑Sale Scenarios
Architect
Architect
Jul 6, 2015 · Big Data

Understanding Logs: The Core of Distributed Systems and Data Integration

This article explains how logs—simple, append‑only, time‑ordered records—serve as the fundamental abstraction behind databases, distributed systems, data integration pipelines, and stream‑processing platforms like Kafka and Hadoop, illustrating their role in ordering, replication, scalability, and real‑time analytics.

HadoopKafkaLogs
0 likes · 48 min read
Understanding Logs: The Core of Distributed Systems and Data Integration
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 28, 2015 · Backend Development

Optimizing Asynchronous Processing in Distributed Systems: Insights from Facebook and Alibaba

The article summarizes Zhao Haiping’s 2015 QCon talk on how asynchronous processing, profiling, and dependency‑tree scheduling can dramatically improve performance and scalability of distributed backend systems, drawing lessons from Facebook’s migration to async PHP and Alibaba’s ongoing optimization efforts.

Backend PerformanceFutureProfiling
0 likes · 12 min read
Optimizing Asynchronous Processing in Distributed Systems: Insights from Facebook and Alibaba
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 13, 2015 · Fundamentals

Key Characteristics and Design Principles of Distributed Systems

Distributed systems, long used since the 1970s and popularized by internet giants like Google, offer scalable, cost‑effective, and fault‑tolerant architectures by leveraging many low‑cost servers, emphasizing horizontal scaling, avoidance of single points of failure, minimal inter‑node communication, and stateless services for elastic application deployment.

distributed systemsfault tolerancehorizontal scaling
0 likes · 13 min read
Key Characteristics and Design Principles of Distributed Systems
Architect
Architect
Jun 3, 2015 · Fundamentals

Curated Learning Materials for System Architecture and Distributed Computing

This article presents a curated collection of seminal papers and resources covering operating systems, virtual machines, system design principles, distributed algorithms, overlay networking, and debugging techniques to help engineers deepen their understanding of system architecture and advance beyond growth bottlenecks.

Operating Systemsdistributed systemsresearch papers
0 likes · 12 min read
Curated Learning Materials for System Architecture and Distributed Computing
Qunar Tech Salon
Qunar Tech Salon
May 21, 2015 · Fundamentals

Key Characteristics and Design Principles of Distributed Systems

The article explains the origins, core features such as scalability, cost‑effectiveness, fault tolerance, and elastic expansion of distributed systems, and outlines design philosophies like low hardware requirements, horizontal scaling, avoidance of single points of failure, minimized inter‑node communication, and stateless service architecture.

distributed systemsfault tolerancehorizontal scaling
0 likes · 11 min read
Key Characteristics and Design Principles of Distributed Systems
MaGe Linux Operations
MaGe Linux Operations
Apr 28, 2015 · Big Data

How LinkedIn Scales Kafka to Billions of Messages Every Day

This article explains how LinkedIn uses Apache Kafka as a high‑throughput, fault‑tolerant messaging backbone, detailing its architecture, message categories, layered replication, audit mechanisms, and the engineering practices that keep billions of daily messages reliable and fast.

KafkaLinkedInbig data
0 likes · 11 min read
How LinkedIn Scales Kafka to Billions of Messages Every Day
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Apr 26, 2015 · Cloud Computing

Key Topics from the 2015 Beijing QCon: Asynchronous Processing, DRC Data Replication, High Availability, and Cloud Database Operations

The 2015 Beijing QCon highlighted four technical talks covering asynchronous processing in distributed systems, the DRC data‑replication infrastructure, minute‑level high‑availability fault recovery, and cloud‑era database operations, illustrating Alibaba's approaches to scalability and reliability in modern cloud platforms.

Cloud DatabaseQConasynchronous-processing
0 likes · 6 min read
Key Topics from the 2015 Beijing QCon: Asynchronous Processing, DRC Data Replication, High Availability, and Cloud Database Operations
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Apr 1, 2015 · Backend Development

Design Goals, Challenges, and Evolution of Large-Scale Website Architecture

This article examines the objectives, challenges, evolutionary technologies, design principles, and practical strategies such as resource separation, caching, load balancing, database read/write splitting, CDN, distributed storage, and consistency models that are essential for building and scaling large‑scale website architectures.

Cachingdistributed systemsload balancing
0 likes · 10 min read
Design Goals, Challenges, and Evolution of Large-Scale Website Architecture
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Mar 25, 2015 · Operations

How WhatsApp Scaled to 400 Million Daily Messages with a 10‑Engineer Team

This article examines how WhatsApp grew its user base, message volume, and infrastructure dramatically over two years while keeping the engineering team at ten, detailing the architectural choices, Erlang‑based stack, hardware scaling, decoupling strategies, and the operational challenges that led to both performance gains and a major outage.

MnesiaWhatsAppdistributed systems
0 likes · 15 min read
How WhatsApp Scaled to 400 Million Daily Messages with a 10‑Engineer Team
Qunar Tech Salon
Qunar Tech Salon
Jan 21, 2015 · Fundamentals

Data Consistency, Replication, and Distributed Transaction Protocols: From Partitioning to Paxos and Dynamo

The article examines the challenges of scaling a single‑server data service, compares data partitioning and replication, explains consistency models, and surveys distributed transaction protocols such as 2PC, 3PC, Paxos, and Dynamo's NWR model, highlighting their trade‑offs in availability, consistency, and performance.

CAP theoremDynamoPaxos
0 likes · 26 min read
Data Consistency, Replication, and Distributed Transaction Protocols: From Partitioning to Paxos and Dynamo
Qunar Tech Salon
Qunar Tech Salon
Dec 29, 2014 · Backend Development

Consistent Hashing: Principles, Monotonicity, and Virtual Nodes

This article explains the consistent hashing algorithm, its motivation in cache systems, the concept of monotonicity, the step‑by‑step mapping process, and how virtual nodes improve balance and resilience when cache servers are added or removed.

consistent hashingdistributed systemsload balancing
0 likes · 9 min read
Consistent Hashing: Principles, Monotonicity, and Virtual Nodes
Qunar Tech Salon
Qunar Tech Salon
Oct 31, 2014 · Operations

Simple Testing Can Prevent Most Critical Failures: Findings from an Analysis of Five Open‑Source Distributed Systems

A recent study of five major open‑source distributed systems reveals that most failures can be triggered and reproduced with simple, multi‑event tests, highlighting the importance of systematic testing, deterministic error handling, and concise logging for reliable system operation.

Bug Analysisdistributed systemslog-analysis
0 likes · 6 min read
Simple Testing Can Prevent Most Critical Failures: Findings from an Analysis of Five Open‑Source Distributed Systems
Baidu Tech Salon
Baidu Tech Salon
Apr 30, 2014 · Backend Development

Logical Coupling, Service Layer Design, and Distributed System Architecture for Large-Scale Web Applications

The article examines the inevitability of service coupling in large‑scale web applications and proposes a two‑dimensional architecture that separates business and logic layers, uses internal data stores, introduces a naming‑and‑location service, selects appropriate transport and RPC protocols, and automates operations with health checks, load balancing, and failover to achieve continuous reliability.

JavaNaming Servicebackend architecture
0 likes · 29 min read
Logical Coupling, Service Layer Design, and Distributed System Architecture for Large-Scale Web Applications
Baidu Tech Salon
Baidu Tech Salon
Apr 29, 2014 · Backend Development

Evolution of Web Architecture: From Single‑Server Sites to Distributed Multi‑Machine Systems

The article traces web architecture’s evolution from simple single‑server Java/JSP sites through memory caching, load‑balanced multi‑machine logic, read/write separation, master‑slave replication or message‑queue syncing, horizontal/vertical sharding, and finally multi‑server web‑server deployments behind load balancers to achieve scalability and reliability.

Cachingdatabase shardingdistributed systems
0 likes · 25 min read
Evolution of Web Architecture: From Single‑Server Sites to Distributed Multi‑Machine Systems
Baidu Tech Salon
Baidu Tech Salon
Apr 23, 2014 · Operations

How to Build Low‑Cost Real‑Time Collaborative Editing: From Edit Locks to Distributed OT

This article surveys practical approaches for implementing real‑time collaborative editing, comparing simple edit‑lock methods, line‑based diff/patch techniques, character‑level Myer's diff, and Operational Transformation—including distributed challenges—and offers recommendations based on project size and performance needs.

Conflict ResolutionDiff Algorithmdistributed systems
0 likes · 16 min read
How to Build Low‑Cost Real‑Time Collaborative Editing: From Edit Locks to Distributed OT