Art of Distributed System Architecture Design
Author

Art of Distributed System Architecture Design

Introductions to large-scale distributed system architectures; insights and knowledge sharing on large-scale internet system architecture; front-end web architecture overviews; practical tips and experiences with PHP, JavaScript, Erlang, C/C++ and other languages in large-scale internet system development.

267
Articles
0
Likes
357
Views
0
Comments
Recent Articles

Latest from Art of Distributed System Architecture Design

100 recent articles max
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Oct 30, 2015 · Backend Development

Scalable Web Architecture for Startup Companies

The article explains how startup engineers can design and evolve a scalable web architecture—through service separation, clustering, load balancing, distributed caching, database replication, and effective team organization—to handle rapid user growth and maintain performance without compromising user experience.

Database ReplicationWeb Architecturecaching
0 likes · 16 min read
Scalable Web Architecture for Startup Companies

TalkingData’s Journey to Building a Mobile Big Data Platform with Spark and YARN

This article recounts how TalkingData progressively introduced Spark into its Hadoop‑YARN based mobile big‑data platform, detailing early architectures, migration challenges, performance gains, the fully Spark‑centric redesign with Kafka and Spark Streaming, encountered pitfalls, and future plans for further optimization.

Data PlatformHadoopSpark
0 likes · 16 min read
TalkingData’s Journey to Building a Mobile Big Data Platform with Spark and YARN

Introducing Erlang: Concurrency, Fault Tolerance, and Simple Syntax

This article introduces Erlang as a general‑purpose concurrent language, highlighting its fault‑tolerant runtime, simple 550‑line syntax, pattern‑matching capabilities, process creation with spawn, and practical examples using the ibrowse HTTP library to demonstrate message passing and distributed computing.

ErlangFunctional ProgrammingPattern Matching
0 likes · 8 min read
Introducing Erlang: Concurrency, Fault Tolerance, and Simple Syntax
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Oct 16, 2015 · Artificial Intelligence

Building Machine Learning Systems in Small Teams: Practices, Pitfalls, and Lessons from Dangdang

This talk shares the experience of a small machine‑learning team at Dangdang, describing how they built a recommendation system from scratch, the tools and processes they used, the challenges of limited personnel, and the many pitfalls they encountered while iterating toward a production‑ready solution.

ML pipelineRecommendationSystem Engineering
0 likes · 21 min read
Building Machine Learning Systems in Small Teams: Practices, Pitfalls, and Lessons from Dangdang

Understanding Container Technology: From Virtual Machines to Scalable Container Clusters

This article explains the fundamentals of container technology, compares containers with virtual machines, describes how containers are managed and deployed using tools like Docker and CoreOS, and shows how container clusters improve resource utilization and scalability in modern DevOps environments.

Dockercloud-nativecontainers
0 likes · 15 min read
Understanding Container Technology: From Virtual Machines to Scalable Container Clusters
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Oct 8, 2015 · Artificial Intelligence

Facebook AI Research (FAIR): History, Teams, Projects, and Vision

The article chronicles Facebook's evolution from a social platform into a leading AI research hub, detailing the founding of FAIR, its key personnel, ambitious goals, major projects such as memory networks, embedding world, DeepFace, language technology, and the M assistant, and highlights the open, collaborative nature of its AI work.

AI researchArtificial IntelligenceFAIR
0 likes · 17 min read
Facebook AI Research (FAIR): History, Teams, Projects, and Vision

Understanding Storm: A Distributed Real-Time Computation System

The article explains the need for low‑latency, high‑performance, distributed real‑time processing, outlines the challenges such systems must address, and introduces Storm as a Hadoop‑like framework for stream processing, detailing its architecture, fault‑tolerance mechanisms, transactional topology, and large‑scale deployment at Taobao.

Big DataStormdistributed systems
0 likes · 14 min read
Understanding Storm: A Distributed Real-Time Computation System