BestHub
Sign in
Tagged articles

distributed storage

275 articles · Page 3 of 3
Tencent Database Technology
Tencent Database Technology
Jan 24, 2019 · Databases

Architecture Evolution and Performance Optimization of Tencent's CKV Distributed In-Memory Storage System

This article details the architectural evolution and comprehensive refactoring of Tencent's CKV distributed in-memory key-value storage system, highlighting its transition to a two-tier single-process multi-threaded model, multi-tenant resource isolation, deep Redis protocol compatibility, and optimized memory engine, which collectively deliver significant improvements in performance, scalability, and operational cost efficiency.

Database ArchitectureIn-Memory DatabaseMulti-Tenant Architecture
0 likes · 10 min read
Architecture Evolution and Performance Optimization of Tencent's CKV Distributed In-Memory Storage System
58 Tech
58 Tech
Jan 7, 2019 · Big Data

Comparison of Kuaishou BlobStore and 58 WOS Object Storage Systems

The article summarizes the technical talk from the 58 Group technology salon, detailing the architectures, scalability, high‑availability mechanisms, and storage models of Kuaishou's BlobStore and 58's WOS, and compares their design choices for large‑scale object storage.

BlobStoreHBaseWOS
0 likes · 9 min read
Comparison of Kuaishou BlobStore and 58 WOS Object Storage Systems
Tencent Cloud Developer
Tencent Cloud Developer
Dec 20, 2018 · Databases

CynosDB Architecture and Optimization: A PostgreSQL-Compatible NewSQL Database

CynosDB, Tencent’s PostgreSQL‑compatible NewSQL service, separates compute and storage, uses a log‑based distributed CynosStore with idempotent logs, offloads CRC checks, and implements async table extension, eliminating full‑page writes and dirty‑page flushing to deliver scalable, cost‑effective performance while preserving PostgreSQL features.

CynosDBDatabase ArchitectureLog System Optimization
0 likes · 12 min read
CynosDB Architecture and Optimization: A PostgreSQL-Compatible NewSQL Database
Baidu Intelligent Testing
Baidu Intelligent Testing
Dec 6, 2018 · Fundamentals

Introduction to CDN System Architecture and Workflow

This article provides a beginner-friendly overview of traditional CDN components, their relationships, and a step‑by‑step download workflow, covering entry service, core indexing, core storage, content management, edge storage, and content distribution without delving into advanced features like grouping or P2P.

CDNContent Delivery NetworkEdge Storage
0 likes · 11 min read
Introduction to CDN System Architecture and Workflow
Beike Product & Technology
Beike Product & Technology
Nov 23, 2018 · Backend Development

Elasticsearch Internals: Distributed Document Storage, Real‑time Search, and Translog Mechanics

This article explains the core Elasticsearch architecture—including shard routing, primary‑replica interaction, document CRUD workflows, multi‑document APIs, segment merging, translog durability, and storage file formats—providing a comprehensive view of how near‑real‑time search is achieved on large‑scale data.

ElasticsearchLuceneSegment Merging
0 likes · 20 min read
Elasticsearch Internals: Distributed Document Storage, Real‑time Search, and Translog Mechanics
ITPUB
ITPUB
Nov 2, 2018 · Databases

How Lest Redefines Persistent Caching for Petabyte‑Scale KV Stores

This article presents Lest, a persistent KV‑store cache designed to overcome the limitations of traditional in‑memory caches by combining disk‑based persistence, lock‑free multithreading, custom protocols, and advanced load‑balancing, and it evaluates its performance on petabyte‑scale workloads.

KV storeLestLoad Balancing
0 likes · 11 min read
How Lest Redefines Persistent Caching for Petabyte‑Scale KV Stores
58 Tech
58 Tech
Nov 1, 2018 · Databases

Insights from the 58 Group Technical Salon: Distributed KV Storage Systems Cellar and WTable

The article summarizes the 58 Group technical salon where experts compared Meituan‑Dianping's Cellar and 58's WTable distributed KV storage systems, detailing their architectures, improvements, scalability, high‑availability mechanisms, and operational considerations, and concludes with a comparative analysis and preview of the next session.

CellarKV storeRocksDB
0 likes · 10 min read
Insights from the 58 Group Technical Salon: Distributed KV Storage Systems Cellar and WTable
Alibaba Cloud Developer
Alibaba Cloud Developer
Oct 16, 2018 · Operations

Alibaba’s OS, Storage, and Resource Management Highlights from OSDI'18

The 13th OSDI conference in Carlsbad attracted over 650 attendees, featuring 47 accepted papers and three Best Papers—two led by Chinese students—while Alibaba showcased its latest OS kernel (AliKernel), next‑generation distributed storage system Pangu 2.0, and the large‑scale resource manager Sigma, sparking lively discussions among global experts.

AlibabaOSDIOperating Systems
0 likes · 8 min read
Alibaba’s OS, Storage, and Resource Management Highlights from OSDI'18
Architects' Tech Alliance
Architects' Tech Alliance
Sep 5, 2018 · Fundamentals

Red Hat Ceph Storage Architecture Overview and Key Components

This article provides a comprehensive English translation of the Red Hat Ceph Storage Architecture Guide, covering Ceph's distributed object storage concepts, cluster architecture, storage pools, CRUSH algorithm, replication and erasure‑coding I/O, internal operations, high‑availability mechanisms, client interfaces, and encryption considerations for cloud environments.

CRUSHCephCloud Infrastructure
0 likes · 40 min read
Red Hat Ceph Storage Architecture Overview and Key Components
Big Data and Microservices
Big Data and Microservices
Aug 22, 2018 · Industry Insights

Designing Scalable Internet Platforms: Key Subsystems and Best Practices

The article outlines the architecture of large‑scale internet application platforms, detailing essential subsystems such as web front‑ends, load balancing, database clusters, caching, distributed storage, server management, and code deployment, and explains how they work together to achieve high availability, performance, and scalability.

Load BalancingServer Managementcaching
0 likes · 8 min read
Designing Scalable Internet Platforms: Key Subsystems and Best Practices
Architecture Digest
Architecture Digest
Jul 15, 2018 · Cloud Computing

Ceph Architecture Overview: Features, Core Components, IO Workflow, Heartbeat, Communication Framework, CRUSH Algorithm, and QoS

This article provides a comprehensive technical overview of Ceph, covering its architecture, key components, storage interfaces, IO processes, heartbeat mechanisms, communication framework, CRUSH data placement algorithm, and customizable QoS strategies for distributed storage systems.

CRUSHCephIO Process
0 likes · 24 min read
Ceph Architecture Overview: Features, Core Components, IO Workflow, Heartbeat, Communication Framework, CRUSH Algorithm, and QoS
UCloud Tech
UCloud Tech
Jul 9, 2018 · Big Data

How Distributed Unified Storage Solves Modern Big Data Challenges

This article explores the evolution of storage technology, the rise of software‑defined distributed unified storage like UMStor, and the Hadapter solution that enables high‑performance, compute‑storage separation for big‑data and cloud environments, highlighting real‑world deployments and performance insights.

Data LakeHadapterSoftware-Defined Storage
0 likes · 14 min read
How Distributed Unified Storage Solves Modern Big Data Challenges
UCloud Tech
UCloud Tech
Jul 7, 2018 · Big Data

How UMStor and HAdapter Power Big Data Cloud Migration with Superior Performance

The article reports on UCloud's subsidiary presenting at ArchSummit 2018 in Shenzhen, detailing the evolution to the digital era, challenges of PB‑scale data storage, and their solution using NFS‑Ganesha, Hadapter, and UMStor to achieve efficient big‑data‑on‑cloud performance and a data‑lake model.

Cloud StorageData LakeHadoop
0 likes · 10 min read
How UMStor and HAdapter Power Big Data Cloud Migration with Superior Performance
UCloud Tech
UCloud Tech
Jun 29, 2018 · Backend Development

What’s New in Ceph? Highlights from the 2018 Developer Monthly Report

The June 2018 Ceph Developer Monthly Report reviews key changes such as the deprecation of ceph‑disk, the upcoming seastar‑based OSD, SMART‑driven disk‑failure prediction, new rbd namespace support, BlueStore memory optimizations, iWARP RDMA support, and several operational enhancements.

CephCloud StorageSMART monitoring
0 likes · 5 min read
What’s New in Ceph? Highlights from the 2018 Developer Monthly Report
Tencent Cloud Developer
Tencent Cloud Developer
Jun 12, 2018 · Cloud Native

CynosDB: Tencent Cloud's Next-Generation Enterprise Distributed Cloud Database

CynosDB, Tencent Cloud’s next‑generation enterprise distributed database, re‑architects MySQL with compute‑storage separation, distributed high‑availability storage, and RDMA‑accelerated low‑latency replication, delivering extreme performance, scalability, sub‑millisecond response times, and nine‑nine data reliability for cloud‑native applications.

Cloud DatabaseCloud NativeCompute-Storage Separation
0 likes · 9 min read
CynosDB: Tencent Cloud's Next-Generation Enterprise Distributed Cloud Database
dbaplus Community
dbaplus Community
Jun 7, 2018 · Operations

Why Ceph’s Unlimited Scalability Isn’t As Simple As It Looks

The article examines Ceph’s claimed infinite scalability, cost advantages, and operational stability from an SRE perspective, comparing it with centralized systems like HDFS, and reveals practical challenges such as expansion granularity, crushmap rebalancing, utilization limits, and maintenance overhead.

CephHDFSOperations
0 likes · 15 min read
Why Ceph’s Unlimited Scalability Isn’t As Simple As It Looks
ITPUB
ITPUB
May 30, 2018 · Backend Development

How JD.com Engineered Its Own Distributed Storage System for Billions of Files

This article chronicles JD.com's journey from recognizing massive storage demands to designing, building, and evolving a self‑developed distributed storage platform—JFS—that handles small and large files, powers a custom image system, object storage, and future container‑native workloads.

JFSbackend engineeringdistributed storage
0 likes · 16 min read
How JD.com Engineered Its Own Distributed Storage System for Billions of Files
21CTO
21CTO
May 29, 2018 · Blockchain

How IPFS Works: A Deep Dive into Its Architecture and Core Components

This article explains the fundamentals of IPFS, covering its file system nature, content‑addressed Merkle‑DAG structure, the multi‑layer architecture (naming, merkledag, exchange, routing, network), IPLD data modeling, and libp2p’s modular networking stack, illustrating how data is stored, addressed, and transferred in a distributed manner.

Content AddressingIPFSIPLD
0 likes · 11 min read
How IPFS Works: A Deep Dive into Its Architecture and Core Components
Meitu Technology
Meitu Technology
May 23, 2018 · Blockchain

An Overview of IPFS: Architecture, IPLD, and libp2p

The article explains IPFS as a peer‑to‑peer, content‑addressed storage system built on a five‑layer architecture, detailing how the Merkle‑DAG, Kademlia routing, IPLD’s multiformats, and libp2p’s modular network stack work together to enable decentralized, tamper‑resistant data storage and retrieval, complementing blockchain.

Content AddressingIPFSIPLD
0 likes · 14 min read
An Overview of IPFS: Architecture, IPLD, and libp2p
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Apr 24, 2018 · Databases

How Dynamo Achieves High‑Availability in Distributed Key‑Value Stores

This article explains Dynamo, the decentralized key‑value storage system, covering its design goals, consistent‑hashing partitioning with virtual nodes, replication strategies, quorum‑based consistency, conflict resolution with vector clocks, hinted handoff, Merkle‑tree synchronization, and gossip‑based failure detection.

DynamoHigh Availabilityconsistent hashing
0 likes · 9 min read
How Dynamo Achieves High‑Availability in Distributed Key‑Value Stores
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Apr 8, 2018 · Operations

How DPRD Improves Data Placement Over CRUSH in Distributed Storage

This article introduces the DPRD hierarchical data placement strategy, explains its roots in the CRUSH algorithm, highlights CRUSH's migration inefficiencies, and details how DPRD achieves near‑theoretical replica movement and balanced distribution during both expansion and shrinkage of a distributed storage system.

CRUSH algorithmCephDPRD strategy
0 likes · 11 min read
How DPRD Improves Data Placement Over CRUSH in Distributed Storage
Architecture Digest
Architecture Digest
Feb 15, 2018 · Databases

Design and Architecture of Zeppelin Distributed Block Storage System

This article presents an in‑depth overview of Zeppelin, a high‑availability, high‑performance block storage service, covering its motivation, online vs offline storage distinctions, data distribution strategies, centralized meta‑server design, replication policies, RocksDB‑based storage engine, Raft‑based consistency protocol, threading model, client request flow, and fault‑handling mechanisms.

Hash PartitioningRaftRocksDB
0 likes · 19 min read
Design and Architecture of Zeppelin Distributed Block Storage System
Tencent Architect
Tencent Architect
Dec 30, 2017 · Databases

An Overview of Time Series Databases and Tencent CTSDB

This article introduces the concept, characteristics, and use cases of time series databases, explains the data model and challenges of traditional solutions, and provides a detailed overview of Tencent's Cloud Time Series Database (CTSDB) along with performance comparisons against InfluxDB.

Big DataCTSDBdistributed storage
0 likes · 12 min read
An Overview of Time Series Databases and Tencent CTSDB
Alibaba Cloud Developer
Alibaba Cloud Developer
Aug 10, 2017 · Big Data

Alibaba’s HBase Innovations: Powering Big Data at Scale – HBaseCon 2017 Asia Insights

At HBaseCon 2017 Asia, Alibaba showcased a series of groundbreaking HBase enhancements—including strong synchronous replication, SQL-on-HBase capabilities, cross‑cluster range data copy, and read/write path optimizations—that dramatically improve performance, reliability, and usability for large‑scale big‑data storage.

Big DataHBaseSQL
0 likes · 10 min read
Alibaba’s HBase Innovations: Powering Big Data at Scale – HBaseCon 2017 Asia Insights
Architects' Tech Alliance
Architects' Tech Alliance
Aug 9, 2017 · Fundamentals

Ceph vs GlusterFS: Architecture, Components, and Comparative Analysis

This article explains the fundamental architectures of Ceph and GlusterFS, describes their core components such as RADOS, librados, CephFS, RBD, and Gluster bricks, and compares their scalability, high‑availability, hardware requirements, decentralization, and performance characteristics for distributed storage deployments.

CephComparisonGlusterFS
0 likes · 9 min read
Ceph vs GlusterFS: Architecture, Components, and Comparative Analysis
Meituan Technology Team
Meituan Technology Team
Jul 6, 2017 · Backend Development

Online Feature System: Architecture, Storage, and High‑Concurrency Techniques

Using Meituan’s hotel‑travel platform as a case study, the article details a scalable online feature system architecture that combines layered storage, efficient compression, and robust synchronization to meet extreme concurrency, throughput, terabyte‑scale data, and sub‑10 ms latency demands for AI‑driven strategy services.

Big Datadata compressiondistributed storage
0 likes · 23 min read
Online Feature System: Architecture, Storage, and High‑Concurrency Techniques
Architecture Digest
Architecture Digest
Jul 6, 2017 · Fundamentals

PacificA: Microsoft’s General Replication Framework for Large‑Scale Distributed Storage Systems

PacificA is Microsoft’s generic replication framework for large‑scale distributed storage systems that provides strong consistency, separates configuration management from data replication, and uses a primary‑secondary model with lease‑based fault detection to ensure availability, correctness, and efficient operation across heterogeneous nodes.

Fault TolerancePacificAconsistency
0 likes · 14 min read
PacificA: Microsoft’s General Replication Framework for Large‑Scale Distributed Storage Systems
21CTO
21CTO
Jun 19, 2017 · Databases

How Didi Scales HBase for Real‑Time Orders, Geo‑Tracking, ETA and Monitoring

This article explains how Didi leverages HBase’s distributed architecture, multi‑language APIs, and custom rowkey designs to support online order queries, driver‑passenger trajectory tracking with GeoHash, real‑time ETA calculations, and a monitoring platform, while managing multi‑tenant resources through DHS and RS Group.

DidiHBaseReal-Time Analytics
0 likes · 13 min read
How Didi Scales HBase for Real‑Time Orders, Geo‑Tracking, ETA and Monitoring
Architect
Architect
Apr 19, 2017 · Fundamentals

Analysis of Ceph Bluestore Storage Engine Architecture

This article examines Ceph's Bluestore storage engine, describing its raw‑device management, metadata structures, write and read I/O processing, allocation strategies, and clone handling, highlighting how it reduces write amplification and optimizes for SSDs compared to the older Filestore.

BlueStoreCephI/O Architecture
0 likes · 9 min read
Analysis of Ceph Bluestore Storage Engine Architecture
Alibaba Cloud Developer
Alibaba Cloud Developer
Apr 1, 2017 · Databases

Alibaba’s HBase Scaling Secrets: High‑Availability, Replication, Performance

This article details how Alibaba has evolved HBase from an internal storage solution to a cloud service, covering its architecture, high‑availability design, asynchronous and synchronous replication, multi‑link data flows, cost‑effective redundancy, performance optimizations, and future development directions.

HBasedistributed storagereplication
0 likes · 28 min read
Alibaba’s HBase Scaling Secrets: High‑Availability, Replication, Performance
Architects' Tech Alliance
Architects' Tech Alliance
Jan 19, 2017 · Fundamentals

Ceph Architecture, Design Principles, Features, and BlueStore Deep Dive

This article shares a series of Sage Weil’s Ceph video lectures that thoroughly explain Ceph’s architecture, design philosophy, key features, and the BlueStore storage engine, providing links to additional resources and background on Ceph’s development history for enthusiasts seeking an in‑depth understanding.

BlueStoreCephObject Store
0 likes · 4 min read
Ceph Architecture, Design Principles, Features, and BlueStore Deep Dive
Tencent Cloud Developer
Tencent Cloud Developer
Dec 23, 2016 · Databases

Analysis of HBase Write-Ahead Log (WAL) Mechanism and Source Code Call Chain

The article explains HBase’s write‑ahead‑log architecture, detailing how client put/delete requests travel through RPC to the RegionServer, are processed by MultiRowMutationService, written to the WAL via FSHLog.append and sync, and finally stored in MemStore, while describing durability options and the underlying source‑code call chain.

Big DataHBaseWAL
0 likes · 10 min read
Analysis of HBase Write-Ahead Log (WAL) Mechanism and Source Code Call Chain
MaGe Linux Operations
MaGe Linux Operations
Dec 3, 2016 · Operations

Build a Scalable Distributed Storage System with MogileFS and Nginx

This guide walks through the concepts of distributed file systems, introduces MogileFS, and provides step‑by‑step instructions—including environment setup, MariaDB and MogileFS configuration, Nginx compilation with the MogileFS module, and testing—to create a scalable small‑file storage solution.

LinuxMariaDBMogileFS
0 likes · 13 min read
Build a Scalable Distributed Storage System with MogileFS and Nginx
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Nov 18, 2016 · Big Data

Understanding HDFS: Design Goals, Architecture, and Data Replication

This article explains HDFS’s core design principles, including fault tolerance, high‑throughput data access, master‑slave architecture with Namenode and Datanodes, namespace management, block replication strategies, safe mode, metadata persistence, communication protocols, robustness mechanisms, and file operations such as creation, deletion, and space reclamation.

HDFSdistributed storage
0 likes · 16 min read
Understanding HDFS: Design Goals, Architecture, and Data Replication
WeChat Backend Team
WeChat Backend Team
Oct 25, 2016 · Backend Development

Reinventing WeChat’s Distributed Storage with Paxos: Inside the Memory Cloud Upgrade

This article details how WeChat transformed its massive memory‑cloud storage by replacing the QuorumKV NWR protocol with a non‑lease Paxos design, optimizing PaxosLog, adopting DirectIO on HDDs, and implementing operational safeguards, resulting in dramatically lower latency, higher availability, and reduced failure rates.

PaxosWeChatconsistency
0 likes · 15 min read
Reinventing WeChat’s Distributed Storage with Paxos: Inside the Memory Cloud Upgrade
ITPUB
ITPUB
Sep 21, 2016 · Operations

How Tencent Cloud Recovered Lost Data in a 2‑Day Storage Crisis

In a two‑day incident, Tencent Cloud's CBS team diagnosed cell failures, implemented directed reads and a dual‑cell merge strategy, and restored three‑copy data integrity, while uncovering monitoring gaps and tool limitations that inform future storage operations.

Cloud StorageData Recoverydistributed storage
0 likes · 9 min read
How Tencent Cloud Recovered Lost Data in a 2‑Day Storage Crisis
Architects' Tech Alliance
Architects' Tech Alliance
Aug 19, 2016 · Cloud Computing

In-Depth Analysis of Ceph Architecture, Features, and Success Factors

This article provides a comprehensive overview of Ceph's distributed storage architecture, its integration with OpenStack, internal data mapping mechanisms, advanced features like SSD caching and global object storage, and examines the key factors behind its widespread adoption in cloud environments.

CRUSH algorithmCephOpenStack
0 likes · 10 min read
In-Depth Analysis of Ceph Architecture, Features, and Success Factors
MaGe Linux Operations
MaGe Linux Operations
Aug 17, 2016 · Operations

Mastering GlusterFS: Installation, Volume Types, and Management Commands

This guide provides a comprehensive overview of GlusterFS, covering essential terminology, step‑by‑step installation, cluster and volume management—including distributed, replicated, striped, and hybrid volume types—along with commands for creating, expanding, healing, and monitoring volumes, plus client mounting options and troubleshooting tips.

GlusterFSLinuxVolume Management
0 likes · 16 min read
Mastering GlusterFS: Installation, Volume Types, and Management Commands
Efficient Ops
Efficient Ops
Aug 10, 2016 · Operations

How RAID and Replication Shape Distributed Storage Architecture

This article explores RAID and replication strategies in distributed storage, detailing stripe concepts, RAID0/1/10/5/6 configurations, the typical three‑node architecture with metadata and data servers, performance bottlenecks, reconstruction experiments, and practical mitigation techniques to ensure data integrity and high availability.

RAIDdata reconstructiondistributed storage
0 likes · 25 min read
How RAID and Replication Shape Distributed Storage Architecture
Efficient Ops
Efficient Ops
Aug 4, 2016 · Fundamentals

Why Data Safety Trumps Performance in Distributed Storage Systems

This article examines the inherent risks of distributed storage, emphasizes that data safety outweighs raw performance, and explains storage types, file system structures, media characteristics, and practical solutions such as SSD caching and SRVSAN architecture to mitigate those risks.

Data SafetySSDdistributed storage
0 likes · 20 min read
Why Data Safety Trumps Performance in Distributed Storage Systems
Baidu Maps Tech Team
Baidu Maps Tech Team
Jun 2, 2016 · Backend Development

How Baidu Maps Re‑engineered Its Indexing Unit for Scalable Data Storage

This article details Baidu Maps' technical team’s refactoring of the indexing (build) unit, outlining existing bottlenecks, design challenges, and a new decoupled architecture that separates storage, incremental updates, and full‑index construction using distributed table storage and message‑driven pipelines to improve scalability and reliability.

Baidu MapsIndexingSearch Architecture
0 likes · 9 min read
How Baidu Maps Re‑engineered Its Indexing Unit for Scalable Data Storage
Baidu Intelligent Testing
Baidu Intelligent Testing
May 5, 2016 · Operations

Preventing Avalanche Effect in Distributed Storage Systems: Replication Strategies, Flow Control, and Safety Mode

The article analyzes distributed storage replication methods, explains how large‑scale replica recovery can trigger an avalanche effect, and proposes operational safeguards such as cross‑rack replica selection, flow‑control mechanisms, predictive fault handling, and a safety mode to maintain system stability.

Flow ControlOperationsavalanche effect
0 likes · 15 min read
Preventing Avalanche Effect in Distributed Storage Systems: Replication Strategies, Flow Control, and Safety Mode
Architect
Architect
Mar 31, 2016 · Cloud Computing

An Overview of Ceph Architecture and Its Storage Interfaces

This article introduces Ceph as an open‑source distributed storage system that supports object, block, and file interfaces, explains its core RADOS components, outlines its advantages such as unified storage, high scalability, reliability and performance, and details how Ceph handles object and block storage within cloud environments.

CephCloud ComputingRADOS
0 likes · 10 min read
An Overview of Ceph Architecture and Its Storage Interfaces
Meituan Technology Team
Meituan Technology Team
Mar 18, 2016 · Cloud Computing

Design and Performance Evaluation of the Ursa Distributed Block Storage System

Ursa, a master‑based distributed block storage system created by Meituan Cloud, overcomes Ceph, Sheepdog, and MooseFS limitations by delivering SSD‑level IOPS and near‑theoretical 10 GbE bandwidth with low CPU usage, supporting large virtual disks, snapshots, high availability, and efficient replica‑striped writes.

CephPerformance TestingUrsa
0 likes · 21 min read
Design and Performance Evaluation of the Ursa Distributed Block Storage System
Architect
Architect
Mar 4, 2016 · Cloud Computing

Understanding Ceph RBD Snapshots, Clones, and Recovery Mechanisms

This article explains the implementation of Ceph RBD snapshots, the associated metadata structures, clone operations, and the detailed recovery processes for both replica and primary OSDs, illustrating how copy‑on‑write and snapshot chains affect data consistency and performance.

COWCephClones
0 likes · 15 min read
Understanding Ceph RBD Snapshots, Clones, and Recovery Mechanisms
21CTO
21CTO
Mar 2, 2016 · Operations

Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices

This article outlines the architecture of large‑scale dynamic web applications, detailing essential subsystems such as the web front‑end, load balancer, database cluster, caching layer, distributed storage, server management, and code deployment, and explains how they work together to ensure reliability, scalability, and maintainability.

Load BalancingServer Managementcaching
0 likes · 9 min read
Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices
Qunar Tech Salon
Qunar Tech Salon
Feb 21, 2016 · Backend Development

Evolution and Best Practices of Image Server Architecture for Large-Scale Websites

This article chronicles the progression of image server architectures—from single‑machine setups to clustered, shared‑storage, and CDN‑backed solutions—highlighting design pitfalls, scalability challenges, and practical recommendations for building reliable, high‑performance image services in modern web applications.

CDNFastDFSdistributed storage
0 likes · 16 min read
Evolution and Best Practices of Image Server Architecture for Large-Scale Websites
Meituan Technology Team
Meituan Technology Team
Feb 7, 2016 · Databases

Large-Scale Storage Systems: Best Practices and Architecture

The article reviews best‑practice designs for massive O2O e‑commerce storage, summarizing a Jan 30 technical salon where Meituan’s Cheng Zhenqiang detailed KV storage optimization, Alibaba Cloud’s Zhang Zirong explained high‑performance server architecture tuning, and Meituan Cloud’s Li Kai presented a unified distributed storage system with cross‑data‑center availability, erasure coding, and metadata management.

Database SystemsKV storagedistributed storage
0 likes · 5 min read
Large-Scale Storage Systems: Best Practices and Architecture
21CTO
21CTO
Jan 30, 2016 · Operations

Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices

This article explains how large‑scale dynamic web applications are built from core subsystems—including web front‑end, load balancing, database clustering, caching, distributed storage, server management, and code deployment—to achieve reliability, scalability, and maintainability for high‑traffic sites.

Load Balancingcachingdatabase clustering
0 likes · 7 min read
Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices
21CTO
21CTO
Jan 12, 2016 · Backend Development

Scalable Distributed Image Storage and Load Balancing for Web Sites

This article explains why serving many images strains web servers, outlines the challenges of I/O bottlenecks, and presents a practical, scalable solution that uses distributed image servers, dynamic load balancing, random selection algorithms, and health monitoring to improve performance for medium‑size business sites.

Backend ArchitectureLoad Balancingdistributed storage
0 likes · 9 min read
Scalable Distributed Image Storage and Load Balancing for Web Sites
Architect
Architect
Dec 17, 2015 · Operations

Ceph Performance Optimization: Methodology, Hardware and Software Tuning Guide

This article summarizes practical methodologies and detailed hardware and software tuning steps—including CPU, memory, network, SSD selection, BIOS settings, Linux kernel parameters, Ceph configuration options, PG calculation, and CRUSH map adjustments—to improve Ceph distributed storage performance.

CephConfigurationHardware Tuning
0 likes · 11 min read
Ceph Performance Optimization: Methodology, Hardware and Software Tuning Guide
Architects' Tech Alliance
Architects' Tech Alliance
Nov 20, 2015 · Cloud Computing

Overview of Nutanix Distributed Storage Architecture

The article explains Nutanix’s hyper‑converged architecture, detailing its storage‑control virtual machine, distributed metadata services, data tiering with FlashStore and DiskStore, support for multiple hypervisors, and advanced features such as snapshots, compression, and real‑time vDisk migration.

Cloud ComputingNutanixdistributed storage
0 likes · 9 min read
Overview of Nutanix Distributed Storage Architecture
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Nov 20, 2015 · Big Data

Design and Implementation of Alibaba Cloud's Cross‑Data‑Center Hadoop Cluster

In 2013 Alibaba Cloud faced full rack capacity in a single IDC, prompting the development of a multi‑NameNode, cross‑data‑center Hadoop solution that overcomes NameNode scalability, inter‑site bandwidth limits, data placement, job scheduling, massive data migration, and user transparency challenges.

Cross‑Data‑CenterFederationHadoop
0 likes · 14 min read
Design and Implementation of Alibaba Cloud's Cross‑Data‑Center Hadoop Cluster
21CTO
21CTO
Nov 16, 2015 · Cloud Computing

How JD.com Scales Storage, Caching, and Messaging with Its Own Cloud Platform

This article explains how JD.com’s three‑layer cloud architecture—storage, middleware, and elastic compute—addresses challenges of massive unstructured data, ever‑growing caches, high‑volume messaging, and rapid service deployment using home‑grown systems like JFS, Jimdb, JMQ, and JSF.

Cloud ComputingElastic ComputeMessage Queue
0 likes · 11 min read
How JD.com Scales Storage, Caching, and Messaging with Its Own Cloud Platform
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 21, 2015 · Big Data

Design Choices for Distributed Storage Metadata: Comparing GlusterFS, Hadoop, GridFS, HBase, and FastDFS

The article examines various distributed storage design approaches—decentralized (GlusterFS), centralized (Hadoop), database‑based (GridFS and HBase), and metadata‑bypassing (FastDFS)—detailing their advantages, drawbacks, and practical considerations for cloud storage systems.

FastDFSGlusterFSGridFS
0 likes · 17 min read
Design Choices for Distributed Storage Metadata: Comparing GlusterFS, Hadoop, GridFS, HBase, and FastDFS
Suning Technology
Suning Technology
Apr 30, 2015 · Cloud Computing

Suning CloudStack Salon: Open‑Source Cloud, Docker, and Storage Insights

The April 25, 2015 Suning Cloud Computing sharing session in Nanjing gathered around 200 cloud enthusiasts and developers, featuring talks on CloudStack’s open‑source contributions, troubleshooting, Docker adoption, object storage practices, custom network design, and distributed storage systems, followed by Q&A and a group photo.

CloudStackDockerdistributed storage
0 likes · 6 min read
Suning CloudStack Salon: Open‑Source Cloud, Docker, and Storage Insights
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Apr 8, 2015 · Cloud Computing

Practices in Building Distributed Technologies for Large‑Scale Cloud Computing Platforms

The article summarizes Dr. Zhang Wensong’s 2014 ArchSummit keynote on the challenges, architectural design, storage strategies, performance optimizations, monitoring, and future directions of Alibaba Cloud’s large‑scale distributed cloud computing platform, covering ECS, SLB, RDS, OCS and full‑link analytics.

ECSMonitoringRDS
0 likes · 17 min read
Practices in Building Distributed Technologies for Large‑Scale Cloud Computing Platforms
Baidu Tech Salon
Baidu Tech Salon
Apr 22, 2014 · Operations

Baidu's Optimization of MooseFS and Redis: Architecture Improvements and Performance Enhancement

At Baidu’s 49th Technical Salon, Cheng Yishi explained how the company revamped its MooseFS and Redis systems by adding a Shadow Master to split reads from writes, introducing Slave nodes for failover, and deploying a Redis proxy middleware, thereby dramatically improving performance, scalability, and high‑availability for critical services.

BaiduFailoverHigh Availability
0 likes · 6 min read
Baidu's Optimization of MooseFS and Redis: Architecture Improvements and Performance Enhancement