BestHub
Sign in
Tagged articles

storage

480 articles · Page 3 of 5
Architects' Tech Alliance
Architects' Tech Alliance
Aug 1, 2022 · Fundamentals

Specialized Data Processor (DPU) Performance Benchmark Methodology and Implementation

The whitepaper introduces a comprehensive DPU performance benchmark methodology, detailing evaluation criteria across network, storage, compute, and security dimensions, and provides guidance on building test systems, selecting workloads, and designing metrics to enable fair, open, and objective assessment of diverse DPU products.

ComputeDPUnetwork
0 likes · 10 min read
Specialized Data Processor (DPU) Performance Benchmark Methodology and Implementation
ByteDance Web Infra
ByteDance Web Infra
Jul 22, 2022 · Fundamentals

Challenges and Optimizations for Large Git Repositories

This article examines why Git struggles with monolithic repositories exceeding 100 GB, outlines storage, performance, stability, and reliability challenges, and presents preventive, mid‑process, and post‑process strategies—including LFS, shallow and partial clones, commit‑graph, bitmap, multi‑pack index, and bundle techniques—to efficiently manage and maintain large Git monorepos.

GitOptimizationlarge-repo
0 likes · 16 min read
Challenges and Optimizations for Large Git Repositories
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jun 29, 2022 · Artificial Intelligence

Music FeatureBox: A Custom Feature Store for Machine Learning at NetEase Cloud Music

Music FeatureBox is NetEase Cloud Music’s custom feature store that centralizes metadata, unifies offline and online feature storage across multiple engines, provides a cross‑language DSL for extraction, ensures training‑inference data consistency, and offers built‑in monitoring, thereby streamlining feature engineering and accelerating the platform’s machine‑learning lifecycle.

DataHubFeature StoreMLOps
0 likes · 17 min read
Music FeatureBox: A Custom Feature Store for Machine Learning at NetEase Cloud Music
DataFunTalk
DataFunTalk
Jun 25, 2022 · Big Data

Alluxio Metadata and Data Synchronization: Design, Implementation, and Optimization

This article provides a comprehensive overview of Alluxio's metadata and data synchronization mechanisms, covering its unified namespace, mounting strategies, consistency models, various write modes, read workflows, metadata sync techniques, performance optimizations, and recommended configurations for different deployment scenarios.

AlluxioData Consistencymetadata synchronization
0 likes · 26 min read
Alluxio Metadata and Data Synchronization: Design, Implementation, and Optimization
Architects' Tech Alliance
Architects' Tech Alliance
Jun 4, 2022 · Operations

Comprehensive Survey of Large‑Scale RDMA Technologies and Practices

This article provides a detailed overview of large‑scale RDMA technology, covering basic concepts, major protocols, network‑level techniques such as congestion control, lossless‑to‑lossy evolution and multipath, virtualization, communication libraries for AI training and storage, performance tuning, monitoring, and real‑world deployment experiences.

AIRDMAVirtualization
0 likes · 16 min read
Comprehensive Survey of Large‑Scale RDMA Technologies and Practices
DataFunSummit
DataFunSummit
Jun 2, 2022 · Databases

An In‑Depth Overview of Apache BookKeeper: Architecture, Features, and Use Cases

This article provides a comprehensive technical overview of Apache BookKeeper, covering its role as a distributed append‑only log service, core concepts, high‑availability mechanisms, storage‑media evolution, comparisons with Raft, and community resources, while illustrating its use in Pulsar and large‑scale data platforms.

Apache BookKeeperData InfrastructureDistributed Log
0 likes · 12 min read
An In‑Depth Overview of Apache BookKeeper: Architecture, Features, and Use Cases
dbaplus Community
dbaplus Community
May 23, 2022 · Cloud Native

Why Kubernetes Is the Core of Cloud‑Native Architecture: A Deep Dive

This article provides a comprehensive overview of Kubernetes, covering its revolutionary role in cloud computing, master‑worker architecture, core concepts such as Pods and Controllers, storage and networking models, workload types, and extensibility through CRI, CNI, and CSI standards.

Cloud NativeContainer OrchestrationKubernetes
0 likes · 18 min read
Why Kubernetes Is the Core of Cloud‑Native Architecture: A Deep Dive
Open Source Linux
Open Source Linux
May 20, 2022 · Fundamentals

Why SSDs Outperform HDDs: Inside the Mechanics of Modern Storage

This article explains why solid‑state drives outperform mechanical hard drives by detailing their distinct operating principles, covering HDD magnetic storage, SSD floating‑gate transistors, and how these differences affect data writing, reading, erasing, and overall performance, especially for random access.

HDDHardwareSSD
0 likes · 7 min read
Why SSDs Outperform HDDs: Inside the Mechanics of Modern Storage
Cloud Native Technology Community
Cloud Native Technology Community
May 5, 2022 · Cloud Native

What’s New in Kubernetes 1.24? Key Features and Changes Explained

Kubernetes 1.24, released in early 2022, introduces 46 enhancements—including the removal of dockershim, default‑off test APIs, signed release artifacts, OpenAPI v3 support, GA storage capacity tracking and volume expansion, new CNI requirements, and numerous API graduations—while also deprecating or deleting several legacy components.

Cloud NativeFeature HighlightsKubernetes
0 likes · 18 min read
What’s New in Kubernetes 1.24? Key Features and Changes Explained
Practical DevOps Architecture
Practical DevOps Architecture
Apr 12, 2022 · Cloud Native

Setting Up NFS Storage in Kubernetes with Helm

This guide walks through configuring an NFS server, installing required utilities, creating a dedicated namespace, installing Helm, and deploying the nfs-client-provisioner chart to provide dynamic NFS storage for workloads in a Kubernetes cluster.

Cloud NativeHelmLinux
0 likes · 3 min read
Setting Up NFS Storage in Kubernetes with Helm
Architects' Tech Alliance
Architects' Tech Alliance
Mar 29, 2022 · Fundamentals

Understanding Linux Ext Filesystems, RAID, and LVM

This article explains the structure of Linux Ext (2/3/4) file systems, the role of superblocks and block groups, compares hardware and software RAID, and introduces LVM as a flexible volume management solution, highlighting its benefits and potential risks.

Ext filesystemLVMLinux
0 likes · 5 min read
Understanding Linux Ext Filesystems, RAID, and LVM
Architects' Tech Alliance
Architects' Tech Alliance
Mar 21, 2022 · Databases

Oracle Real Application Cluster (RAC) Architecture, Components, Storage Options and Management

The article provides a comprehensive overview of Oracle Real Application Cluster (RAC), detailing its two‑part architecture of Clusterware and RAC instances, shared storage configurations, key Clusterware processes, storage options, benefits such as load balancing and high availability, as well as its management and planning considerations.

ClusterwareDatabaseOracle
0 likes · 13 min read
Oracle Real Application Cluster (RAC) Architecture, Components, Storage Options and Management
Ops Development Stories
Ops Development Stories
Feb 25, 2022 · Operations

Recovering a Ceph 16 Cluster After System Disk Failure

This guide walks through the step‑by‑step process of restoring a Ceph 16 cluster when a node's system disk fails, covering host removal, node re‑initialization, Docker and Cephadm installation, host addition, labeling, OSD recreation, and final verification.

CephCluster RecoveryOperations
0 likes · 7 min read
Recovering a Ceph 16 Cluster After System Disk Failure
Architects Research Society
Architects Research Society
Jan 25, 2022 · Big Data

Azure Data Lake Storage Gen2: Design Guide, Best Practices, and Operational Considerations

This guide provides a comprehensive overview of Azure Data Lake Storage Gen2, covering when to use it, key design considerations, data organization strategies, access control models, file formats, cost‑optimization techniques, monitoring approaches, and performance‑tuning tips for large‑scale big‑data workloads.

ADLS Gen2AzureBig Data
0 likes · 41 min read
Azure Data Lake Storage Gen2: Design Guide, Best Practices, and Operational Considerations
Architects' Tech Alliance
Architects' Tech Alliance
Jan 20, 2022 · Industry Insights

Why NVIDIA’s BlueField DPU Is Redefining Modern Data Center Architecture

The 2021 China DPU Industry Whitepaper outlines how NVIDIA’s BlueField DPU series—BlueField‑2, the upcoming 400 Gb/s BlueField‑3, and future BlueField‑4—offload and accelerate networking, storage, security, and AI workloads, offering programmable ARM cores, high‑performance NICs, and a rich DOCA ecosystem that reshapes data‑center infrastructure.

BlueFieldDOCADPU
0 likes · 14 min read
Why NVIDIA’s BlueField DPU Is Redefining Modern Data Center Architecture
Yiche Technology
Yiche Technology
Dec 31, 2021 · Cloud Native

Integrating Virtualization and Containerization with KubeVirt: Practices and Architecture at Yiche

This article describes Yiche's cloud‑native transformation that unifies virtualization and containerization by evaluating Kata, Virtlet and KubeVirt, selecting KubeVirt, detailing its architecture, storage integration, custom enhancements, deployment challenges, and future work for a hybrid infrastructure.

KubeVirtVirtualizationcloud-native
0 likes · 14 min read
Integrating Virtualization and Containerization with KubeVirt: Practices and Architecture at Yiche
Code DAO
Code DAO
Dec 29, 2021 · Artificial Intelligence

Inside Optuna: How Its Core Components Enable Hyper‑Parameter Optimization

This article dissects Optuna’s internal design by building three miniature versions (Minituna v1‑v3) that illustrate its main components, storage layer, sampling APIs, pruning mechanisms, and joint‑sampling concepts, while comparing them with Optuna’s full implementation.

MinitunaOptunaPruning
0 likes · 24 min read
Inside Optuna: How Its Core Components Enable Hyper‑Parameter Optimization
Architects' Tech Alliance
Architects' Tech Alliance
Dec 14, 2021 · Industry Insights

Why NVIDIA’s BlueField DPU Is Redefining Data‑Center Architecture

The article provides an in‑depth analysis of NVIDIA’s BlueField DPU series—detailing the roadmap from BlueField‑2 to BlueField‑4, the technical capabilities of BlueField‑3 across networking, security, and storage, and the DOCA ecosystem that enables programmable, hardware‑accelerated data‑center services, positioning DPUs as a core pillar of modern cloud infrastructure.

BlueFieldDPUData Center
0 likes · 14 min read
Why NVIDIA’s BlueField DPU Is Redefining Data‑Center Architecture
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 4, 2021 · Big Data

Understanding Spark's BlockManager, MemoryStore, and DiskStore

This article explains Spark's storage architecture, detailing the roles and interactions of BlockManager, MemoryStore, and DiskStore, including their initialization, data management mechanisms, code implementations, and eviction strategies, to help readers grasp how Spark efficiently handles in‑memory and on‑disk data.

Big DataBlockManagerDiskStore
0 likes · 12 min read
Understanding Spark's BlockManager, MemoryStore, and DiskStore
DataFunTalk
DataFunTalk
Nov 13, 2021 · Cloud Native

Designing Cloud‑Native Distributed Database Architecture: Lessons from TiDB

This article explores how to design a cloud‑native distributed database architecture by examining TiDB’s current structure, proposing a storage‑compute separation that leverages cloud services like S3 and EBS, and discussing implications for cost, scalability, fault‑tolerance, and multi‑tenant deployment.

Fault ToleranceTiDBarchitecture
0 likes · 14 min read
Designing Cloud‑Native Distributed Database Architecture: Lessons from TiDB
DataFunSummit
DataFunSummit
Nov 13, 2021 · Cloud Native

Designing Cloud‑Native Distributed Database Architecture: Insights from TiDB

This article explores how to design a cloud‑native distributed database architecture using TiDB as a case study, discussing cost reduction, storage choices, compute‑storage separation, fault tolerance, scaling strategies, and the trade‑offs of caching and persistent storage in modern cloud environments.

TiDBarchitecturecloud-native
0 likes · 15 min read
Designing Cloud‑Native Distributed Database Architecture: Insights from TiDB
Tencent Architect
Tencent Architect
Nov 10, 2021 · Databases

How Tencent’s TDSQL‑C Achieves PB‑Scale Storage and Serverless Elasticity

The article details Tencent Cloud's TDSQL‑C cloud‑native database, explaining traditional database bottlenecks, its four standout features—PB‑level storage, second‑level scaling, rapid snapshot backup, and serverless pay‑as‑you‑go—and the deep kernel optimizations that enable these capabilities while outlining future performance and cross‑region goals.

Databaseperformancescalability
0 likes · 7 min read
How Tencent’s TDSQL‑C Achieves PB‑Scale Storage and Serverless Elasticity
Architects' Tech Alliance
Architects' Tech Alliance
Nov 4, 2021 · Fundamentals

Demystifying NVMe: From Protocol Basics to PCIe Register Configurations

This comprehensive guide explains the NVMe specification, covering terminology, SSD architecture, PCIe register layout, queue structures, arbitration mechanisms, data addressing methods, command formats, controller operation, reset procedures, interrupt handling, and advanced features such as firmware updates and end‑to‑end data protection.

HardwareNVMePCIe
0 likes · 24 min read
Demystifying NVMe: From Protocol Basics to PCIe Register Configurations
Cloud Native Technology Community
Cloud Native Technology Community
Oct 29, 2021 · Cloud Native

Understanding Kubernetes CSI: Persistent Volume Lifecycle and Component Interaction

This article explains how Kubernetes CSI enables out‑of‑tree persistent storage by detailing the PV lifecycle—Create, Attach, Detach, Mount, Unmount, Delete—and describing the roles of core components such as apiserver, PVController, external‑provisioner, external‑attacher, and kubelet, with code examples and diagrams.

CSICloud NativeKubernetes
0 likes · 15 min read
Understanding Kubernetes CSI: Persistent Volume Lifecycle and Component Interaction
Efficient Ops
Efficient Ops
Oct 12, 2021 · Fundamentals

Why cp Copies a 100GB File Instantly: Sparse Files and Inode Basics

An unexpected fast copy of a 100 GB file using the cp command reveals the concept of sparse files, where the logical size differs from physical disk usage, and explains how file systems employ inodes, block allocation, and multi‑level indexing to manage storage efficiently.

file systeminodestorage
0 likes · 11 min read
Why cp Copies a 100GB File Instantly: Sparse Files and Inode Basics
Open Source Linux
Open Source Linux
Oct 7, 2021 · Fundamentals

Understanding RAID Levels: From RAID 0 to RAID 10 and Beyond

This article explains the purpose and principles of RAID arrays, compares common RAID levels (0, 1, 5, 6, 10) and JBOD, and outlines advanced configurations such as RAID N+N, helping readers choose the right storage solution for performance and reliability.

JBODRAIDdata redundancy
0 likes · 5 min read
Understanding RAID Levels: From RAID 0 to RAID 10 and Beyond
Baidu Intelligent Testing
Baidu Intelligent Testing
Sep 28, 2021 · Databases

Design and Evolution of BaikalDB: A Cloud‑Native Distributed Database for Commercial Advertising Systems

This article examines the business storage requirements of large‑scale advertising platforms and details how BaikalDB was architected as a cloud‑native, MySQL‑compatible distributed database that combines OLTP, OLAP, KV and full‑text capabilities while ensuring high reliability, low cost and linear scalability.

AdvertisingBaikalDBCloud Native
0 likes · 24 min read
Design and Evolution of BaikalDB: A Cloud‑Native Distributed Database for Commercial Advertising Systems
Top Architect
Top Architect
Sep 17, 2021 · Backend Development

Kafka Storage Mechanism and Reliability Guarantees

This article explains Kafka's storage architecture, including segment files and indexing, and details the reliability mechanisms such as ISR, OSR, LEO, HW, producer acknowledgment levels, and leader election strategies to ensure data consistency and availability.

KafkaMessage Queuereliability
0 likes · 9 min read
Kafka Storage Mechanism and Reliability Guarantees
IT Architects Alliance
IT Architects Alliance
Aug 29, 2021 · Big Data

Kafka Storage Mechanism and Reliability Guarantees

This article explains Kafka's storage architecture—including topics, partitions, segments, and their naming rules—along with how data is read, and details the system's reliability features such as ISR/OSR replication, leader election, producer acknowledgment levels, and delivery guarantees.

At-Least-OnceLeader ElectionSegment
0 likes · 10 min read
Kafka Storage Mechanism and Reliability Guarantees
Open Source Linux
Open Source Linux
Aug 5, 2021 · Fundamentals

Understanding DAS, NAS, SAN and RAID: A Complete Storage Fundamentals Guide

This article provides a comprehensive overview of storage fundamentals, covering the concepts, architectures, and use cases of Direct‑Access Storage (DAS), Network‑Attached Storage (NAS), Storage Area Networks (SAN), and detailed explanations of RAID levels, their advantages, limitations, and implementation options.

DASNASRAID
0 likes · 25 min read
Understanding DAS, NAS, SAN and RAID: A Complete Storage Fundamentals Guide
Ops Development Stories
Ops Development Stories
Aug 5, 2021 · Cloud Native

How to Deploy NFS Subdir External Provisioner on Kubernetes with HA

This guide walks through deploying the NFS‑subdir‑external‑provisioner on Kubernetes, covering migration to the new repository, configuring storage classes with subdirectory support, applying RBAC resources, creating PVCs, enabling high‑availability with leader election, and troubleshooting common mount errors.

Cloud NativeHigh AvailabilityKubernetes
0 likes · 14 min read
How to Deploy NFS Subdir External Provisioner on Kubernetes with HA
IT Architects Alliance
IT Architects Alliance
Jul 22, 2021 · Cloud Computing

How to Build Scalable Private and Hybrid Cloud Architectures

This article explains how to design private and hybrid cloud architectures, outlines essential open‑source technologies, discusses scalability, availability, manageability and feasibility, and provides practical guidance on resource measurement, queue load‑balancing, and error‑data handling for robust cloud systems.

Cloud Computingarchitectureelasticity
0 likes · 7 min read
How to Build Scalable Private and Hybrid Cloud Architectures
MaGe Linux Operations
MaGe Linux Operations
Jul 5, 2021 · Cloud Native

How Do Cloud‑Native Storage Solutions Stack Up? Performance Insights

This article examines typical storage options for stateful applications in cloud‑native environments, compares mainstream cloud‑native storage products through performance testing, discusses the challenges of multi‑cloud deployments, outlines criteria for selecting storage solutions, and highlights the advantages of distributed and cloud‑native storage systems for modern workloads.

Multi-Cloudcloud-nativedistributed-systems
0 likes · 15 min read
How Do Cloud‑Native Storage Solutions Stack Up? Performance Insights
Sohu Tech Products
Sohu Tech Products
Jun 23, 2021 · Cloud Native

Containerizing Stateful Services on Kubernetes: Challenges, Solutions, and Best Practices

This article examines the difficulties of running stateful services such as Redis, etcd, and MySQL on Kubernetes and presents practical solutions—including workload selection, CRD/operator extensions, scheduling strategies, high‑availability mechanisms, performance‑optimized networking and storage, and chaos‑engineering validation—to achieve reliable, high‑performance containerized deployments.

High AvailabilityKubernetesNetworking
0 likes · 32 min read
Containerizing Stateful Services on Kubernetes: Challenges, Solutions, and Best Practices
Liangxu Linux
Liangxu Linux
May 27, 2021 · Fundamentals

Understanding Linux File Systems Through MINIX: A Visual Guide

This article explains the principles of Linux file systems using clear diagrams and the simple MINIX file system as a teaching example, covering hard‑drive basics, file and directory structures, inode layouts, formatting layout, and step‑by‑step file‑reading procedures.

LinuxMINIXoperating-system
0 likes · 11 min read
Understanding Linux File Systems Through MINIX: A Visual Guide
Architects' Tech Alliance
Architects' Tech Alliance
May 6, 2021 · Operations

Key Technical Considerations for Dual‑Active Data Center Architecture

The article explains dual‑active data‑center disaster‑recovery architecture, covering SAN vs NAS storage options, distance, network, performance, true active‑active versus active‑passive designs, multipathing considerations, and provides a downloadable comprehensive guide to implementation for practitioners.

Disaster RecoveryDual-Activestorage
0 likes · 7 min read
Key Technical Considerations for Dual‑Active Data Center Architecture
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Apr 25, 2021 · Databases

Overview of Database System Design

This article provides a comprehensive overview of database system design, covering the historical evolution, classification of relational and NoSQL databases, common architectures, consistency models, indexing techniques, storage formats, compression, and practical considerations for selecting and optimizing database solutions.

DatabaseIndexingSystem Design
0 likes · 45 min read
Overview of Database System Design
iQIYI Technical Product Team
iQIYI Technical Product Team
Apr 23, 2021 · Cloud Native

ByteDance Stateful Application Cloud‑Native Practices

ByteDance’s cloud‑native migration of stateful services uses a custom SolarService extending StatefulSet with Budset CRD to handle versioned data, shard‑aware routing, NUMA‑aware scheduling, advanced storage, eBPF monitoring, and automated PDB eviction, delivering efficiency, cost savings, and reliable rolling upgrades.

AutomationKubernetesMonitoring
0 likes · 18 min read
ByteDance Stateful Application Cloud‑Native Practices
macrozheng
macrozheng
Apr 14, 2021 · Databases

Why You Should Avoid NULL Columns in MySQL: Performance, Storage, and Index Impacts

This article explains why setting MySQL columns to NOT NULL improves query optimization, reduces index complexity, saves storage space, and prevents unexpected behavior in calculations, while also detailing default values, handling of NULL in aggregates, and the internal row format differences between NULLable and NOT NULL columns.

Database DesignIndexingNOT NULL
0 likes · 12 min read
Why You Should Avoid NULL Columns in MySQL: Performance, Storage, and Index Impacts
IT Architects Alliance
IT Architects Alliance
Mar 21, 2021 · Cloud Computing

Cloud Computing Reference Architecture and Design Considerations

The article presents a comprehensive cloud computing reference architecture, illustrating private and hybrid cloud designs, discussing platform choices, storage solutions, scalability, elasticity, and key considerations such as availability, manageability, and feasibility for building robust, cost‑effective systems.

Cloud Computingarchitectureelasticity
0 likes · 6 min read
Cloud Computing Reference Architecture and Design Considerations
Open Source Linux
Open Source Linux
Mar 5, 2021 · Fundamentals

Understanding Linux Virtual File Systems and NVDIMM Persistent Memory

This article explains the Linux virtual file system architecture, the differences between storage media such as HDD, SSD, NAND and NOR flash, introduces NVDIMM‑N/F/P types, their hardware and software handling, and shows how to configure and use persistent memory (PMEM) with DAX, BTT and kernel memmap on Linux.

DAXLinuxNVDIMM
0 likes · 35 min read
Understanding Linux Virtual File Systems and NVDIMM Persistent Memory
360 Tech Engineering
360 Tech Engineering
Jan 25, 2021 · Cloud Computing

KubeVirt: Integrating Virtual Machines into Kubernetes – Architecture, Operations, and SDK Usage

This article explains how KubeVirt extends Kubernetes to manage virtual machines, covering the background of OpenStack‑to‑K8s migration, technical selection, KubeVirt architecture, CRDs, components, common operations, storage and networking choices, SDK usage, and practical deployment experiences within a private cloud platform.

CephKubeVirtKubernetes
0 likes · 23 min read
KubeVirt: Integrating Virtual Machines into Kubernetes – Architecture, Operations, and SDK Usage
Cloud Native Technology Community
Cloud Native Technology Community
Jan 25, 2021 · Cloud Native

How KubeVirt Extends Kubernetes to Manage Virtual Machines and Bare Metal

This article examines the challenges of running both VMs and containers in a hybrid OpenStack‑Kubernetes environment, evaluates KubeVirt against alternatives such as Virtlet and Kata, and provides detailed guidance on KubeVirt architecture, CRDs, storage, networking, SDK usage, and integration with internal platforms.

Cloud NativeKubeVirtKubernetes
0 likes · 25 min read
How KubeVirt Extends Kubernetes to Manage Virtual Machines and Bare Metal
Ops Development Stories
Ops Development Stories
Jan 15, 2021 · Operations

How to Deploy a Multi‑Node Ceph Cluster on CentOS 7 – Step‑by‑Step Guide

This article provides a comprehensive, step‑by‑step tutorial for setting up a three‑node Ceph storage cluster on CentOS 7.9, covering host configuration, firewall and SELinux settings, package installation, monitor, manager, OSD, MDS, and RGW deployment, along with required keyrings, configuration files, and troubleshooting tips.

CentOSCephCluster Deployment
0 likes · 20 min read
How to Deploy a Multi‑Node Ceph Cluster on CentOS 7 – Step‑by‑Step Guide
Top Architect
Top Architect
Dec 30, 2020 · Backend Development

Using Kafka as a Storage System for Twitter’s Account Activity Replay API

The article explains how Twitter built the Account Activity Replay API by repurposing Kafka as a storage layer, detailing the system’s architecture, partitioning strategy, request handling, deduplication, and performance optimizations to provide reliable event recovery for developers.

InfrastructureKafkaTwitter
0 likes · 8 min read
Using Kafka as a Storage System for Twitter’s Account Activity Replay API
Architects' Tech Alliance
Architects' Tech Alliance
Dec 6, 2020 · Operations

Understanding Data Centers: Architecture, Reliability, and Emerging Technologies

This article explains what a data center is, its core components of compute, storage, and networking, the operational and architectural considerations for reliability and security, and reviews industry standards and emerging technologies such as edge computing, cloud integration, SDN, HCI, containers, NVMe, and GPU acceleration.

Edge computingGPUInfrastructure
0 likes · 12 min read
Understanding Data Centers: Architecture, Reliability, and Emerging Technologies
Efficient Ops
Efficient Ops
Dec 2, 2020 · Cloud Native

Mastering Kubernetes Storage: Volumes, PVs, PVCs, and CSI Explained

This article explains Kubernetes storage fundamentals—including Volumes, PersistentVolumes, PersistentVolumeClaims, StorageClasses, and the evolution from in‑tree plugins to FlexVolume and CSI—while providing practical YAML examples and highlighting how to mount persistent data onto cluster nodes.

CSIKubernetesPersistentVolume
0 likes · 8 min read
Mastering Kubernetes Storage: Volumes, PVs, PVCs, and CSI Explained
vivo Internet Technology
vivo Internet Technology
Nov 25, 2020 · Databases

Understanding Elasticsearch Architecture, Indexing, and Storage Mechanisms

Elasticsearch combines Lucene’s inverted index with a distributed cluster of master‑eligible, data, and coordinating nodes, using Zen discovery for node election and split‑brain prevention, while indexing writes to primary shards, replicating to replicas, storing immutable segments that are periodically merged for efficient search.

ClusterDistributed ArchitectureElasticsearch
0 likes · 19 min read
Understanding Elasticsearch Architecture, Indexing, and Storage Mechanisms
Open Source Linux
Open Source Linux
Nov 17, 2020 · Fundamentals

Cache vs Buffer: Clear Visual Guide to Their Core Differences

This article provides a concise, visual explanation of the fundamental differences between cache and buffer, illustrating their distinct roles—cache for speeding data retrieval and buffer for smoothing data flow—through real‑world analogies, hardware examples, and practical usage scenarios.

Buffercomputer architecturestorage
0 likes · 5 min read
Cache vs Buffer: Clear Visual Guide to Their Core Differences
Selected Java Interview Questions
Selected Java Interview Questions
Nov 8, 2020 · Backend Development

Designing a Scalable Feed Stream System Architecture

This article explains the principles, data models, storage choices, synchronization strategies, metadata handling, and scaling considerations for building a high‑performance feed‑stream system that can support millions to billions of users, with practical guidance on using NoSQL or relational databases.

NoSQLSystem DesignTablestore
0 likes · 21 min read
Designing a Scalable Feed Stream System Architecture
Practical DevOps Architecture
Practical DevOps Architecture
Nov 8, 2020 · Operations

How to Configure BIOS and Create RAID 5 Volumes

This guide walks through entering the BIOS, selecting system settings, configuring the storage controller, creating RAID 0/1/5 volumes with specific capacities, and verifying the status of each logical volume using step‑by‑step screenshots.

BIOSOperationsRAID
0 likes · 3 min read
How to Configure BIOS and Create RAID 5 Volumes
Architects' Tech Alliance
Architects' Tech Alliance
Nov 6, 2020 · Fundamentals

Fundamentals of Server Hardware, Storage, and Network Interfaces

This article provides a comprehensive overview of server fundamentals, covering definitions, high‑performance characteristics, core components such as CPU, memory, disks and RAID, various CPU architectures, server classifications, C/S and B/S models, and detailed explanations of network interface cards, their functions, classifications, port types, and cable options.

HardwareIT fundamentalsRAID
0 likes · 6 min read
Fundamentals of Server Hardware, Storage, and Network Interfaces
Architects' Tech Alliance
Architects' Tech Alliance
Nov 2, 2020 · Fundamentals

Understanding NFS and pNFS: Architecture, Protocols, and Performance

This article explains how the Network File System (NFS) enables file sharing across heterogeneous operating systems, describes the limitations of traditional NFS for high‑performance computing, and introduces pNFS (NFSv4.1) with its three protocols, layout types, and performance advantages for large‑scale parallel storage.

NFSParallel I/Ofile system
0 likes · 11 min read
Understanding NFS and pNFS: Architecture, Protocols, and Performance
Architects' Tech Alliance
Architects' Tech Alliance
Nov 1, 2020 · Fundamentals

Essential Storage Fundamentals: RAID, Snapshots, Backup, CDP, Clustering, and VTL Explained

This guide provides a concise overview of core storage concepts—including RAID levels, COW/ROW snapshot mechanisms, backup strategies, continuous data protection, clustering architectures, and virtual tape library (VTL) implementations—helping readers understand how each technology contributes to data reliability and availability.

BackupCDPClustering
0 likes · 4 min read
Essential Storage Fundamentals: RAID, Snapshots, Backup, CDP, Clustering, and VTL Explained
IT Architects Alliance
IT Architects Alliance
Nov 1, 2020 · Industry Insights

What Are the Five Core Data Replication Techniques for Disaster Recovery?

This article breaks down the five major data replication approaches—application‑level, host‑level, database‑level, storage‑gateway, and storage‑media—detailing their principles, advantages, drawbacks, and typical use cases to help professionals design effective disaster‑recovery solutions.

BackupData ReplicationDisaster Recovery
0 likes · 12 min read
What Are the Five Core Data Replication Techniques for Disaster Recovery?
Architects' Tech Alliance
Architects' Tech Alliance
Nov 1, 2020 · Databases

Overview of Data Replication Technologies for Disaster Recovery

The article introduces the 2021 China Disaster Recovery Whitepaper and explains five layers of data replication—application, host, database, storage‑gateway, and storage‑media—detailing their mechanisms, advantages, limitations, and use cases in modern backup and business continuity solutions.

BackupData ReplicationTechnology
0 likes · 12 min read
Overview of Data Replication Technologies for Disaster Recovery
Architects' Tech Alliance
Architects' Tech Alliance
Oct 25, 2020 · Operations

Understanding Data Backup Techniques: File‑Level, Block‑Level, Remote Copy, Snapshots and Volume Clone

This article explains the fundamentals and classifications of data backup technologies—including file‑level and block‑level protection, remote file copy, remote volume imaging, snapshot mechanisms, CoFW vs RoFW strategies, and volume clone methods—while also covering backup destinations, paths, and common backup strategies.

BackupOperationsblock-level
0 likes · 20 min read
Understanding Data Backup Techniques: File‑Level, Block‑Level, Remote Copy, Snapshots and Volume Clone
Liangxu Linux
Liangxu Linux
Oct 22, 2020 · Fundamentals

Why CPU Access to Hard Drives Is So Slow: A Deep Dive into HDD, SSD, and I/O

Hard drives (HDD) and solid‑state drives (SSD) differ dramatically in latency; the article explains the orders‑of‑magnitude gap between CPU cache, memory, and disk access, details the I/O mechanisms (programmed I/O, interrupt‑driven I/O, DMA), and shows why mechanical drives are inherently slow.

CPUI/OSSD
0 likes · 11 min read
Why CPU Access to Hard Drives Is So Slow: A Deep Dive into HDD, SSD, and I/O
ITPUB
ITPUB
Oct 16, 2020 · Operations

What CDN Architecture Evolution Says About the Future of IT and Storage

In an interview, ByteDance edge‑computing architect Zhou Chaoyong explains how CDN and storage architectures have evolved with rising data demands, predicts NVMe's dominance in the storage market, and previews his upcoming SACC 2020 talk on high‑performance XFS storage systems.

CDNEdge computingIT Architecture
0 likes · 9 min read
What CDN Architecture Evolution Says About the Future of IT and Storage
IT Architects Alliance
IT Architects Alliance
Oct 11, 2020 · Cloud Computing

Designing a Secure, Scalable Private Cloud: Principles, Architecture, and Best Practices

This article provides a comprehensive guide to building private cloud infrastructures, covering core principles of stability, scalability and redundancy, storage options, network design, compute resource planning, operating‑system choices, security mechanisms, cloud‑ification techniques, and practical OpenStack deployment examples.

OpenStackarchitecturenetwork
0 likes · 46 min read
Designing a Secure, Scalable Private Cloud: Principles, Architecture, and Best Practices
Programmer DD
Programmer DD
Oct 11, 2020 · Backend Development

Designing Scalable Feed Stream Systems: Architecture, Storage, and Sync Strategies

This article explains how to design a high‑performance feed‑stream system—covering product definition, data categories, storage options, synchronization modes, metadata handling, commenting, likes, search, sorting, deletion, and update—so you can build a solution that scales to millions or billions of users.

Backend ArchitectureScalableSystem Design
0 likes · 21 min read
Designing Scalable Feed Stream Systems: Architecture, Storage, and Sync Strategies
JD Cloud Developers
JD Cloud Developers
Sep 22, 2020 · Fundamentals

Designing High‑Reliability Storage Systems: Strategies from JD Cloud & Intel

An in‑depth look at how JD Cloud’s high‑reliability storage architecture tackles data reliability challenges—covering replica management, redundancy, detection and repair mechanisms, tiered storage designs, and Intel Optane’s role in boosting performance—offering practical strategies for balancing cost and resilience.

Data ReplicationIntel Optanecloud
0 likes · 17 min read
Designing High‑Reliability Storage Systems: Strategies from JD Cloud & Intel
Programmer DD
Programmer DD
Sep 20, 2020 · Cloud Native

Step-by-Step Guide: Deploy Ceph‑CSI (v3.1.0) with RBD on Kubernetes

This tutorial walks through deploying the Ceph‑CSI driver version 3.1.0 on a Kubernetes cluster using RBD as persistent storage, covering environment setup, Ceph pool and user creation, ConfigMap and Secret configuration, RBAC, CSI sidecar deployment, storage class definition, and a complete end‑to‑end test with PVC and pod.

CSICephCloud Native
0 likes · 12 min read
Step-by-Step Guide: Deploy Ceph‑CSI (v3.1.0) with RBD on Kubernetes