NVMe over Fabrics, leveraging PCIe and RDMA, replaces legacy SCSI and SAS protocols to deliver vastly higher bandwidth and lower latency for SSDs, enabling massive parallel I/O queues, and reshaping data‑center storage architectures through both FC‑NVMe and Ethernet‑based implementations.
This article details the architecture and practical techniques behind WeChat's large‑scale monitoring system, covering lightweight data collection, classification of real‑time, non‑real‑time and user‑specific metrics, anomaly detection algorithms, automated configuration, and high‑performance storage solutions for billions of events per minute.
This guide explains essential Linux storage commands—including fdisk, df, du, mount, and umount—covers automatic mounting via /etc/fstab, details disk partitioning with fdisk, and demonstrates how to format partitions using mkfs, providing practical examples for each step.
This article provides a detailed, curated list of the most popular Docker‑related tools across categories such as orchestration, CI/CD, monitoring, security, storage, networking and management, including brief descriptions, official links and cost information to help developers, DevOps engineers and platform architects choose the right solutions for every stage of the container lifecycle.
The 2017 KubeCon+CloudNativeCon in Austin showcased over 4,000 attendees, highlighted Kubernetes as the "Linux of the cloud," explored multi‑cloud strategies, service mesh adoption, storage challenges on Kubernetes, and underscored China's growing influence in the cloud‑native ecosystem.
The article provides a comprehensive technical analysis of NVMe over Fabric, highlighting the advantages of Fibre Channel over Ethernet, discussing RDMA, zero‑copy mechanisms, and the impact of SCSI translation layers on performance and adoption in modern data‑center storage architectures.
This guide explains why hard drives fail, distinguishes physical and logical damage, and reviews thirteen powerful data recovery utilities—complete with features, supported file systems, and usage tips—to help you restore lost files efficiently.
This article explains the ALUA (Asymmetric Logical Unit Access) multipathing model, compares it with A/A‑Symmetric and Active/Passive mechanisms, describes its application in dual‑active storage architectures, and outlines OS support and key features for improving I/O performance and reliability.
The article explains how IBM PowerHA SystemMirror 7.1 and Spectrum Virtualize/SVC HyperSwap enable active‑active, cross‑site storage architectures using Metro Mirror, detailing their history, topology, failover mechanisms, performance characteristics, volume‑group features, and operational advantages for high‑availability environments.
The article explains NetApp MetroCluster’s clustered storage architecture, including dual‑site HA pairs, 4‑node active‑active designs, synchronization mechanisms such as SyncMirror, ClusterRemote and CRS, and the network and NVRAM strategies that enable seamless data protection and disaster recovery across distances up to 200 km.
The event showcases three technical talks covering the evolution of Hujiang's storage architecture, the transformation of the Dianrong payment system into a public service, and an introduction to the TiSpark project that integrates TiDB with Spark, highlighting design choices, trade‑offs, and future directions.
The article explains Dell EMC SVC's gateway‑style storage architecture, its 2‑8 node clusters, I/O groups, vDisk Mirror functionality, local and stretched cluster configurations, arbitration mechanisms, and performance improvements in Enhanced Stretched Cluster, providing a comprehensive guide to high‑availability storage design.
This article explains how server clusters manage shared storage using SCSI‑2 and SCSI‑3 reservation mechanisms, detailing their workflows, advantages, and limitations, and includes examples from Windows Server 2003 and 2008 clustering to ensure data integrity and high availability.
This article analyzes Kaminario’s K2 and K2.N storage solutions, illustrating how SSD/NVMe core technology, hybrid‑cloud capabilities, and integrated AI/ML operations combine to deliver high‑performance, scalable, and intelligent enterprise storage.
This article explains how SSD controllers use wear‑leveling algorithms to distribute writes across NAND flash blocks, covering sequential and non‑sequential write scenarios, key assumptions, implementation strategies, and the importance of managing limited erase‑cycle endurance for reliable storage.
This article details JD's AI platform built on Docker and Kubernetes, covering its high‑availability architecture, network plugin choices, storage solutions like GlusterFS and SeaweedFS, GPU management, CI/CD pipelines, logging, monitoring, and native Spark on Kubernetes, illustrating how a cloud‑native stack supports large‑scale AI services.
The article explains why MySQL insert operations can become extremely slow despite small data volumes, analyzing storage architecture, cache behavior, BBU protection, and common hardware or configuration issues, and provides concrete commands and steps to diagnose and resolve the performance problem.
This article explains what raw (裸) devices are, how to identify and use them with Oracle on Unix, their performance advantages, when they should be employed, and practical tips for configuration, backup, and related storage considerations.
This article reviews the fundamental concepts of HDFS, explains its master‑slave architecture with NameNode and DataNode, describes block replication, and discusses various implementations—including native HDFS, NetApp/Lustre, GPFS/Ceph, and Isilon—as well as HDFS‑to‑NFS gateway integration.
This article explains why disk health monitoring is crucial for service stability, introduces SMART technology and the smartctl tool, details command usage, key SMART attributes, value interpretation, and outlines automated data collection and alerting strategies for reliable operations.
This article provides a comprehensive overview of BeeGFS, covering its architecture, BeeOND on‑demand instances, quota and directory‑quota mechanisms, Buddy mirroring, supported APIs, hardware requirements, network options, and export methods via SMB/CIFS and NFS for high‑performance computing environments.
BeeGFS is a GPL‑licensed parallel file system for Linux that offers scalable storage through a modular architecture of management, metadata, and object storage servers, supports a wide range of hardware and OS platforms, and provides detailed installation, configuration, and performance‑tuning guidance including the BeeOND burst‑buffer extension.
RocketMQ is a distributed queue-based middleware offering strict message ordering, diverse pull modes, scalable subscribers, real-time subscription, and massive message accumulation, with detailed network deployment, storage mechanisms, key features, flushing strategies, query methods, server-side filtering, JVM memory utilization, and solutions for message backlog.
The article analyzes how expanding demand and cross‑industry convergence are driving High‑Performance Computing (HPC) to become the next technology hotspot, covering its market segmentation, cloud integration, storage challenges, key vendors, and future trends such as HPDA, Burst Buffer, and open‑source file systems.
This article walks beginners through multiple practical approaches for setting up a home NAS server, covering hardware choices, single‑system and dual‑system configurations, virtualization options, recommended software, remote management tools, and even a media‑center upgrade plan.
The article explains hard‑disk physical structure, how seek time, rotational latency and transfer rate determine IOPS and throughput, and describes Linux I/O stack optimizations—such as caching, scheduling, and append‑only or LSM‑tree designs—to mitigate random‑access bottlenecks and improve overall storage performance.
This article details Alibaba's middleware team's exploration of time‑series data characteristics, real‑world monitoring scenarios, the limitations of traditional databases, and the evolution of their custom HiTSDB solution that combines inverted indexing, high‑compression algorithms, and distributed aggregation to meet massive write and query demands.
The OSCON 2017 conference in Austin featured Huawei’s extensive open‑source showcase, including talks on ecosystem growth, serverless micro‑service orchestration, unified storage with OpenSDS, network simplification via iCAN, and Go‑based DevOps orchestration, plus demos of OpenStack and developer ecosystem solutions.
This article explains how to evaluate SSD performance by processing raw fio benchmark logs, interpreting bandwidth, IOPS, and latency metrics, converting logs to CSV, visualizing results with charts, and drawing practical conclusions for storage selection and reliability.
This article reviews core database high‑availability technologies—including IBM DB2 HADR, HACMP clustering, SQL and Q replication, storage‑level disaster recovery, and DPF considerations—explaining their mechanisms, suitable scenarios, and practical deployment tips for enterprise environments.
This article explains the key SSD benchmark indicators—4K random I/O, sustained throughput, performance consistency, durability, and write amplification—while describing why they matter for evaluating storage solutions and guiding proper SSD selection for production workloads.
This article details Alibaba Cloud's high‑performance local storage solution for the massive Alipay Red Packet service, covering business requirements, existing block storage limitations, architectural redesign, key components like Virtio‑blk, SPDK, and NVMe SSD, and performance benchmarks demonstrating dramatically lower latency and higher IOPS.
The article explains how NetApp's SnapDiff engine and SnapVault solution enable efficient, agent‑less incremental backups by comparing snapshot differences directly on storage, reducing backup windows and improving performance for Windows, Linux, UNIX, and heterogeneous environments.
The article details Hujiang's practical experience deploying microservices with Docker, evaluating orchestration tools, network and storage solutions, monitoring approaches, and automatic scaling, and demonstrates how Docker improves deployment density, QPS, and resource efficiency compared to traditional architectures.
This article revisits earlier mistakes in a Nimble Storage analysis, provides corrected specifications for the CS series, outlines HPE's evolving cloud computing strategy, and shares two free resources for readers interested in cloud architecture and Amazon cloud services.
This article presents a detailed walkthrough of a typical web system architecture, covering layered components, load‑balancing strategies, business service and communication layers, storage options from file to object stores, and key criteria for evaluating architecture such as cost, scalability, security, and disaster recovery.
This article reviews major big‑data storage and query architectures—including HBase, Dremel/Parquet, pre‑aggregation systems, Lucene, and the custom Tindex solution—evaluating their strengths, weaknesses, and suitability for real‑time, high‑volume analytical workloads.
The article reviews the evolution of Direct Attached Storage (DAS) from its early role as basic direct‑connected storage to its renewed relevance in big‑data, cloud, and HPC environments, detailing market growth, vendor offerings, architectural designs, and practical deployment scenarios.
This article provides an extensive overview of Docker, covering its open‑source origins, client‑server architecture, container isolation, image management, orchestration tools such as Compose, Swarm and Machine, networking solutions, storage strategies, integration with PaaS/IaaS platforms, Kubernetes, OpenStack, DevOps practices, micro‑service architecture, and the broader Docker ecosystem.
The article explains the technical fundamentals of 4K sector hard drives, their performance and compatibility advantages, industry adoption trends, and practical factors that affect HDD longevity, offering a comprehensive guide for anyone interested in modern storage technology.
Facing massive user growth, Tencent’s social network team redesigned its KV storage architecture—introducing CKV and Grocery, automating capacity planning, data migration, and backup reuse—to dramatically lower costs, improve operational efficiency, and maintain high service quality across millions of devices.
The article examines agentless backup technology, comparing its implementation in virtualized and physical environments, detailing supported interfaces, evaluating a real‑world Asigra Cloud Backup case, and discussing security risks, performance impacts, and when traditional agents remain necessary.
This article examines the inherent risks of distributed storage, emphasizes that data safety outweighs raw performance, and explains storage types, file system structures, media characteristics, and practical solutions such as SSD caching and SRVSAN architecture to mitigate those risks.
This article explains how VARCHAR's variable‑length storage and CHAR's fixed‑length storage differ in space usage, memory consumption during queries, and I/O performance, helping developers select the appropriate type for optimal MySQL efficiency.
This article experimentally compares PostgreSQL 9.5's BRIN and BTREE indexes across seven data distributions, revealing that BRIN uses up to 6,848 times less storage while BTREE consistently outperforms BRIN in query speed, with the gap narrowing as data repetition increases.
A misconfigured mount_maxsize limited each Data Server to 20 GB, causing 96% storage usage, and after correction led to block corruption that required a custom script to clean up, illustrating the importance of proper storage settings and automated remediation in TFS operations.
From 2012 to 2016, EMC’s World conferences introduced a series of groundbreaking storage and data‑management technologies—including XtremIO flash arrays, ViPR software‑defined storage, Isilon OneFS, VxRack hyper‑convergence, and the formation of Dell Technologies—shaping industry trends and highlighting the shift toward cloud‑centric data solutions.
The article explains how traditional SAN storage creates CPU‑I/O bottlenecks, how Google’s distributed file system inspired hyper‑converged designs that fuse compute and storage, and why tiered storage with SSD and HDD offers scalable, high‑performance infrastructure for modern data‑center workloads.
This article provides a comprehensive overview of Citrix XenServer, detailing its Xen‑based hypervisor architecture, management tools, storage and networking components, including resource pools, virtual NICs, Open vSwitch, VLAN support, and distributed switching, highlighting its role in modern cloud virtualization.
On February 10, 2016 a provincial accounting database experienced severe daily‑batch delays despite other applications running normally; a senior DBA collected alert logs, AWR snapshots, ASH dumps, and OSW metrics, uncovered log‑file‑sync and redo‑IO degradation, increased rollbacks, and a faulty SAN link, pinpointing the root cause.
This article provides a comprehensive overview of VMware vSphere, covering its core components (ESX/ESXi, vCenter, client/web), management features, disaster‑recovery and backup solutions (SRM, VADP, VCB), and storage provisioning methods including VAAI, VASA, vSAN, VMFS, RDM and vVol.
This article examines the kernel‑mode iSCSI Enterprise Target (IET), detailing its component modules (ietadm, ietd, iscsi_trgt), the interaction flow between initiators and the target, and the internal I/O processing pipeline, including thread allocation, work queues, and backend storage handling.
This article provides a comprehensive overview of Hyper-V, covering its extensive operating system support, virtual networking, management integration with System Center, dynamic memory, storage options, VM conversion tools, and key SMB 3.0 features for high‑availability and performance in virtualized environments.
This article explains the architecture and code flow of InnoDB's IO subsystem, covering read/write threads, asynchronous AIO handling, concurrency control, file prefetch strategies, and log write padding, with detailed examples of the underlying C++ structures and functions.
This article explains RAID technology, detailing each RAID level's design, performance trade‑offs, and reliability characteristics so readers can choose the most suitable configuration for their storage needs.
This article traces the evolution of image server architectures—from a simple single‑directory setup on Windows/.NET, through cluster‑based real‑time synchronization and shared‑storage solutions, to modern FastDFS‑backed distributed file systems with CDN acceleration—highlighting scalability, reliability, and migration challenges.
This guide explains Oracle's Orion tool, its advantages and limitations, step‑by‑step usage instructions, sample test scenarios for random read/write and sequential read, result file details, and a troubleshooting tip for asynchronous I/O errors on Linux.
This article explores Taobao's massive data product architecture, detailing its five-layer design, the use of Hadoop and real‑time systems, hybrid relational and NoSQL storage, a middleware layer for data integration, and systematic caching strategies that enable petabyte‑scale analytics and fast query responses.
This article explains the Linux Device Mapper architecture, introduces thin provisioning and snapshot techniques, and provides step‑by‑step command‑line demonstrations of creating thin pools, volumes, and Docker storage snapshots using loopback devices.
This article explains SSD fundamentals, including flash memory principles, device composition, controller functions, common pitfalls, performance degradation causes, and best practices for monitoring and maintaining SSDs in enterprise environments, ensuring reliability and data integrity.
The article outlines ten major IT trends for 2016—including the shift to application‑centric spending, DevOps acceleration, data lakes, analytics platform control, converged services, in‑memory databases, flash storage, and the evolving role of IT in the third platform—highlighting how enterprises must adapt to stay competitive.
This article presents a detailed case study of an Oracle RAC system performance bottleneck, walks through comprehensive monitoring, storage and partitioning analysis, and outlines a step‑by‑step optimization plan—including KEEP pool tuning and partition redesign—that dramatically improved I/O latency and overall throughput.
Senior DBA and architect Bai Shan answers community questions on advancing from DBA to architect, future career routes, testing environment setup, interpreting AWR storage metrics, using sar and iostat for disk I/O monitoring, cache sizing, and the growing importance of automation in cloud-era database operations.
This article examines the key challenges of building large‑scale, high‑interaction web 2.0 platforms—including massive data processing, concurrency control, file storage, indexing, distributed architecture, AJAX usage, security, synchronization, clustering, and OpenAPI integration—offering practical considerations for robust backend design.
This article provides a comprehensive overview of Microsoft Hyper-V, detailing its OS support, virtual networking, management APIs, integration with System Center, dynamic memory, snapshots, cloning, storage options, SMB 3.0 features, and clustering capabilities for efficient virtualization operations.
This article provides a comprehensive overview of RAID technology, explaining its purpose, the various standard levels from RAID 0 to RAID 6, hybrid configurations, non‑standard implementations like DRFS, and both software and firmware/driver based deployment methods.
This article explains SSD fundamentals such as page and block structures, the causes and mitigation of write amplification through reserved space and TRIM, presents detailed KVM virtualization test setups and results, and compares SSD types, offering practical guidance for maximizing SSD performance in virtualized environments.
This article provides a comprehensive overview of VMware's storage path reliability, pluggable storage architecture, virtual machine conversion tools, high‑availability and resource‑management features such as HA, DRS, FT, vMotion, storage vMotion, DPM, as well as networking components like vDS and VMkernel ports, plus upgrade automation utilities.
The article explains VMware vSphere as a cloud‑based data‑center virtualization suite, detailing its main components such as ESXi, vCenter, vSphere Client, and Web Access, and covering disaster recovery, backup technologies, storage APIs, and various storage provisioning methods like vSAN, VMFS, RDM, NFS/CIFS and vVol.
This article examines the evolution and challenges of time‑series storage, compares file‑based, LSM‑tree, and B‑tree approaches, and proposes a vector‑based method to efficiently handle writes, reads, query semantics, dimensions, and aggregation for modern big‑data applications.
The article explains that hard‑disk I/O is the primary performance bottleneck in laptops, demonstrates how SSDs dramatically improve boot, shutdown, and application launch times, compares MLC and SLC SSD technologies, and recommends replacing traditional HDDs with SSDs for better overall speed.
This article explains how variable‑length data structures are stored in databases, illustrates PostgreSQL's page and row formats, and compares the storage overhead of DEFAULT NULL versus DEFAULT '' fields, showing that NULL can reduce space dramatically when many columns are nullable.
CHAR stores fixed‑length strings padded with spaces, while VARCHAR stores variable‑length strings with a length byte, leading to different maximum sizes—255 characters for CHAR and up to 65,535 bytes for VARCHAR (about 21,589 UTF‑8 characters)—and distinct use cases such as short fixed fields versus space‑saving flexible fields.
This guide walks through creating Linux LVM physical volumes, volume groups, and logical volumes on four 1 GB disks, demonstrates formatting, mounting, extending, shrinking, and snapshotting volumes, and provides the necessary commands for managing and removing LVM components.
This article examines the architectural differences, performance, consistency, and security trade‑offs between Ceph and Swift object storage in OpenStack, offering guidance on selecting the appropriate solution based on deployment scale, multi‑region needs, and security requirements.
This article explains what RAID is, compares common RAID levels with their advantages and disadvantages, and provides step‑by‑step Linux commands for creating, managing, and safely shutting down software RAID arrays using mdadm.
This article explains the concept, architecture, and trade‑offs of various RAID levels—including RAID 0, 1, 2, 3, 4, 5, 6, and hybrid configurations—detailing how they combine multiple inexpensive disks to achieve different balances of speed, capacity, and fault tolerance for server environments.
This guide outlines essential Azure cloud considerations—including cost monitoring, VM storage types, load‑balancing strategies, SSD advantages, IP address differences, reserved IP billing, SLA guarantees, storage cost factors, diagnostics, and overall best practices—to help avoid common pitfalls when moving projects from local environments to the cloud.
This article provides a concise overview of several widely-used distributed file systems—including Lustre, Hadoop, MogileFS, FreeNAS, FastDFS, NFS, OpenAFS, MooseFS, pNFS, and GoogleFS—highlighting their origins, key features, supported platforms, and typical use cases.
This article explains how leveraging CDN technology—through caching proxies, routing acceleration, security protection, and cost‑saving strategies—can overcome regional network limitations, mitigate DDoS attacks, and optimize storage and load‑balancing, while also comparing open‑source reverse‑proxy solutions and offering practical hardware and software tuning tips.
