A Comprehensive Overview of Storage Development History, Types, and Models
This article provides a detailed overview of the evolution of storage systems—from single‑node to cloud‑native—covering fundamental concepts, data classifications, storage types such as block, file, and object, and examples like Rook and MinIO, aimed at beginners seeking a macro understanding of storage architecture.
Background
This article consolidates information from Yang Chuanhui's book, Da Hua Storage, network resources, and personal understanding to outline the basic trajectory and essential knowledge of storage development for beginners.
Storage Development History
From standalone disks to internet‑scale solutions, storage has evolved to achieve low cost, high performance, scalability, and ease of use, resulting in categories such as single‑node storage, centralized storage, distributed storage, cloud storage, and cloud‑native storage.
Data Classification & Models
All storage types are built on specific data classifications and corresponding data models. The three common storage categories are block storage, file storage, and object storage.
Block Storage
Block storage uses two main approaches: Direct‑Attached Storage (DAS) and Storage Area Network (SAN).
DAS (Direct Attach Storage) – directly attached to the host.
SAN (Storage Area Network) – high‑speed network‑based storage.
File Storage
Provides file services over a network.
Object Storage
Based on key‑value stores, separating data and metadata, and exposing a RESTful API, often built on Object‑based Storage Devices (OSD).
Single‑Node Storage
Encapsulates a storage engine that offers file, key‑value, table, or relational models on persistent media such as HDDs or SSDs.
Centralized Storage
Includes controllers, disk arrays (JBOD), switches, and management devices, forming a larger storage system.
Distributed Storage
Connects independent storage devices via network to present a unified service. System classifications include distributed file systems, key‑value stores, table stores, and distributed databases. Design follows the CAP theorem.
Cloud Storage
Built on distributed storage foundations and delivered over the Internet, offering flexibility and typically provided by cloud vendors.
Cloud‑Native Storage
Extends cloud storage with dynamic provisioning, S3‑compatible APIs, and Kubernetes friendliness. Notable projects include:
Rook
The CNCF’s first cloud‑native storage project integrates file, block, and object storage into Kubernetes clusters, enabling seamless operation with other applications and services.
MinIO
MinIO is a high‑performance, software‑defined object storage suite that integrates with Kubernetes, allowing operators to manage storage via the Kubernetes interface.
Additional references and recommended readings are listed at the end of the original article.
Architects' Tech Alliance
Sharing project experiences, insights into cutting-edge architectures, focusing on cloud computing, microservices, big data, hyper-convergence, storage, data protection, artificial intelligence, industry practices and solutions.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.