Understanding the Storage Performance Development Kit (SPDK): Architecture, Components, and Key Technologies

Solid‑state storage devices are rapidly replacing traditional disks in data centers due to superior performance, power efficiency, and rack density, which shifts the bottleneck to the storage software stack.

SPDK (Storage Performance Development Kit) was created as an end‑to‑end reference architecture that can achieve millions of I/O operations per second by running entirely in user space on multiple CPU cores and NVMe SSDs, without additional hardware.

SPDK operates on two key techniques: user‑mode drivers that avoid kernel context switches, and Polled Mode Drivers (PMDs) that replace interrupt‑driven I/O with periodic polling, reducing latency and CPU overhead.

The framework consists of numerous sub‑components, including NVMe drivers, Intel QuickData Technology, NVMe‑over‑Fabrics initiators, block device abstraction (bdev), Blobstore, logical volumes, Ceph RBD, and Linux AIO, all sharing common user‑mode and polling infrastructure.

SPDK also provides storage protocols such as iSCSI target, NVMe‑oF target, and vhost target, enabling high‑performance block access over Ethernet, RDMA, FC, or TCP, and efficient virtual machine I/O.

A FAQ section addresses common concerns, such as platform support (primarily Linux with some FreeBSD drivers), Intel‑centric optimizations, the user‑space high‑performance path, and integration with DPDK for network packet processing.

The article concludes with references to additional resources, including detailed DPDK and SPDK documentation, and promotional material for a comprehensive e‑book collection on architecture technologies.