How NVMe over Fabrics Will Transform the Storage Landscape

NVMe over Fabrics is poised to reshape storage environments by addressing performance limitations of legacy protocols such as SCSI, SAS, and SATA.

Medium Technology Hits a Bottleneck

Storage networking has evolved from early ESCON‑based Fibre Channel and parallel SCSI to serial interfaces like SAS and SATA, but these technologies struggle with high latency and limited I/O concurrency, especially when paired with HDDs.

Even SSDs using SATA or SAS face queue‑depth constraints; SATA offers a single 32‑command queue, while SAS can provide up to 256 commands, still insufficient for modern multi‑core processors.

Exploring NVMe Technology

NVMe replaces SCSI by using the PCIe bus, delivering roughly 4 Gbps per lane and dramatically reducing latency.

The protocol supports up to 65,535 I/O queues, each with 65,535 entries, enabling massive parallelism that matches the core count of contemporary CPUs.

The NVM Express Working Group, formed by about 90 companies, released NVMe 1.3 in July, adding security, resource sharing, and SSD durability features.

What Is NVMe over Fabrics

NVMe can be extended beyond direct‑attached devices using iSCSI or Fibre Channel, leading to the NVMe‑over‑Fabrics (NVMe‑of) standard, first defined in 2014.

Two transport types are under development: RDMA‑based NVMe‑of and Fibre Channel‑based FC‑NVMe.

RDMA moves data directly between application memories without CPU involvement, offering ultra‑low latency via Infiniband, iWARP, or RoCE (pronounced “Rocky”). Vendors such as Mellanox provide 100 Gbps adapters that offload NVMe‑of processing.

NVMe enables massive parallel access to SSDs and emerging media like 3D XPoint, fundamentally changing performance expectations.

How to Deploy NVMe

Data‑center deployments typically install NVMe devices in servers; most modern servers, hypervisors (e.g., VMware vSphere), and operating systems already support NVMe.

NVMe is also being adopted as the back‑end protocol for storage arrays, replacing SAS and Fibre Channel in many high‑performance systems.

Vendors such as HPE, NetApp, and Pure Storage have announced NVMe‑enabled platforms that deliver half the latency and double the write bandwidth of previous generations.

Choices Facing NVMe

Full adoption of NVMe over Fabrics allows SAN architectures to transition to NVMe‑based fabrics while preserving features like snapshots, replication, compression, and deduplication.

Customers can avoid costly Fibre Channel upgrades by leveraging existing 32 Gbps infrastructure, though older servers without 32 Gbps HBAs may need hardware updates.

NVMe‑enabled arrays can coexist with SCSI, easing migration for teams familiar with Fibre Channel.

Start‑ups such as E8 Storage and Excelero are building NVMe‑centric solutions using 100 GbE and RoCE, claiming millions of IOPS and sub‑100 µs latencies.

Other innovators like Apeiron Data Systems are exploring 40 GbE NVMe architectures for hyper‑converged designs.

The Future of NVMe

NVMe is set to replace SCSI and SAS as the default SSD interface, with high‑end deployments moving to NVMe‑over‑Fabrics while retaining enterprise data‑services.

As ecosystem support matures, NVMe will likely become the dominant storage protocol, superseding traditional flash architectures.