Why NVMM Is Redefining Memory: A Deep Dive into Emerging Non‑Volatile Storage

NVMM Technologies and Characteristics

Non‑Volatile Memory (NVM) refers to storage media that retain data without power. Modern non‑volatile main memory (NVMM) includes:

Phase‑Change Memory (PCM) : stores data by switching a chalcogenide material between amorphous and crystalline phases.

Memristor‑based ReRAM : uses a titanium‑oxide nanodevice whose resistance changes with applied voltage.

Spin‑Transfer Torque MRAM (STT‑MRAM) : exploits magnetic tunnel junctions and spin‑transfer torque to represent bits.

All three provide low latency (tens to hundreds of nanoseconds), high density, and byte‑addressability, making them orders of magnitude faster than NAND flash.

Form Factors and Interfaces

NAND flash is typically exposed via SATA or PCIe SSDs. NVMM devices are packaged as DIMM modules that plug into standard memory slots, commonly called Persistent Memory (PM) or Storage Class Memory (SCM). The terms are interchangeable; PM emphasizes persistence, while SCM highlights the position between DRAM and flash in the storage hierarchy.

Intel Optane and 3D XPoint

Intel’s commercial NVMM product, Optane (also known as Apache Pass or AEP), is built on 3D XPoint technology. The exact material (PCM or ReRAM) is undisclosed, but performance numbers are public:

Read latency ≈ 350 ns (DRAM ≈ 100 ns).

Read/write latency ≈ 10 µs for 4 KB accesses.

Random‑write throughput ≈ 500 k IOPS at 4 KB.

PCIe Optane SSDs deliver ~2000 MB/s sequential throughput while maintaining the low‑latency random performance.

Position in the Storage Hierarchy

NVMM narrows the gap between main memory and storage. It offers persistence, low latency, and byte‑addressability, allowing designs where NVMM can act as primary memory, secondary storage, or a hybrid tier.

System‑Software Models

Two dominant usage models are emerging:

NVMM as primary memory : Replaces or coexists with DRAM. Benefits include simplified programming (variables become persistent). Challenges involve safe APIs, crash‑consistent allocation, and wear‑leveling.

NVMM as secondary storage : Works alongside DRAM. Requires explicit allocation policies, wear‑aware placement, and caching strategies.

Linux integrates DAX (Direct Access) to bypass the page cache for direct reads/writes to persistent memory. However, DAX does not eliminate metadata cache overhead, prompting the development of purpose‑built file systems:

PMFS : a memory‑style file system that removes the block device layer.

NOVA : a log‑structured file system optimized for hybrid volatile/non‑volatile memories.

SoupFS : uses soft‑updates to provide fast metadata operations on NVMM.

Hybrid Storage Designs

Because Optane is still expensive, most deployments combine NVMM with traditional flash or HDDs. Notable research projects:

Strata : a cross‑media file system with a user‑space library (libFS) that writes directly to SCM and a kernel component (kernelFS) that migrates data to appropriate media based on access patterns.

Ziggurat : a tiered file system that predicts write behavior and places data on NVMM or slower storage, dynamically migrating hot/cold data.

Future Outlook

As NVMM matures, system software will increasingly “bypass the page cache” and even parts of the kernel to exploit its DRAM‑like performance. Ongoing research focuses on programming models, reliability mechanisms, and efficient hybrid architectures, making NVMM a fertile area for system developers.

References

Intel Optane Technology 3D XPoint: https://www.intel.com/content/www/us/en/architecture-and-technology/optane-technology-animation.html

PMDK (Persistent Memory Development Kit): https://pmem.io/

Dulloor et al., “System Software for Persistent Memory,” EuroSys 2014.

Xu et al., “NOVA: A Log‑structured File System for Hybrid Volatile/Non‑volatile Main Memories,” FAST 2016.

Dong et al., “Soft Updates Made Simple and Fast on Non‑volatile Memory,” ATC 2017.

Kwon et al., “Strata: A Cross Media File System,” SOSP 2017.

Zheng et al., “Ziggurat: A Tiered File System for Non‑Volatile Main Memories and Disks,” FAST 2019.

Illustrations