Tagged articles

data lifecycle management

3 articles · Page 1 of 1
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Jul 20, 2026 · Cloud Native

Redesigning Parallel File Storage for AI Production: Introducing Baidu PFS L3

As AI moves from isolated model training to full‑scale production with mixed workloads, Baidu's new PFS L3 offers elastic, cloud‑native parallel file storage that delivers tens of GB/s throughput, millions of IOPS, sub‑millisecond latency, and automated data lifecycle management to meet the evolving demands of modern AI platforms.

AI infrastructureBaidu CloudPFS L3
0 likes · 12 min read
Redesigning Parallel File Storage for AI Production: Introducing Baidu PFS L3
JD Tech
JD Tech
Mar 20, 2021 · Big Data

Implementing Erasure Coding in HDFS: Migration Strategy, Testing Framework, and Data Lifecycle Management

This article details JD's practical experience migrating HDFS to erasure coding, covering the decision between upgrade and porting, the step‑by‑step upgrade and rollback procedures, automated testing, a custom data‑lifecycle management system for hot‑warm‑cold data, and comprehensive data‑integrity safeguards to achieve significant storage cost reductions while maintaining production reliability.

HDFScluster upgradedata lifecycle management
0 likes · 17 min read
Implementing Erasure Coding in HDFS: Migration Strategy, Testing Framework, and Data Lifecycle Management
Architects' Tech Alliance
Architects' Tech Alliance
Apr 9, 2016 · Fundamentals

IBM Spectrum Storage: Overview of SDS Strategy, Spectrum Scale and LTFS Integration for Data Lifecycle Management

The article explains IBM Spectrum Storage's software‑defined storage strategy, introduces the Spectrum Scale product line and its LTFS EE plugin for automated data tiering between disk and tape, and describes how IBM SmartCloud Storage Access enables self‑service provisioning and unified management of NAS and block resources.

IBM Spectrum StorageLTFSSpectrum Scale
0 likes · 7 min read
IBM Spectrum Storage: Overview of SDS Strategy, Spectrum Scale and LTFS Integration for Data Lifecycle Management