Skip to content
Tagged articles

AI Training

104 articles · Page 2 of 2
UCloud Tech
UCloud Tech
Mar 24, 2020 · Artificial Intelligence

Why Does PyTorch Struggle with UFS Storage? Insights and Optimizations

A detailed case study reveals why PyTorch training on UFS file storage suffers severe I/O bottlenecks, compares it with local SSD and SSHFS, and presents practical optimizations such as using cv2.imdecode, caching DataLoader handles, and converting small‑file datasets into large UFS files to close the performance gap.

AI TrainingPyTorchUFS
0 likes · 14 min read
Why Does PyTorch Struggle with UFS Storage? Insights and Optimizations
Architects' Tech Alliance
Architects' Tech Alliance
Dec 24, 2019 · Fundamentals

Design Considerations and Benefits of Storage Class Memory (SCM) for Data‑Intensive Applications

The article examines the emerging Storage Class Memory (SCM) market, outlines its various technologies, discusses performance and cost trade‑offs, and highlights how SCM can accelerate AI training, enable fast data recovery, reduce data‑center power consumption, and presents the challenges of latency and system integration.

AI TrainingSCMStorage Class Memory
0 likes · 15 min read
Design Considerations and Benefits of Storage Class Memory (SCM) for Data‑Intensive Applications
iQIYI Technical Product Team
iQIYI Technical Product Team
Jan 4, 2019 · Artificial Intelligence

Building a Deep Learning Training Platform on Cloud: Challenges, Runonce Service, and Storage Optimization

iQIYI built a cloud‑based deep‑learning training platform called Jarvis, replacing the initial Runonce service, by containerizing GPU tasks, adopting Ceph S3 storage with FUSE, optimizing data pipelines, and addressing compute, storage, and networking challenges to improve scalability and reduce GPU idle time.

AI TrainingGPU computingcloud platform
0 likes · 9 min read
Building a Deep Learning Training Platform on Cloud: Challenges, Runonce Service, and Storage Optimization