storage-acceleration

DataFunSummit

Nov 16, 2024 · Big Data

Data Lake Storage Acceleration: Evolution, Challenges, and Solutions for AI and Big Data Workloads

This article surveys the evolution of data‑lake storage acceleration, compares different architectural stages, analyzes why acceleration is needed for AI and big‑data scenarios, and details the key techniques—metadata acceleration, read/write speedup, and end‑to‑end workflow optimization—used to overcome performance and cost challenges.

AIBig DataCloud Native

0 likes · 23 min read

Data Lake Storage Acceleration: Evolution, Challenges, and Solutions for AI and Big Data Workloads

DataFunTalk

Nov 5, 2023 · Cloud Native

Cloud‑Native Storage Acceleration: Experience and Practices with CloudFS on Volcano Engine

This article presents the cloud‑native storage acceleration demands, evaluates what constitutes a good acceleration solution, and details the design, implementation, and real‑world practice of CloudFS—including metadata acceleration, data‑plane caching, FUSE enhancements, AI training and multi‑cloud data‑lake use cases—while outlining future roadmap plans.

AIBig DataCloud Native

0 likes · 15 min read

Cloud‑Native Storage Acceleration: Experience and Practices with CloudFS on Volcano Engine