ByteDance Data Platform
Sep 24, 2026 · Artificial Intelligence
PB-Scale Embodied Data: Efficient Storage & Training with Volcano Engine Multimodal Data Lake
Digua Robot leverages Volcano Engine's multimodal data lake — combining TOS object storage, Lance columnar format, and Ray distributed processing — to unify heterogeneous robot episode data, enable PB-scale ingestion, spatial quality checks via LAS operators, and achieve near-PFS training throughput with RobotLanceDataset.
Lance formatPB-scale dataRay distributed processing
0 likes · 22 min read
