Tagged articles

data quality governance

1 articles · Page 1 of 1
ByteDance Data Platform
ByteDance Data Platform
Sep 24, 2026 · Artificial Intelligence

PB-Scale Embodied Data: Efficient Storage & Training with Volcano Engine Multimodal Data Lake

Digua Robot leverages Volcano Engine's multimodal data lake — combining TOS object storage, Lance columnar format, and Ray distributed processing — to unify heterogeneous robot episode data, enable PB-scale ingestion, spatial quality checks via LAS operators, and achieve near-PFS training throughput with RobotLanceDataset.

Lance formatPB-scale dataRay distributed processing
0 likes · 22 min read
PB-Scale Embodied Data: Efficient Storage & Training with Volcano Engine Multimodal Data Lake