Skip to content
Tagged articles

Volcano Engine EMR

1 articles · Page 1 of 1
ByteDance Data Platform
ByteDance Data Platform
Nov 11, 2026 · Big Data

From Files to Lakehouse: Scaling AI Training Data to 100B+ Tokens with Lance

IQuest Research replaced file-based data management with a Lance-based lakehouse on Volcano Engine EMR, introducing a four-layer architecture with stable record IDs, columnar accumulation, versioned delivery, and bidirectional traceability to handle 50B+ records and enable reproducible training at hundred-billion token scale.

AI data pipelineLanceRay
0 likes · 7 min read
From Files to Lakehouse: Scaling AI Training Data to 100B+ Tokens with Lance