Didi Tech
Mar 28, 2019 · Big Data
Scaling Hive Metadata Storage with Federation Architecture
Didi solved Hive’s MySQL metadata bottleneck by building a federation architecture—using waggle_dance to route requests to multiple MySQL instances based on database names—enabling horizontal scaling, read/write support, and seamless compatibility with existing Hive clients while improving stability and performance.
Data WarehouseHive FederationMetadata Scalability
0 likes · 7 min read