Qunar Tech Salon
May 16, 2019 · Big Data
Optimizing HDFS Federation Data Migration with FastCopy and qFastCopy at Qunar
This article describes the challenges of scaling Qunar's Hadoop NameNode, introduces HDFS Federation and the FastCopy tool, presents performance tests comparing FastCopy with DistCp, and details the development and evaluation of an optimized qFastCopy solution that reduces multi‑petabyte migration time from hours to a few.
FastCopyFederationHDFS
0 likes · 8 min read