Tagged articles

SnapshotScanMR

2 articles · Page 1 of 1

Jul 16, 2019 · Big Data

Optimizing HBase‑to‑Hive Data Transfer with SnapshotScanMR to Reduce RegionServer Load

The article describes how a large‑scale ETL process that previously used HBaseStorageHandler caused severe region server pressure, and how a new HBase‑to‑Hive task based on SnapshotScanMR was designed to bypass region servers, halve execution time, and double scanning performance.

ETLHBaseHive

0 likes · 6 min read

Optimizing HBase‑to‑Hive Data Transfer with SnapshotScanMR to Reduce RegionServer Load

Zhongtong Tech

Jul 5, 2019 · Big Data

How SnapshotScanMR Doubles HBase‑to‑Hive ETL Speed and Relieves Cluster Load

This article explains how leveraging HBase's SnapshotScanMR feature to create a custom hbase2hiveBySnapshot task dramatically reduces region server pressure, halves ETL execution time, and improves cluster stability for large‑scale data back‑fill operations.

ETLHBaseHive

0 likes · 6 min read

How SnapshotScanMR Doubles HBase‑to‑Hive ETL Speed and Relieves Cluster Load