Cluster Migration

Architect

Sep 30, 2024 · Operations

Automated Resource Balancing and Migration for Redis Clusters

The article describes how an automated resource‑balancing system continuously monitors Redis host memory usage, selects optimal nodes, safely migrates them through a multi‑step process (adding slaves, verifying replication, promoting masters, deleting old nodes), and provides task management and notification features to maintain high availability and reduce manual DBA effort.

Cluster MigrationRedisReliability

0 likes · 13 min read

Automated Resource Balancing and Migration for Redis Clusters

360 Zhihui Cloud Developer

Aug 8, 2024 · Big Data

How to Migrate HBase and HDFS Clusters Safely Without Downtime

This guide details a step‑by‑step migration plan for HBase and HDFS clusters, covering background, high‑availability architecture, role assignments, expansion and shrinkage of ZooKeeper and JournalNode, NameNode and DataNode migration, rolling restarts, and common upgrade pitfalls.

Cluster MigrationHBaseHDFS

0 likes · 12 min read

How to Migrate HBase and HDFS Clusters Safely Without Downtime

Qunar Tech Salon

Jun 5, 2023 · Operations

Practical Experience of Large‑Scale Elasticsearch Cluster Node Migration at Qunar

This article details the background, challenges, migration plan, automation, and performance‑tuning techniques used to relocate a petabyte‑scale Elasticsearch logging cluster from one data center to another, highlighting practical lessons and measurable improvements in stability and migration speed.

Cluster MigrationElasticsearchPerformance Tuning

0 likes · 20 min read

Practical Experience of Large‑Scale Elasticsearch Cluster Node Migration at Qunar

DataFunSummit

Jan 22, 2023 · Big Data

Applying Spark SQL at Ping An Insurance: Business Background, Deployment Choices, Migration Process, and Lessons Learned

This article details how Ping An Insurance migrated its offline Hive SQL workloads to Spark SQL, covering business background, deployment mode selection, migration workflow, typical challenges, optimization measures, and the resulting performance and resource utilization improvements.

Cluster MigrationDeployment Modesbig data

0 likes · 16 min read

Applying Spark SQL at Ping An Insurance: Business Background, Deployment Choices, Migration Process, and Lessons Learned

Ops Development Stories

Oct 10, 2022 · Operations

How to Safely Change Ceph MON IP Addresses During Server Migration

This guide details how to modify Ceph monitor (MON) IP addresses when moving a Ceph cluster to a new data center, covering both same‑network IP changes by adding and removing MON nodes and full‑network IP updates using monmaptool, with step‑by‑step commands and troubleshooting tips.

CephCluster MigrationIP

0 likes · 8 min read

How to Safely Change Ceph MON IP Addresses During Server Migration

YunZhu Net Technology Team

Apr 7, 2022 · Operations

RocketMQ Cluster Migration: Issues, Preparation Steps, and Recommended Migration Plans

This article analyzes the problems caused by multiple independent RocketMQ clusters, outlines the current cluster architecture, details pre‑migration preparations, compares two migration schemes (one not recommended and one recommended), and summarizes the benefits of consolidating clusters into a single, well‑managed deployment.

Cluster MigrationDockerInfrastructure

0 likes · 9 min read

RocketMQ Cluster Migration: Issues, Preparation Steps, and Recommended Migration Plans

Qunhe Technology Quality Tech

Mar 25, 2022 · Cloud Native

Migrating a Multi-Cloud Cluster in 2 Hours: Key Strategies and Lessons

This article details a real‑world multi‑cloud cluster migration, covering preparation, testing strategies, traffic replay, performance validation, latency simulation, and communication practices that enabled a successful two‑hour cutover without impacting critical services.

Cluster MigrationPerformance Testingcloud-native

0 likes · 13 min read

Migrating a Multi-Cloud Cluster in 2 Hours: Key Strategies and Lessons

Tongcheng Travel Technology Center

Nov 2, 2021 · Big Data

Hadoop Cluster Cross-Data Center Migration Practice at Tongcheng Travel

This article details Tongcheng Travel’s month‑long, zero‑downtime migration of hundreds of petabytes of Hadoop HDFS and YARN clusters across data centers, describing the background, migration strategies, lessons learned, tool enhancements, and future plans to improve data locality, balance, and monitoring.

Cluster MigrationDistCpHDFS

0 likes · 16 min read

Hadoop Cluster Cross-Data Center Migration Practice at Tongcheng Travel

360 Zhihui Cloud Developer

Mar 31, 2021 · Operations

How to Efficiently Backup and Restore Your Kubernetes Cluster with Velero and Other Tools

Accidental namespace deletions in Kubernetes can cause massive data loss, but by using etcd snapshots, resource‑level backup tools like Velero, PX‑Backup, and Kasten, and configuring scheduled backups, hooks, and PVC migration, you can protect clusters, streamline recovery, and avoid painful manual redeployments.

BackupCluster MigrationPVC

0 likes · 12 min read

How to Efficiently Backup and Restore Your Kubernetes Cluster with Velero and Other Tools

Didi Tech

Jan 5, 2020 · Big Data

Rolling Upgrade of HDFS from 2.7 to 3.2: Experience, Issues and Solutions

The team performed a rolling upgrade of HDFS from 2.7 to 3.2 on large clusters, resolving EditLog, Fsimage, StringTable and authentication incompatibilities by omitting EC data, using fallback images, rolling back commits and first upgrading to the latest 2.x release, following a staged JournalNode‑NameNode‑DataNode procedure, validating with rehearsals and a custom trash‑management tool, and achieving uninterrupted service, improved stability, performance and cost efficiency.

Big DataCluster MigrationErasure Coding

0 likes · 11 min read

Rolling Upgrade of HDFS from 2.7 to 3.2: Experience, Issues and Solutions

Snowball Engineer Team

Mar 23, 2018 · Big Data

Redesigning Snowball's Log Collection Architecture During Hadoop Cluster Expansion

The article details Snowball's challenges with a saturated CDH Hadoop cluster, outlines the limitations of the original Kafka‑based log pipeline, and explains how a comprehensive redesign using FlumeNG, Spillable Memory Channels, and custom HDFS sinks resolves latency, data loss, and high‑load issues while supporting future growth.

Cluster MigrationFlumeNGHadoop

0 likes · 6 min read

Redesigning Snowball's Log Collection Architecture During Hadoop Cluster Expansion