Tagged articles
Federation
34 articles · Page 1 of 1
This article details Ctrip's migration from Kubefed to Karmada for multi‑cluster governance, describing the architectural evolution, production deployment for high‑availability and smooth cross‑cluster pod migration, and the performance and memory optimizations required to support over 200 GB of control‑plane memory usage and tens of thousands of Pods.
Control Plane OptimizationFederationHigh Availability
0 likes · 18 min read

Learn how to design and implement a robust, production‑grade Prometheus high‑availability solution using a federated global cluster, multiple business‑level instances, remote storage with Thanos or VictoriaMetrics, Docker‑Compose deployment, health‑check scripts, performance metrics, alerting rules, and best‑practice operational guidelines.
Docker ComposeFederationHigh Availability
0 likes · 17 min read

This guide walks through designing and implementing a robust, enterprise‑grade Prometheus high‑availability solution using federation clusters, remote storage back‑ends, Docker‑Compose deployments, health‑check scripts, and best‑practice recommendations for monitoring, security, and performance.
Docker ComposeFederationHigh Availability
0 likes · 17 min read

This article examines the challenges and benefits of running stateful services such as Redis on Kubernetes, presents Kuaishou’s practical experience with cloud‑native migration, evaluates risks and performance impacts, and details the custom workloads, operators, federation and KubeBlocks solutions that enable large‑scale, reliable stateful service orchestration.
FederationKubeBlocksKubernetes
0 likes · 12 min read

This article presents Tongcheng Travel's metadata solution built on the open‑source Waggle Dance project, detailing the three‑layer architecture, challenges of a monolithic Hive Metastore, evaluated migration plans, federation implementation, migration workflow, and future directions for unified metadata governance.
FederationHive MetastoreWaggle Dance
0 likes · 11 min read

This article explains why organizations adopt multi‑cluster Kubernetes for high availability, hybrid‑cloud scaling, and fault isolation, outlines the preparatory steps, compares Federation v1 and v2, introduces Karmada as a CNCF project, and shares practical non‑federated deployment, monitoring, traffic management, and migration techniques with code examples.
DevOpsFederationKarmada
0 likes · 18 min read

This article explains why a global view is needed when Prometheus metrics are scattered across many instances, compares community approaches such as Federation, Thanos, and Remote Write, and details Alibaba Cloud's Global Aggregation Instance and Remote Write solutions with configuration examples and a real‑world case study.
FederationGlobal ViewPrometheus
0 likes · 25 min read

This article analyzes why a single Prometheus instance repeatedly runs out of memory and crashes, explains the underlying storage mechanisms, and presents practical solutions such as metric reduction, retention tuning, federation architecture, and remote storage integration to improve stability and scalability.
FederationPrometheusmonitoring
0 likes · 6 min read

Since Kubernetes became the de‑facto standard, ByteDance faced scaling limits with single‑cluster setups, prompting the adoption of KubeFed V2 and later the development of KubeAdmiral, a next‑generation multi‑cluster federation system that enhances scheduling, resource efficiency, native API support, and dynamic scaling across clouds.
FederationKubeAdmiralKubernetes
0 likes · 15 min read

This guide explains the purpose of Kubernetes Federation, walks through installing Helm, the kubefed controller plane, and kubefedctl, then details how to join clusters, enable resource federation, deploy sample workloads, and provides a handy command reference for multi‑cluster operations.
FederationHelmKubernetes
0 likes · 9 min read

This guide explains the purpose of Kubernetes Federation, its benefits for multi‑cluster management, step‑by‑step installation using Helm and kubefedctl, how to join and unjoin clusters, enable resource federation, and provides a cheat sheet of common commands for reliable cross‑cluster deployments.
FederationHelmKubernetes
0 likes · 8 min read

This article explains why Kubernetes federation is needed for managing multiple clusters, compares the deprecated Federation v1 with the improved v2 architecture, and introduces Karmada as a modern multi‑cloud orchestration solution, complete with configuration examples, scheduling strategies, and CRD definitions.
CRDFederationKarmada
0 likes · 16 min read

This article explains how to design and operate a RabbitMQ cluster capable of handling millions of messages per second by describing RabbitMQ fundamentals, Google‑scale deployment, sharding and consistent‑hash plugins, high‑availability mirroring, federation, and integration with Spring AMQP, while also covering practical deployment scenarios and performance trade‑offs.
FederationHigh AvailabilityMessage Queue
0 likes · 23 min read


ITPUBMay 7, 2022 · Big Data
This article details eBay's evolution of its massive HDFS storage—from a single‑cluster design to ViewFS Federation, then to Router‑Based Federation—highlighting the performance bottlenecks, optimization techniques, FastCopy integration, and future plans for further scaling and automation.
FederationHDFSRouter-based Federation
0 likes · 11 min read

This article explains why Kubernetes single‑cluster scalability is limited to about 5,000 nodes, introduces the concept of multi‑cluster federation, compares the legacy kubefed project with the actively maintained Karmada solution, and shows how policies and replica‑scheduling enable flexible cross‑AZ deployments and failover.
FederationKarmadaKubernetes
0 likes · 13 min read

This article explains how to horizontally scale RabbitMQ clusters, use sharding and federation plugins, configure mirror queues and other high‑availability features, and apply practical patterns such as confirms, retries, and delayed delivery to achieve million‑level message throughput in production environments.
FederationMessage QueueRabbitMQ
0 likes · 23 min read

This article explains how to horizontally scale RabbitMQ clusters to handle millions of messages per second by leveraging cluster modes, mirror queues, sharding plugins, consistent‑hash exchanges, federation, and high‑availability configurations, while also covering practical scenarios such as retries, delayed tasks, and Spring AMQP integration.
FederationHigh AvailabilityMessage Queue
0 likes · 22 min read

This article explains how to build both small‑scale and large‑scale high‑availability Prometheus setups using local and remote storage, federation, keepalived, and PostgreSQL + TimescaleDB adapters to ensure reliable monitoring and alerting across growing infrastructures.
FederationPrometheusRemote Storage
0 likes · 6 min read

This article explains how Prometheus’s local storage limits scalability and how Remote Storage, federation, and high‑availability setups—using dual instances, keepalived, and adapters with PostgreSQL + TimescaleDB—can overcome data persistence and performance challenges for both small‑scale and large‑scale monitoring environments.
FederationHigh AvailabilityPrometheus
0 likes · 5 min read

This guide walks through manually deploying a Prometheus federation on Kubernetes, covering environment setup with sealos, creating storage classes, persistent volumes, ConfigMaps, StatefulSets, services, applying manifests, and verifying the federation to aggregate metrics across multiple clusters.
FederationKubernetesPrometheus
0 likes · 10 min read

Enterprises adopt hybrid multi‑cloud architectures driven by high‑profile security incidents and regulatory demands, leveraging Kubernetes multi‑cluster capabilities such as disaster recovery, latency reduction, isolation, fault containment, and vendor‑lock‑in avoidance, with solutions like Federation v1/v2 and KubeSphere illustrated through real‑world case studies.
FederationKubeSphereKubernetes
0 likes · 13 min read

This article explains why modern enterprises adopt multiple Kubernetes clusters, covering single‑cluster capacity limits, hybrid‑cloud requirements, fault‑tolerance concerns, the benefits of multi‑cluster setups, architectural models, and community‑driven implementation patterns.
FederationMulti-Clustercloud-native
0 likes · 9 min read

This article examines common misuse of Prometheus federation, explains its limitations, and presents a pure‑Prometheus solution using multi_remote_read to achieve high‑availability monitoring, including configuration examples, code analysis, and best‑practice recommendations for proper data aggregation and query merging.
FederationPrometheusmulti_remote_read
0 likes · 11 min read

This article provides a comprehensive overview of HDFS—including its design goals, core components, data read/write workflows, high‑availability mechanisms, federation, storage policies, colocation benefits, and practical usage scenarios—explaining why it is the foundational distributed file system for large‑scale data processing.
Data StorageFederationHDFS
0 likes · 17 min read

This article details how Kuaishou tackled performance, scalability, and stability challenges of Hive MetaStore by introducing a BeaconServer hook architecture, read‑write separation, API refinements, traffic control, and federation designs, resulting in significant query efficiency and service reliability improvements.
FederationHiveRead-Write Separation
0 likes · 14 min read

This article explains how to design and implement a cloud‑native, large‑scale distributed monitoring system using Prometheus, covering its limitations, service‑level sharding, centralized storage, federation, and high‑availability strategies to overcome scaling challenges in Kubernetes environments.
FederationHigh AvailabilityPrometheus
0 likes · 12 min read

This article presents an in‑depth overview of ByteDance’s large‑scale HDFS deployment, describing its unique access layer, metadata and data layers, the evolution through multiple growth stages, and the key architectural improvements such as NNProxy, DanceNN, lock redesign, startup acceleration, and slow‑node mitigation techniques.
ByteDanceFederationHDFS
0 likes · 18 min read

This article explains the rise of multi‑cluster designs, outlines three common scenarios—cloud burst, disaster recovery, and active‑active—examines the complexities of application delivery across clusters, and details how Kubernetes and Alibaba Cloud’s ACK implement unified APIs, tunnel mechanisms, and high‑availability to enable true multi‑cloud operations.
ACKCluster TunnelFederation
0 likes · 19 min read

This article details Xiaomi's end‑to‑end, highly available Kubernetes monitoring solution that combines Prometheus, OpenTSDB, and Falcon to handle massive dynamic metrics, ensure persistent storage, and support seamless scaling across multiple clusters.
FederationHigh AvailabilityKubernetes
0 likes · 16 min read

This article analyzes the performance and stability bottlenecks of a Hadoop 2.7.3 NameNode caused by memory limits, RPC QPS, and long restart times, and presents a comprehensive solution stack—including HDFS federation, ViewFS, FastCopy, and tuned Balance/Mover tools—to improve scalability and reduce downtime.
BalanceFastCopyFederation
0 likes · 11 min read

This article describes the challenges of scaling Qunar's Hadoop NameNode, introduces HDFS Federation and the FastCopy tool, presents performance tests comparing FastCopy with DistCp, and details the development and evaluation of an optimized qFastCopy solution that reduces multi‑petabyte migration time from hours to a few.
FastCopyFederationHDFS
0 likes · 8 min read

This article examines the performance challenges encountered after upgrading a large‑scale HDFS cluster at VIP.com, explains the root causes of NameNode RPC latency, and presents concrete solutions—including delayed block reports, configurable block deletion, federation redesign, client monitoring, temp‑directory sharding, and small‑file handling—along with configuration snippets and real‑world results.
FederationHDFSHadoop
0 likes · 13 min read

Meituan‑Dianping migrated its 2,000‑node HDFS cluster to Federation by fixing ViewFs compatibility, simplifying mount points, leveraging FastCopy for massive data moves, improving token handling, and automating split‑workflow steps, thereby overcoming single‑NameNode bottlenecks and providing a practical blueprint for large‑scale Hadoop deployments.
FastCopyFederationHDFS
0 likes · 22 min read

In 2013 Alibaba Cloud faced full rack capacity in a single IDC, prompting the development of a multi‑NameNode, cross‑data‑center Hadoop solution that overcomes NameNode scalability, inter‑site bandwidth limits, data placement, job scheduling, massive data migration, and user transparency challenges.
Cross‑Data‑CenterFederationHadoop
0 likes · 14 min read
