BestHub
Sign in
Tencent Cloud Middleware
Tencent Cloud Middleware
Dec 15, 2022 · Operations

Designing Pulsar Disaster Recovery: Multi‑Region Replication, Rack‑Aware Placement, and Dual‑Write Strategies

This article explains how Tencent engineers configure Apache Pulsar for disaster recovery, covering multi‑replica consistency, journal handling, rack‑aware placement, GEO cross‑region replication, dual‑write/dual‑consume setups, and operational lessons for ad and billing scenarios.

Apache PulsarMessage QueuesOperational Practices
0 likes · 10 min read
Designing Pulsar Disaster Recovery: Multi‑Region Replication, Rack‑Aware Placement, and Dual‑Write Strategies
Big Data Technology Architecture
Big Data Technology Architecture
Apr 20, 2020 · Big Data

Introduction to HDFS: Architecture, Features, Replication, Rack Awareness, and Metadata Management

This article provides a comprehensive overview of Hadoop Distributed File System (HDFS), covering its streaming data access model, key characteristics, master‑slave architecture, block storage and replication mechanisms, rack‑aware placement strategy, and how the NameNode manages metadata and checkpoints.

HadoopRack Awarenessdistributed file system
0 likes · 7 min read
Introduction to HDFS: Architecture, Features, Replication, Rack Awareness, and Metadata Management
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 12, 2019 · Big Data

Weekly Knowledge Summary: Yarn Resource Scheduler, Hadoop Rack Awareness, HDFS Data Flow, and Small File Solutions

This weekly note shares personal updates and a concise technical overview covering Yarn's resource scheduling, Hadoop's rack‑aware architecture, HDFS data flow, and practical solutions to the HDFS small‑file problem, along with links to further reading and upcoming work plans.

HadoopRack AwarenessSmall Files
0 likes · 5 min read
Weekly Knowledge Summary: Yarn Resource Scheduler, Hadoop Rack Awareness, HDFS Data Flow, and Small File Solutions