Tag

Distributed Systems

0 views collected around this technical thread.

Tencent Cloud Developer
Tencent Cloud Developer
Nov 14, 2024 · Cloud Native

ZooKeeper Core Knowledge and Typical Application Scenarios

Although many platforms are dropping ZooKeeper, this guide explains its CP‑oriented architecture, znode structure, watcher mechanism, Zab consensus, leader election, and common patterns such as publish/subscribe, load balancing, naming, master election, distributed locks and queues, giving architects essential fundamentals for coordination services.

Consensus AlgorithmDistributed CoordinationDistributed Systems
0 likes · 25 min read
ZooKeeper Core Knowledge and Typical Application Scenarios
Tencent Cloud Developer
Tencent Cloud Developer
Jan 23, 2022 · Fundamentals

Understanding Paxos and Consensus Algorithms in Distributed Systems

Understanding Paxos and other consensus algorithms, this article explains how crash‑fault‑tolerant protocols like Paxos, Raft, and ZAB achieve sequential consistency through two‑phase voting, contrasts them with Byzantine‑fault‑tolerant methods, and details Multi‑Paxos optimizations, leader election, and practical trade‑offs for distributed systems.

Consensus AlgorithmCrash Fault ToleranceDistributed Systems
0 likes · 20 min read
Understanding Paxos and Consensus Algorithms in Distributed Systems
Tencent Cloud Developer
Tencent Cloud Developer
Jun 15, 2021 · Fundamentals

Understanding the Raft Consensus Algorithm: Principles, Workflow, and Comparison with Paxos

Raft is a leader-based consensus algorithm designed to be easier to understand and implement than Paxos, decomposing consensus into leader election, log replication, and safety rules; it ensures consistent, gap‑free logs, comparable performance, and simpler deployment for distributed systems.

Consensus AlgorithmDistributed SystemsLeader Election
0 likes · 16 min read
Understanding the Raft Consensus Algorithm: Principles, Workflow, and Comparison with Paxos
Tencent Cloud Developer
Tencent Cloud Developer
Apr 20, 2021 · Databases

Advanced Guide to Redis: Data Structures, Usage, Internals, Performance Issues, and Security

This comprehensive Redis guide explains core data structures like strings, lists, sets, hashes and sorted sets, explores advanced features such as Bloom filters, distributed locks and clustering, details internal mechanisms, performance bottlenecks, and provides essential security best practices for safe, high‑performance deployment.

Data StructuresDistributed SystemsPerformance
0 likes · 13 min read
Advanced Guide to Redis: Data Structures, Usage, Internals, Performance Issues, and Security
Tencent Cloud Developer
Tencent Cloud Developer
Apr 12, 2021 · Backend Development

Understanding Message Queues: From Basic Queues to Redis, Kafka, and Pulsar

The article compares basic in‑memory queues, Redis lists and streams, Kafka’s partitioned log architecture, and Pulsar’s compute‑storage separation, explaining each system’s core mechanisms, strengths, and limitations so readers can choose the most suitable message‑queue solution for their workloads.

ArchitectureDistributed SystemsKafka
0 likes · 29 min read
Understanding Message Queues: From Basic Queues to Redis, Kafka, and Pulsar
Java Tech Enthusiast
Java Tech Enthusiast
Apr 2, 2021 · Backend Development

Getting Started with RocketMQ: Installation, Core Concepts, and Spring Boot Integration

This guide walks through installing RocketMQ 4.5.1, launching NameServer and broker, testing with sample producer/consumer scripts, explains core components and console setup, shows Spring Boot starter integration with example code, and demonstrates sending normal, ordered, and transactional messages.

Distributed SystemsJavaMessage Queue
0 likes · 15 min read
Getting Started with RocketMQ: Installation, Core Concepts, and Spring Boot Integration
Xianyu Technology
Xianyu Technology
Feb 26, 2021 · Backend Development

Design and Implementation of the Optimus Tag Management Platform for Xianyu Feeds

The Optimus platform centralizes Xianyu feed tag configuration into a three‑layer system of tags, scenes, and experiments, providing a console for AB testing, time‑ and version‑based targeting, fast HSF/Diamond client integration, parallel rule‑based data fetching, cutting latency from 120 ms to 15 ms and enabling rapid tag updates that boosted pCTR and pCVR, with plans to broaden coverage and add smarter personalization.

Distributed SystemsJavaTag Management
0 likes · 9 min read
Design and Implementation of the Optimus Tag Management Platform for Xianyu Feeds
Tencent Cloud Developer
Tencent Cloud Developer
Aug 4, 2020 · Cloud Computing

Tencent Cloud Elasticsearch Optimization Practices in Tencent Meeting: High Availability, Performance, and Cost-Effective Solutions

Tencent Meeting migrated its quality‑analysis system to Tencent Cloud Elasticsearch, tackling OOM failures, 3 M/s write spikes and scaling limits by adding multi‑AZ deployment, leaky‑bucket rate limiting, streaming aggregation checks, optimized merge and translog handling, plus hot‑warm storage, ILM, multi‑disk and off‑heap caching, cutting cluster size from 15 000 to under 300 nodes while maintaining high availability and performance.

Cost OptimizationData EngineeringDistributed Systems
0 likes · 23 min read
Tencent Cloud Elasticsearch Optimization Practices in Tencent Meeting: High Availability, Performance, and Cost-Effective Solutions
Tencent Cloud Developer
Tencent Cloud Developer
Sep 11, 2019 · Big Data

YARN Practice and Technical Evolution at Kuaishou

Jiaoxiao Fang’s talk details Kuaishou’s YARN deployment, covering its architecture, support for offline, real‑time and ML workloads, and recent enhancements such as event‑handling stability, refined preemption, high‑throughput parallel scheduling, shuffle‑caching for small I/O, plus plans for job protection and multi‑cluster resource utilization.

Big DataCluster OptimizationDistributed Systems
0 likes · 16 min read
YARN Practice and Technical Evolution at Kuaishou
Tencent Cloud Developer
Tencent Cloud Developer
Jun 17, 2019 · Cloud Native

Service Mesh Implementation Challenges and Solutions: Practical Insights from Production Environment

Implementing a service mesh in production faces real‑world hurdles such as significant CPU consumption, 20‑50% performance loss, tangled sidecar responsibilities, missing registration support, and control‑plane bottlenecks, which can be mitigated by a central‑mesh fallback, IPC and lock‑free optimizations, staged sidecar splitting, and unified Pilot‑based service discovery.

Cloud NativeDistributed SystemsIstio
0 likes · 16 min read
Service Mesh Implementation Challenges and Solutions: Practical Insights from Production Environment
iQIYI Technical Product Team
iQIYI Technical Product Team
Jan 12, 2018 · Backend Development

Couchbase Caching Optimization and Case Studies in iQIYI's Bubble Social Backend

The article details iQIYI’s Bubble social service cache architecture, comparing Couchbase and Redis, explaining vBucket design and management UI, and presenting three real‑world optimizations—like‑system key redesign, voting‑system aggregation, and SDK upgrade—along with migration, synchronization, and operational best‑practice recommendations.

Backend DevelopmentCache OptimizationCouchbase
0 likes · 16 min read
Couchbase Caching Optimization and Case Studies in iQIYI's Bubble Social Backend