distributed caching

Lobster Programming

Jun 11, 2024 · Fundamentals

Why Consistent Hashing Matters: Solving Cache Distribution and Scaling Issues

Consistent hashing replaces simple modulo‑based distribution to efficiently locate cached data across changing numbers of servers, using a hash ring and virtual nodes to ensure balanced load, minimize data movement, and improve reliability in distributed caching, load balancing, and database sharding scenarios.

Shardingconsistent hashingdistributed caching

0 likes · 6 min read

Why Consistent Hashing Matters: Solving Cache Distribution and Scaling Issues

Bilibili Tech

Jan 6, 2023 · Backend Development

Hotspot Detection and Local Cache Framework for High‑Traffic Applications

The presented hotspot detection and local‑cache framework leverages the HeavyKeeper streaming top‑k algorithm with decay‑based burst detection, integrates zero‑code SDK support and a whitelist‑enabled LRU cache, enabling a few megabytes of memory to achieve up to 85% hit rates and dramatically reduce Redis load in high‑traffic applications.

Cache Optimizationdistributed cachingheavykeeper

0 likes · 21 min read

Hotspot Detection and Local Cache Framework for High‑Traffic Applications

JD Tech

Dec 1, 2022 · Databases

Understanding Redis Data Skew and Hotkey Detection with JD Open‑Source hotkey Solution

This article explains the concept of Redis data skew, its causes and impacts, explores data volume and access skew classifications, presents mitigation strategies, and provides a comprehensive source‑code walkthrough of JD's open‑source hotkey framework—including client, worker, and dashboard components—for detecting and handling hot keys in distributed cache clusters.

HotKeyJavaRedis

0 likes · 54 min read

Understanding Redis Data Skew and Hotkey Detection with JD Open‑Source hotkey Solution

Tencent Cloud Developer

Feb 28, 2022 · Big Data

GooseFS: Distributed Caching System for Storage-Compute Separation Architecture

GooseFS, Tencent Cloud’s distributed caching system for storage‑compute separation, links compute frameworks to underlying storage (COS, CHDFS, COSN) and boosts big‑data and AI workloads by 2‑10× through transparent acceleration, robust master‑worker architecture, Raft‑based HA, tiered caching, and metadata optimizations, delivering up to 50% cost savings and 29% faster compute jobs.

GooseFSMetadata OptimizationRaft consensus

0 likes · 18 min read

GooseFS: Distributed Caching System for Storage-Compute Separation Architecture

vivo Internet Technology

Jan 12, 2022 · Backend Development

Vivo Push Notification Platform: Architecture Evolution and Engineering Practices

The article details Vivo’s push notification platform, describing its evolution from cloud‑based beginnings to a self‑built, three‑region architecture that supports over 1 million concurrent connections, billions of daily messages, and incorporates optimizations such as adaptive heartbeats, advanced load‑balancing, distributed caching, multi‑layer rate limiting, circuit‑breaker mechanisms, and comprehensive content security.

Long ConnectionPush NotificationRate Limiting

0 likes · 16 min read

Vivo Push Notification Platform: Architecture Evolution and Engineering Practices

Laravel Tech Community

May 9, 2021 · Backend Development

Understanding Consistent Hashing: From Simple Modulo Hash to Optimizations

This article explains the drawbacks of a basic modulo hash algorithm for key distribution, demonstrates how consistent hashing resolves scaling and node‑failure issues, and discusses virtual‑node techniques to mitigate data skew and improve load balancing in distributed cache systems.

consistent hashingdata skewdistributed caching

0 likes · 5 min read

Understanding Consistent Hashing: From Simple Modulo Hash to Optimizations

Vipshop Quality Engineering

Jan 17, 2018 · Backend Development

Uncovering Hidden Cache Failures: A Robustness Test of Memcached with spymemcached

This article details a comprehensive robustness test of a core public service system's caching layer, exposing how decreasing Memcached (MC) instances dramatically impacts TPS and latency, analyzes the underlying Ketama consistent‑hash algorithm, and proposes concrete improvements to mitigate such failures.

Memcachedbackend testingcache robustness

0 likes · 11 min read

Uncovering Hidden Cache Failures: A Robustness Test of Memcached with spymemcached

Art of Distributed System Architecture Design

Jun 24, 2016 · Backend Development

Scalable Web Architecture for Startup Companies

This article explains how startup engineers can design and implement a scalable web architecture—covering server clustering, load balancing, distributed caching, database replication, and team organization—to handle rapid user growth without compromising performance or reliability.

database replicationdistributed cachingload balancing

0 likes · 15 min read

Scalable Web Architecture for Startup Companies

Qunar Tech Salon

May 29, 2016 · Backend Development

Understanding Distributed Caching: Principles and Implementation of Memcached

This article explains the fundamentals of caching, the role of distributed caches like memcached in high‑concurrency environments, and details the algorithms—including remainder hashing and consistent hashing with virtual nodes—that enable memcached to distribute data across multiple servers efficiently.

Memcachedbackendcache algorithms

0 likes · 10 min read

Understanding Distributed Caching: Principles and Implementation of Memcached

Architecture Digest

May 12, 2016 · Backend Development

Understanding Distributed Caching with Memcached: Principles and Algorithms

This article explains the fundamentals of caching, the role of memcached in high‑concurrency environments, and details the distributed implementation methods such as remainder hashing and consistent hashing, including their advantages, drawbacks, and optimization techniques.

Backend DevelopmentMemcachedcaching algorithms

0 likes · 11 min read

Understanding Distributed Caching with Memcached: Principles and Algorithms

Art of Distributed System Architecture Design

Mar 11, 2015 · Cloud Computing

Building a Scalable Cloud Application Platform for the 12306 Railway Ticketing System with Pivotal Gemfire

The article analyzes the rapid growth of China’s 12306 online ticketing platform, the challenges of extreme traffic and concurrency during peak travel periods, and how a cloud‑native, memory‑centric architecture based on Pivotal Gemfire enabled scalable, high‑performance, and highly available ticketing services.

Pivotal Gemfirecloud computingdistributed caching

0 likes · 17 min read

Building a Scalable Cloud Application Platform for the 12306 Railway Ticketing System with Pivotal Gemfire