Tagged articles
Distributed Caching
32 articles · Page 1 of 1
This article details a Java implementation for one-click account freezing that uses a security version counter to instantly invalidate all access tokens, refresh tokens, sessions, and trusted devices across multiple clients without maintaining token blacklists, covering distributed caching, audit logging, and recovery flows.
Account FreezeAuthenticationDistributed Caching
0 likes · 23 min read

This article explores space-based architecture, a pattern that replaces central databases with replicated in-memory data grids to achieve extreme scalability, detailing its components, caching strategies, data synchronization mechanisms, collision risks with quantitative formulas, and trade-offs in simplicity, testability, and cost.
Distributed Cachingdata collisionin-memory data grid
0 likes · 18 min read

This article presents fourteen practical scenarios covering the design, pitfalls, strategies, and implementation details of distributed caching in Spring Boot, including cache breakdown prevention, write‑through vs. write‑behind, eviction policies, negative caching, secondary caches, cache‑aside pattern, warming, monitoring, consistency, and custom key generation, all illustrated with concrete code examples.
Cache ConsistencyCache EvictionDistributed Caching
0 likes · 17 min read

This article explains how Alluxio’s distributed caching architecture tackles the massive, multimodal data challenges of embodied AI, delivers near‑zero‑millisecond access, achieves 99.57% GPU utilization in MLPerf Storage v2.0, and validates its value through real‑world enterprise deployments.
AI data platformAlluxioData Infrastructure
0 likes · 21 min read

This article explains what a cache avalanche is, why it occurs in distributed systems, and presents practical mitigation techniques such as multi‑level caching, staggered expirations, mutex locks, and hotspot isolation to keep backend services stable under high load.
Backend PerformanceDistributed Cachingcache avalanche
0 likes · 5 min read

Alluxio’s distributed caching dramatically accelerates AI training and checkpointing workloads, achieving up to 99.57% GPU utilization and linear scaling across clusters in the MLPerf Storage v2.0 benchmark, while using cost‑effective commodity hardware to eliminate I/O bottlenecks.
AI TrainingAlluxioDistributed Caching
0 likes · 11 min read

This article examines how Volcano Engine's Elastic Instant Cache (EIC) tackles the memory bottleneck, high‑concurrency latency, and cross‑node coordination challenges of large language model inference by decoupling storage and computation, pooling resources, and applying layered optimizations, ultimately boosting AI inference efficiency, scalability, and cost‑effectiveness across various deployment scenarios.
AI infrastructureDistributed CachingKVCache
0 likes · 30 min read

The article details the consistent hashing algorithm, describing how a hash ring and virtual nodes distribute keys across servers, minimize data movement during node changes, compare it with simple modulo hashing, and outline typical use cases such as load balancing, distributed caches, storage systems, and database sharding.
Consistent HashingDistributed Cachinghash ring
0 likes · 10 min read

JD’s Hotkey framework provides millisecond‑level detection and cluster‑wide push of hot data, users, and interfaces, dramatically reducing backend query load, improving performance, and supporting scenarios such as local caching and rate limiting, with proven scalability demonstrated in large‑scale e‑commerce promotions.
Backend PerformanceDistributed CachingJava
0 likes · 7 min read

Consistent hashing replaces simple modulo‑based distribution to efficiently locate cached data across changing numbers of servers, using a hash ring and virtual nodes to ensure balanced load, minimize data movement, and improve reliability in distributed caching, load balancing, and database sharding scenarios.
Consistent HashingDistributed CachingSharding
0 likes · 6 min read

The presented hotspot detection and local‑cache framework leverages the HeavyKeeper streaming top‑k algorithm with decay‑based burst detection, integrates zero‑code SDK support and a whitelist‑enabled LRU cache, enabling a few megabytes of memory to achieve up to 85% hit rates and dramatically reduce Redis load in high‑traffic applications.
Distributed Cachingheavykeeperhotspot detection
0 likes · 21 min read

This article explains the concept of Redis data skew, its causes and impacts, explores data volume and access skew classifications, presents mitigation strategies, and provides a comprehensive source‑code walkthrough of JD's open‑source hotkey framework—including client, worker, and dashboard components—for detecting and handling hot keys in distributed cache clusters.
Distributed CachingHotKeyperformance optimization
0 likes · 54 min read

GooseFS, Tencent Cloud’s distributed caching system for storage‑compute separation, links compute frameworks to underlying storage (COS, CHDFS, COSN) and boosts big‑data and AI workloads by 2‑10× through transparent acceleration, robust master‑worker architecture, Raft‑based HA, tiered caching, and metadata optimizations, delivering up to 50% cost savings and 29% faster compute jobs.
Distributed CachingGooseFSLRU cache
0 likes · 18 min read

This article explains the principles of consistent hashing, compares it with simple modulo hashing, and shows how the hash ring, virtual nodes, and key mapping improve load balancing, minimize data loss during node changes, and prevent cache avalanche in distributed caching systems.
Consistent HashingDistributed Cachingvirtual nodes
0 likes · 12 min read

The article details Vivo’s push notification platform, describing its evolution from cloud‑based beginnings to a self‑built, three‑region architecture that supports over 1 million concurrent connections, billions of daily messages, and incorporates optimizations such as adaptive heartbeats, advanced load‑balancing, distributed caching, multi‑layer rate limiting, circuit‑breaker mechanisms, and comprehensive content security.
Distributed CachingLong ConnectionPush Notification
0 likes · 16 min read

This article explores the essence of system architecture, illustrating how large‑scale services like Uber and Weibo handle massive traffic, data storage, service decomposition, multi‑level caching, and monitoring, and offers practical design principles for building robust, high‑performance backend systems.
Distributed Cachingbackend architectureperformance optimization
0 likes · 22 min read

Fluid is an open‑source cloud‑native data orchestration and acceleration system that runs on Kubernetes, offering storage‑agnostic datasets, distributed caching, intelligent scheduling, and performance optimizations for data‑intensive AI and big‑data workloads.
AIDistributed CachingFluid
0 likes · 6 min read

This article explains the drawbacks of a basic modulo hash algorithm for key distribution, demonstrates how consistent hashing resolves scaling and node‑failure issues, and discusses virtual‑node techniques to mitigate data skew and improve load balancing in distributed cache systems.
Consistent HashingData SkewDistributed Caching
0 likes · 5 min read

This article uses a classic distributed caching scenario to explain consistent hashing, detailing its principles, advantages, challenges like cache avalanche, and solutions such as virtual nodes, while illustrating each step with clear diagrams and examples.
Consistent HashingDistributed Cachingcache avalanche
0 likes · 14 min read

This article explains why distributed caching is essential for large‑scale internet applications, outlines the business and technical benefits of cloud services, and details EVCache’s cloud‑native design, cross‑region replication, high‑availability mechanisms, and real‑world use cases such as Netflix’s recommendation system.
AWSDistributed CachingEVCache
0 likes · 15 min read

This article details a comprehensive robustness test of a core public service system's caching layer, exposing how decreasing Memcached (MC) instances dramatically impacts TPS and latency, analyzes the underlying Ketama consistent‑hash algorithm, and proposes concrete improvements to mitigate such failures.
Backend testingConsistent HashingDistributed Caching
0 likes · 11 min read

This article explains how memcached’s client‑side distribution works, illustrates the role of consistent hashing in assigning keys to servers, compares traditional modulo hashing with consistent hashing, discusses hash function choices, and provides complete Java and Python implementations for a scalable distributed cache.
BackendConsistent HashingDistributed Caching
0 likes · 12 min read

This article explains how startup engineers can design and implement a scalable web architecture—covering server clustering, load balancing, distributed caching, database replication, and team organization—to handle rapid user growth without compromising performance or reliability.
Database ReplicationDistributed CachingWeb Scaling
0 likes · 15 min read

This article explains how startup engineers can design and evolve a scalable web architecture—covering server partitioning, load balancing, distributed caching, database replication, and team organization—to handle rapid user growth without compromising performance or reliability.
Database ReplicationDistributed Cachingload-balancing
0 likes · 16 min read

This article explains the fundamentals of caching, the role of distributed caches like memcached in high‑concurrency environments, and details the algorithms—including remainder hashing and consistent hashing with virtual nodes—that enable memcached to distribute data across multiple servers efficiently.
Consistent HashingDistributed CachingMemcached
0 likes · 10 min read

A telecom CRM project introduced a horizontally scalable Memcache cache layer to store frequently accessed dictionary and customer data, reducing database queries by 30%, improving response times by 15%, and lowering expansion costs while detailing the architecture, access logic changes, high‑availability measures, and real‑world results.
Distributed Cachingbackend architecturememcache
0 likes · 13 min read

This article explains the fundamentals of caching, the role of memcached in high‑concurrency environments, and details the distributed implementation methods such as remainder hashing and consistent hashing, including their advantages, drawbacks, and optimization techniques.
Consistent HashingDistributed CachingMemcached
0 likes · 11 min read


21CTOMay 9, 2016 · Backend Development
Under high‑concurrency loads, disk I/O becomes a bottleneck, prompting the use of caches; this article explains the fundamentals of caching, the role of memcached, and details its distributed implementation, covering simple modulo hashing, consistent hashing, and optimized virtual‑node techniques.
Consistent HashingDistributed CachingMemcached
0 likes · 9 min read


21CTOApr 25, 2016 · Backend Development
This article explores why Memcached expiration can cause sudden DB overload and presents five practical strategies—including periodic DB refresh, lock‑based queries, dual‑key schemes, and time‑embedded values—to proactively update caches and keep backend performance stable.
BackendDistributed CachingJava
0 likes · 8 min read

The article explains Netflix’s EVCache—a cloud‑native, memcached‑based distributed cache that provides low‑latency, high‑reliability data access across multiple regions using asynchronous Kafka‑driven replication, detailing its architecture, performance optimizations, and remaining challenges.
Distributed CachingEVCacheKafka replication
0 likes · 10 min read

Consistent hashing organizes the hash space into a virtual ring, allowing cache servers and objects to be mapped with minimal disruption when servers are added or removed, thereby reducing cache misses and backend load compared to traditional modulo‑based hashing.
Consistent HashingDistributed CachingHash Algorithms
0 likes · 4 min read

The article analyzes the rapid growth of China’s 12306 online ticketing platform, the challenges of extreme traffic and concurrency during peak travel periods, and how a cloud‑native, memory‑centric architecture based on Pivotal Gemfire enabled scalable, high‑performance, and highly available ticketing services.
Distributed CachingPivotal Gemfirehigh concurrency
0 likes · 17 min read
