HotKey | BestHub

JD Retail Technology

Feb 7, 2025 · Backend Development

Cache Big‑Key and Hot‑Key Issues: Case Study, Root‑Cause Analysis, and Mitigation Strategies

A promotional event created an oversized Redis cache entry that, combined with cache‑penetration bursts, saturated network bandwidth and caused a service outage, prompting mitigation through Protostuff serialization, gzip compression, request throttling, and enhanced monitoring, while recommending design‑time cache planning and stress testing to prevent future big‑key failures.

CacheHotKeyPerformance

0 likes · 9 min read

Cache Big‑Key and Hot‑Key Issues: Case Study, Root‑Cause Analysis, and Mitigation Strategies

DeWu Technology

Nov 25, 2024 · Databases

Redis Hot Key Detection and Kernel-Based Real-Time Statistics

The article describes a kernel‑level hot‑key detection module for Redis that tracks per‑second access counts via an O(1) LRU queue, flags keys exceeding configurable thresholds, and provides real‑time subscription alerts and queryable logs, overcoming the latency and overhead limitations of existing detection methods.

HotKeyKernelPerformance

0 likes · 11 min read

Redis Hot Key Detection and Kernel-Based Real-Time Statistics

Java Tech Enthusiast

Oct 2, 2024 · Backend Development

Hotkey Detection Framework for JD App Backend

JD’s hot‑key detection framework instantly identifies bursty hot requests, pushes the hot keys to a clustered memory layer, and broadcasts them to all JVMs, enabling client‑side caching, user blocking, and circuit breaking, while handling up to 370 000 detections and 800 000 pushes per second and reducing backend query load by over 50 % in large‑scale events.

DistributedHotKeyJava

0 likes · 6 min read

Hotkey Detection Framework for JD App Backend

Architecture Digest

Feb 26, 2024 · Backend Development

JD-Hotkey: High-Performance Backend Hot Data Detection Framework

JD-Hotkey is a backend framework that detects and pushes hot keys at millisecond precision, handling billions of keys daily with up to 370,000 detection tasks per second and 600,000 push operations per second, dramatically reducing data‑layer pressure and improving application performance across various caching and rate‑limiting scenarios.

HotKeyPerformancebackend

0 likes · 5 min read

JD-Hotkey: High-Performance Backend Hot Data Detection Framework

Aikesheng Open Source Community

Nov 15, 2023 · Databases

Understanding Redis Hotkeys: Issues, Detection Methods, and Mitigation Strategies

This article explains what Redis hotkeys are, the performance and replication problems they cause, various techniques for detecting them—including client statistics, MONITOR, the HOTKEYS command, and TCP packet capture—and practical mitigation approaches such as sharding, multi‑level caching, and monitoring optimization.

CacheHotKeyPerformance

0 likes · 9 min read

Understanding Redis Hotkeys: Issues, Detection Methods, and Mitigation Strategies

Bilibili Tech

Sep 15, 2023 · Databases

Understanding and Detecting BigKey and HotKey Issues in Redis Clusters

BigKey and HotKey issues in Redis clusters arise when oversized keys block processing or a single key receives excessive requests, causing timeouts, memory overflow, shard collapse, and performance degradation, but can be detected during testing using Redis commands, visual clients, and open‑source analysis tools.

CacheDatabaseHotKey

0 likes · 8 min read

Understanding and Detecting BigKey and HotKey Issues in Redis Clusters

Code Ape Tech Column

Feb 16, 2023 · Databases

Understanding and Solving BigKey and HotKey Issues in Redis Clusters

BigKey and HotKey are common Redis cluster problems that can degrade performance, cause timeouts, network congestion, and even system-wide failures; this article explains their definitions, impacts, detection methods, and practical mitigation strategies—including key splitting, local caching, and migration optimizations—based on real-world production cases.

DatabaseHotKeyPerformance

0 likes · 22 min read

Understanding and Solving BigKey and HotKey Issues in Redis Clusters

JD Tech

Dec 1, 2022 · Databases

Understanding Redis Data Skew and Hotkey Detection with JD Open‑Source hotkey Solution

This article explains the concept of Redis data skew, its causes and impacts, explores data volume and access skew classifications, presents mitigation strategies, and provides a comprehensive source‑code walkthrough of JD's open‑source hotkey framework—including client, worker, and dashboard components—for detecting and handling hot keys in distributed cache clusters.

Data SkewHotKeyJava

0 likes · 54 min read

Understanding Redis Data Skew and Hotkey Detection with JD Open‑Source hotkey Solution

JD Retail Technology

Sep 1, 2020 · Backend Development

JD Hotkey Framework: Architecture, Performance Optimizations, and Scaling to 350k QPS

The article details JD's high‑performance Hotkey middleware, explaining its real‑time hot‑data detection architecture, the challenges faced during massive traffic spikes, and a series of systematic optimizations—including JDK upgrades, thread‑pool tuning, Disruptor replacement, and serialization changes—that enabled the system to scale from 20k to 350k queries per second while maintaining millisecond‑level latency.

DisruptorHotKeyJava

0 likes · 16 min read

JD Hotkey Framework: Architecture, Performance Optimizations, and Scaling to 350k QPS

JD Retail Technology

Jul 1, 2020 · Backend Development

JdHotkey: A Lightweight Hotkey Detection Framework – Architecture, Workflow, and Performance

The article introduces the JdHotkey framework, a lightweight, real‑time hotkey detection solution for Redis and other services, detailing the risks of hot keys, prior mitigation methods, core design components, operational workflow, and performance benchmarks across various hardware configurations.

EtcdHotKeyJava

0 likes · 16 min read

JdHotkey: A Lightweight Hotkey Detection Framework – Architecture, Workflow, and Performance