The article explains how layered caching in Java back‑ends—combining MyBatis first‑ and second‑level caches with a service‑layer Caffeine + Redis cache—affects cache granularity, consistency, distribution, and performance, and provides concrete configuration examples, code snippets, and best‑practice guidelines.
SpringBoot developers can dramatically boost throughput and cut latency by pairing a microsecond‑level local cache (Caffeine or Guava) with Redis, using a two‑level architecture that isolates hot data in JVM memory, reduces network and serialization overhead, and provides configurable eviction policies for various use cases.
The article explains why the default SpringBoot cache manager is insufficient for production, then walks through creating custom Caffeine and Redis CacheManager beans, configuring expiration, key prefixes, serialization, and multi‑level caching to solve issues like cache penetration, key collisions, and performance bottlenecks.
This article walks through a complete performance‑optimization and deployment pipeline for a Spring Boot blog, covering multi‑level caching with Caffeine and Redis, database indexing and cursor pagination, read‑write splitting, asynchronous processing, rate limiting, Docker multi‑stage builds, Nginx reverse‑proxy setup, Actuator monitoring, custom metrics, health checks, alerting, JMeter load testing, and JVM tuning.
This article explains how to design and implement a three‑level cache pyramid (Caffeine → Redis → MySQL) in Spring Boot 3, covering configuration, a reusable CacheTemplate, hot‑key handling, random TTL, warm‑up, monitoring, and load‑test results that show latency dropping from tens of milliseconds to a few milliseconds while cutting CPU and network usage dramatically.
This article outlines a multi‑level cache system for handling over a million QPS, detailing the architecture from client to database, key components like Caffeine and Redis Cluster, and providing concrete code examples for read‑through and write‑through flows.
This article explains why adding Redis alone may still be slow, introduces a three‑level cache pyramid (Caffeine L1, Redis L2, DB L3) built with Spring Boot 3, and provides complete configuration, code, warm‑up, monitoring, and benchmark results that reduce response time from 28 ms to 2 ms while cutting CPU usage by 35%.
The article demonstrates how to achieve a ten‑fold reduction in API response time by building a three‑level cache pyramid (Caffeine L1, Redis L2, DB L3) in Spring Boot 3, covering dependencies, configuration, core template code, warm‑up, monitoring, load‑test results and common high‑concurrency pitfalls.
This article explains what cache breakdown is in high‑traffic scenarios, why it can overload databases, and presents practical solutions such as pre‑warming hot data, scheduled cache refreshes, and multi‑level caching with code examples in Java and Redis.
By combining a local Caffeine cache, a remote Redis layer, and a MySQL database into a three‑tier cache pyramid, this guide shows how to reduce API response time from 28 ms to 2 ms, cut CPU usage by 35 %, and achieve up to 14‑fold performance gains, complete with configuration, code, and monitoring tips.
The article explains why adding Redis alone often remains slow, introduces a three‑level cache pyramid (L1 Caffeine, L2 Redis, L3 MySQL) built with Spring Boot 3, and shows how this design reduces request latency from 28 ms to 2 ms, cuts CPU usage by 35 % and achieves up to 14‑fold throughput improvement.
The article demonstrates how to combine Spring Boot 3, Caffeine local cache, and Redis into a three‑level cache pyramid, reducing API response time from 28 ms to 2 ms, cutting CPU usage by 35 %, and providing detailed configuration, code examples, performance benchmarks, and mitigation strategies for common high‑concurrency pitfalls.
The article explains that overwhelming request rates exceed database capacity, causing exponential latency, and presents six proven cache‑design techniques—including in‑process, Redis, multi‑level, cache‑aside, write‑through/write‑behind, and edge caching—to keep Spring Boot APIs stable, fast, and cost‑effective under high load.
This article explains why local caches are essential in high‑performance services, outlines required cache features, compares four Java‑based local cache implementations (ConcurrentHashMap, Guava Cache, Caffeine, Ehcache), and offers practical solutions for consistency, hit‑rate improvement, and technology selection.
SpringBoot’s out‑of‑the‑box defaults—such as Tomcat’s tiny connection pool, HikariCP’s 10‑thread limit, lazy‑loaded JPA entities, system‑timezone JSON serialization, un‑rolled Logback files, unlimited in‑memory cache, exposed Actuator endpoints, tiny file‑upload limits, per‑task thread creation for @Async, and unlimited transaction timeouts—can silently cripple production systems, so each must be reviewed and tuned for real‑world workloads.
This article explains how to build a JWT blacklist in Spring Boot 3, covering token fingerprinting, storage options using Caffeine or Redis, request interception, configuration, and sample login/logout endpoints to revoke tokens before they expire.
JetCache, an open‑source Java caching library, combines local (Caffeine) and distributed (Redis) caches into a multi‑level system, offering annotation‑driven lazy loading, automatic refresh, consistency strategies, cache pre‑warming, monitoring, and safeguards against penetration, avalanche, and memory leaks.
This article examines five frequent Redis cache anti‑patterns—cache avalanche, unbounded local cache, stale data, missing invalidation, and oversized objects—explaining their pitfalls with code examples and showing concrete fixes that dramatically improve latency, throughput, and memory usage.
This article explains why a first‑level local cache is essential for high‑performance services, outlines required cache features, compares four Java implementations (ConcurrentHashMap, Guava, Caffeine, Encache), and provides solutions for consistency, hit‑rate improvement, and technology selection, concluding that Caffeine offers the best performance.
This article explains the hidden performance killer of cache false sharing in multicore Java applications, demonstrates its impact with benchmark code, and shows how padding, the @Contended annotation, and Caffeine's internal structures can eliminate the issue for faster execution.
This article dissects Guava Cache's source code, explaining its segmented lock architecture, data structures, put/get implementations, cleanup and eviction mechanisms, and compares its performance and design choices with the more modern Caffeine cache library.
This article dissects Guava Cache's source code, explaining its segment‑based locking, data structures, put/get implementations, cleanup and eviction mechanisms, and then contrasts its performance and design choices with the more modern Caffeine cache, highlighting why Guava falls short.
Combining Redis’s distributed, high‑capacity cache with Caffeine’s ultra‑fast local cache creates a two‑level strategy where most reads hit the in‑process cache, fall‑backs use Redis, and only rare misses query the database, dramatically cutting latency, boosting throughput, and easing DB load.
This article explains the role of local in‑memory caches in high‑performance service architectures, compares implementations such as ConcurrentHashMap, Guava Cache, Caffeine, and Ehcache, discusses cache consistency and hit‑rate challenges, and recommends Caffeine as the preferred solution for multi‑level caching with Redis or Memcached.
An overview of two‑level caching architecture, the motivations for using local in‑memory caches, essential features of a local cache, comparative analysis of implementations using ConcurrentHashMap, Guava Cache, Caffeine, and Ehcache, and strategies for consistency, hit‑rate improvement, and practical code examples.
This article explains the inner workings of Caffeine's cache, covering the getIfPresent method, the design of ReadBuffer and StripedBuffer, eviction policies, the maintenance cycle, and the climb algorithm that dynamically adjusts window and protected partitions for optimal performance.
This article explains the inner workings of Caffeine's getIfPresent method, the design of its MPSC ReadBuffer and WriteBuffer, the maintenance cycle, eviction strategies, and the TinyLFU algorithm, providing Java code examples and diagrams to illustrate how caching decisions are made in high‑concurrency environments.
The article details practical monitoring strategies for both remote Redis and local Caffeine caches in high‑traffic game services, including prefix‑based Redis key tracking, Aspect‑oriented instrumentation, Caffeine statistics collection, and real‑world case studies that illustrate how these metrics identify hot‑keys, cache‑miss spikes, and reduce system load.
This article explains how to build a two‑level cache architecture using Caffeine as a local cache and Redis as a remote cache in a Spring Boot project, covering manual implementation, Spring cache annotations, and a custom AOP‑based solution while discussing advantages, consistency challenges, and best‑practice code examples.
This article explains how Caffeine implements element expiration using three built‑in policies and a custom TimeWheel strategy, detailing the construction of the timer wheel, bucket selection, scheduling, advancing, and eviction logic within the cache's maintenance cycle.
This article provides a comprehensive walkthrough of Caffeine cache's architecture, explaining its fixed-size eviction policy, underlying data structures such as ConcurrentHashMap, MPSC buffers, Count‑Min Sketch frequency tracking, and the dynamic window‑probation‑protected zones, while detailing key methods like put, getIfPresent, and maintenance.
This article recounts five successive performance optimizations applied to a SpringBoot‑Thymeleaf category‑tree API—adding Redis caching, scheduled async refresh jobs, local Caffeine memory cache, gzip compression via Nginx, and Redis data slimming—transforming query latency and scaling QPS from around 100 to over 500.
This article examines why and how to use local in‑process caches in Java, compares four implementations—ConcurrentHashMap, Guava Cache, Caffeine, and Ehcache—covers essential cache features, consistency challenges, hit‑rate optimization, and recommends Caffeine as the most performant choice for a two‑level caching architecture.
This article introduces the Caffeine Java caching library, detailing its features, core classes and parameters, various loading strategies—including manual, automatic, and asynchronous loading—eviction policies, removal listeners, and cache statistics, accompanied by practical code examples for integration in backend applications.
This guide introduces Caffeine, a high‑performance Java caching library, explains its core features, configuration options, loading strategies—including manual, automatic, asynchronous, and async loading caches—eviction policies, removal listeners, and statistics collection, providing code examples for each use case.
This article details a step‑by‑step performance improvement journey for a category‑tree query in a SpringBoot‑Thymeleaf system, covering Redis caching, scheduled jobs, local Caffeine cache, Gzip compression, and data slimming with byte‑array storage to resolve latency and large‑key issues.
This article walks through five successive performance optimizations—adding Redis caching, scheduling async updates, introducing a Caffeine local cache, enabling Nginx GZip compression, and compressing Redis data—to dramatically reduce the size and latency of a category‑tree API in a SpringBoot application.
This article introduces the high‑performance Caffeine caching library for Spring Boot 3.2, explains its core features, demonstrates detailed performance benchmarks, and provides practical code examples covering synchronous and asynchronous operations, eviction policies, removal listeners, refresh mechanisms, and statistics collection.
This article presents a real‑world case study of a high‑concurrency data‑processing interface whose response time was reduced from 30 seconds to under one second by diagnosing SQL bottlenecks, refactoring MyBatis code, applying PostgreSQL array aggregation, and introducing a Caffeine cache, while also discussing the limits of relational databases and promoting related AI services.
This article presents a real‑world case of optimizing a high‑concurrency transaction‑statistics API, detailing diagnosis of a 30‑second latency, SQL refactoring with array_agg and unnest, Java‑level improvements, and Caffeine caching, while also sharing promotional offers for ChatGPT services and a developer community.
This article introduces the Java Caffeine caching library, explains its manual, loading, and async cache APIs, details eviction and refresh strategies, shows how to collect statistics, and demonstrates full integration with Spring Boot using Maven dependencies, cache annotations, constant definitions, configuration classes, and usage examples.
This article explains why Caffeine’s default scheduler (disabledScheduler) does not trigger RemovalListener on expired entries, details the three cache cleanup strategies, compares the four built‑in schedulers, and shows how to configure a functional scheduler with code examples.
This article explains how to build a high‑performance, dynamically configurable rate‑limiting utility for Java applications using Caffeine cache with a 1‑second refresh interval, covering data structures, limit‑checking logic, dynamic configuration, and sample code with test results.
This article reviews three popular Java in‑process caching libraries—Guava, Caffeine, and Ehcache—explaining their configuration options, performance characteristics, monitoring capabilities, advantages and disadvantages, and provides a side‑by‑side comparison to help developers choose the most suitable local cache for their applications.
Learn how to implement a two‑level caching architecture in Spring Boot using Caffeine as a local cache and Redis as a remote cache, covering manual implementations, annotation‑driven approaches with @Cacheable/@CachePut/@CacheEvict, and a custom @DoubleCache annotation to minimize code intrusion while improving response times.
This article introduces J2Cache, a two‑level caching framework for Spring Boot, explains its L1 (Caffeine/Ehcache) and L2 (Redis/Memcached) architecture, and provides a complete hands‑on example covering Maven dependencies, configuration, core service classes, REST controller, and testing procedures.
Cache warming, a technique used in high‑concurrency systems to preload frequently accessed data before traffic spikes, improves hit rates, reduces latency, prevents cache breakdowns, and eases backend load, with methods ranging from startup loading and scheduled jobs to Spring Boot listeners, Redis tools, and Caffeine loaders.
Cache warming, a technique used in high‑concurrency systems, involves preloading frequently accessed data into memory before traffic spikes to improve hit rates, reduce cold‑start latency, prevent cache breakdowns, and lessen backend load, with various strategies such as startup loading, scheduled jobs, manual triggers, Redis tools, and Caffeine loaders demonstrated through Spring Boot code examples.
This article explains how upgrading Java and Groovy dependencies caused an IllegalAccessException in Caffeine's asynchronous cache due to module encapsulation, and details the attempted fixes including JVM '--add-opens' arguments and dependency version adjustments.
This guide walks through implementing a two‑level cache in Spring Boot 2.7 using Lettuce’s CacheFrontend together with Caffeine, covering dependency setup, configuration, custom CacheAccessor, bean definitions, and sample endpoints that demonstrate automatic synchronization and eviction between local JVM cache and Redis.
This guide explains how to implement API rate limiting in SpringBoot 2.7.16 using custom annotations, AspectJ, and the high‑performance Caffeine cache, covering cache configuration, eviction policies, statistics, and practical code examples for annotation definition, aspect logic, and controller usage.
An in‑depth comparison of popular Java in‑process caching solutions—Guava, Caffeine, and Ehcache—covers their expiration policies, capacity limits, eviction strategies, monitoring features, performance optimizations, and ideal use cases, helping developers select the most suitable cache for their applications.
This article explains cache prewarming—its purpose, benefits, and various strategies such as startup loading, scheduled tasks, manual triggers, and cache loaders—while providing concrete Spring Boot and Redis examples, including code snippets for ApplicationReadyEvent, CommandLineRunner, InitializingBean, @PostConstruct, @Scheduled, and Caffeine cache loader.
This guide explains why Ubuntu locks the screen after a few minutes of idle and provides three practical methods—adjusting power settings, using the Caffeine app, and editing UPower configuration—to prevent automatic sleep, along with step‑by‑step commands and warnings about energy efficiency.
This article provides a comprehensive overview of the Caffeine local cache library, covering its fundamentals, configuration options, loading strategies, eviction policies, statistics, and detailed steps for integrating Caffeine with Spring Boot using annotations and custom cache managers.
This article provides a comprehensive guide to Caffeine, a high‑performance Java local cache library, covering its fundamentals, loading strategies, eviction policies, refresh mechanisms, statistics, and step‑by‑step integration with Spring Boot using annotations such as @Cacheable and configuration examples.
This article explains how to build a three‑layer cache architecture for Spring Boot by integrating Redis as a distributed cache with Caffeine as a local cache, covering configuration, custom CacheManager implementation, message‑driven synchronization, and practical usage examples.
This article provides an in‑depth tutorial on the Caffeine local cache library for Java, covering its fundamentals, loading strategies, eviction policies, refresh mechanisms, statistics, and step‑by‑step integration with Spring Boot, including configuration, annotations, and practical code examples.
This article provides an in‑depth overview of the Caffeine local cache library for Java, covering its concepts, configuration options, loading strategies, eviction policies, asynchronous usage, statistics collection, and step‑by‑step integration with Spring Boot including annotations and practical code examples.
This article outlines the design goals, architecture, and implementation details of a high‑performance distributed caching solution for Spring Boot applications, combining Redis as a first‑level cache with Caffeine as a second‑level cache, and provides configuration, usage examples, and future enhancement plans.
This article details a step‑by‑step performance optimization of a category‑tree query in a SpringBoot‑Thymeleaf e‑commerce system, covering initial Redis caching, periodic job updates, local Caffeine cache, Gzip compression, data slimming, and byte‑level compression to dramatically improve response times and reduce Redis key size.
In this article we walk through five successive optimizations—adding Redis caching, scheduling asynchronous jobs, introducing local Caffeine cache, enabling Nginx GZip compression, and slimming Redis data—to dramatically improve the performance of a SpringBoot‑Thymeleaf classification‑tree query, reducing response size from 1 MB to 100 KB and raising QPS from 100 to over 500.
An overview of two-level cache architecture explains why local in-memory caches are needed, outlines essential cache features, compares implementations using ConcurrentHashMap, Guava Cache, Caffeine, and Ehcache with code examples, and discusses consistency, hit-rate improvement, and technology selection, recommending Caffeine for best performance.
This article introduces Caffeine Cache as a modern local caching solution, explains its W‑TinyLFU algorithm advantages over Guava, demonstrates various loading and eviction strategies, and provides detailed Spring Boot integration examples with Maven dependencies, configuration, annotations, and custom bean setups.
This article introduces the Caffeine Java caching library, explains its flexible expiration and write policies, and provides detailed manual, synchronous, and asynchronous code examples with console output to demonstrate how to integrate and benchmark Caffeine for high‑performance backend services.
Caffeine is a high‑performance, low‑memory Java cache library that outperforms alternatives in benchmarks, uses the W‑TinyLFU eviction algorithm, offers extensive configuration (capacity, weight, expiration, listeners, stats), and integrates seamlessly with Spring and Guava concepts.
This tutorial walks through the evolution from manual Redis calls to Spring Cache abstraction, explains AOP‑based proxying, details core annotations, demonstrates Caffeine and Redisson integration, explores list caching, and shows how to build a custom two‑level cache for high‑performance Java back‑ends.
This article explains how to replace manual cache handling with Spring Cache annotations, introduces the concepts of L1 (Caffeine) and L2 (Redis) caches, discusses design considerations for consistency, null handling, eviction, and provides practical Maven and configuration examples for Java backend applications.
This article provides an in‑depth tutorial on configuring and using the Caffeine caching library in Java, covering cache creation, property settings such as initial capacity, maximum size, weight, expiration policies, statistics collection, custom listeners, and advanced features like removal listeners and cache writers.
The article analyzes a weekend outage of a Spring Boot microservice where all HTTP requests timed out, tracing the root cause to Caffeine's synchronous cache eviction lock being blocked by a long‑running compute operation, and proposes using AsyncCache with a dedicated thread pool to avoid similar contention.
This article explains why multi‑level caching is needed, outlines design challenges of combining Redis and Caffeine, provides step‑by‑step integration instructions for Spring Boot, and presents performance benchmarks demonstrating the speed advantage of the multi‑level approach.
This article explains the design and implementation of a two‑level caching architecture using local Caffeine cache as L1 and remote Redis as L2 in Spring Boot, covering manual cache handling, annotation‑based management with Spring Cache, and a custom annotation with AOP to minimize code intrusion.
This article explains common cache replacement algorithms such as FIFO, LRU, LFU, and W‑TinyLFU, discusses their drawbacks, and provides a detailed SpringBoot example showing how to integrate the Caffeine caching library with code snippets and configuration instructions.
This article explains the Caffeine local cache library, its W‑TinyLFU eviction algorithm, how it improves on Guava Cache, and provides detailed examples of manual, synchronous, and asynchronous loading, eviction policies, reference types, statistics, and Spring Boot integration with code snippets.
This article walks through adapting a custom Redis client to Spring Cache, explains the cache abstraction, demonstrates annotation‑driven caching, shows how to integrate Caffeine and Redisson, and builds a simple two‑level cache to illustrate advanced scenarios for Spring Cache users.
Server‑side caching improves performance by trading space for time, using local caches like HashMap, Guava, Ehcache, and Caffeine, distributed caches such as Redis, and multi‑level architectures that combine in‑process, distributed, and database layers, while employing consistency patterns, monitoring, and hot‑key detection.
This article explains how Caffeine Cache improves on Guava Cache with the modern W‑TinyLFU algorithm, details its eviction strategies, shows how to configure it in Spring Boot, and provides code examples for manual, synchronous, and asynchronous loading, as well as annotation‑driven usage.
This article explains the concept of hot data, categorizes its types, discusses caching trade‑offs, introduces LFU, LRU and TinyLFU algorithms, describes the HotCaffeine system architecture and features, and presents performance improvements and practical deployment considerations for Java backend services.
This article introduces Caffeine Cache, explains its W‑TinyLFU eviction algorithm, compares it with Guava, and provides detailed usage examples—including manual, synchronous, and asynchronous loading, eviction policies, Spring Boot integration, annotations, and configuration snippets—for building high‑performance backend caches.
In high‑traffic e‑commerce systems, caching—ranging from simple in‑JVM HashMap caches to Guava, Caffeine, and Redis distributed stores—reduces latency by applying eviction policies such as FIFO, LRU, LFU, or W‑TinyLFU, while employing consistency strategies like expiration, write‑through, and cache‑aside to mitigate breakdown, avalanche, and penetration issues.
This article explains how to create a simple single‑node in‑memory cache that supports per‑entry expiration by defining a generic cache interface and implementing it with Caffeine, using ConcurrentHashMap to store multiple caches keyed by expiration time.
This article provides a comprehensive analysis of the Caffeine Java caching library, covering its performance‑focused W‑TinyLFU eviction algorithm, detailed source‑code walkthroughs of frequency sketching, read/write buffers, timer‑wheel expiration, and practical usage examples compared with Guava Cache.
This article explains Caffeine, a high‑performance Java local cache, comparing it with Guava Cache, detailing its W‑TinyLFU eviction policy, asynchronous read/write buffers, timer‑wheel expiration, and provides extensive source code analysis to illustrate its design and optimization techniques.
Caffeine is a high‑performance Java 8 local‑cache library that replaces Guava by using the W‑TinyLFU algorithm with three‑queue LRU structures and lock‑free read/write buffers, offering extensive configuration, dynamic runtime adjustments, and safe back‑source loading with distributed locks to prevent cache‑stampede.
This article explains Caffeine, a high‑performance Java local cache, covering its design improvements over Guava Cache, the W‑TinyLFU eviction algorithm, asynchronous read/write buffers, timer‑wheel expiration, and detailed source code analysis with examples.
This article explains Caffeine, a high‑performance Java local cache that supersedes Guava Cache, by detailing its design principles such as the W‑TinyLFU eviction algorithm, FrequencySketch implementation, adaptive window sizing, asynchronous read/write buffers, and timer‑wheel expiration, accompanied by extensive code examples.
This article explains Caffeine's high‑performance local cache features, presents JMH benchmark results that show it beating Guava, ConcurrentMap and ehcache, details its expiration, refresh and eviction mechanisms, compares memory usage and eviction algorithms, and provides migration code for Guava users.
This article traces iQIYI's five‑stage journey of Java caching—from simple database queries and in‑process HashMap caches, through Guava's advanced features addressing lock contention, expiration, and refresh, to the high‑performance Caffeine library with its W‑TinyLFU algorithm—while providing code examples and architectural insights.
This article traces iQIYI’s five‑stage evolution of Java caching—from simple database lookups and Redis synchronization to Guava Cache enhancements and finally to Caffeine’s W‑TinyLFU implementation—explaining each approach, its advantages, drawbacks, and the underlying algorithms that drive modern cache performance.
This article traces iQIYI’s five‑stage Java caching journey—from early database lookups, through Redis synchronization, in‑process HashMap and Guava caches, to modern Caffeine with W‑TinyLFU—explaining each phase’s advantages, drawbacks, eviction algorithms, and implementation details such as segment locking, expiration queues, and multi‑queue data structures.
