BestHub
Sign in
Tagged articles

Backend Performance

83 articles · Page 1 of 1
Woodpecker Software Testing
Woodpecker Software Testing
Aug 27, 2026 · Backend Development

Backend Performance Tuning: Emerging Trends and Strategies for the Next Three Years

The article examines how backend performance tuning is evolving from manual, experience‑driven cycles to data‑driven observability, closed‑loop AIOps, serverless/Wasm architectures, and energy‑aware optimization, outlining concrete examples, tools, and forecasts shaping the field through 2026.

AIOpsBackend PerformanceEnergy Efficiency
0 likes · 8 min read
Backend Performance Tuning: Emerging Trends and Strategies for the Next Three Years
DevOps Coach
DevOps Coach
Apr 26, 2026 · Backend Development

Forget Kafka: A Lightweight Go Queue Achieves 2 Million Messages per Second

The article analyzes how replacing Kafka with a simple in‑memory Go queue reduced architectural complexity, boosted throughput from 240‑330 K to 1.8‑2.0 M messages per second, and clarified debugging, while still acknowledging scenarios where Kafka remains the better choice.

Backend PerformanceGoIn‑Memory Ring Buffer
0 likes · 8 min read
Forget Kafka: A Lightweight Go Queue Achieves 2 Million Messages per Second
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 16, 2026 · Backend Development

Why Bigger Connection Pools Fail Under High Concurrency and What to Do Instead

Increasing a database connection pool size often worsens performance under massive traffic because the bottleneck lies in hardware limits and management overhead, so developers must adopt async processing, read‑write splitting, caching, sharding, and proper pool tuning to sustain high concurrency.

Backend PerformanceDatabase ScalingHigh Concurrency
0 likes · 4 min read
Why Bigger Connection Pools Fail Under High Concurrency and What to Do Instead
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 13, 2025 · Backend Development

Boost Web Performance 10× with Nginx Caching: A Step‑by‑Step Guide

Learn how Nginx’s powerful caching mechanism can slash response times by up to tenfold, reduce backend load, and increase throughput, with detailed explanations of the caching workflow, essential configuration directives, micro‑cache tricks, and FastCGI caching examples for high‑traffic services.

Backend PerformanceCachingConfiguration
0 likes · 5 min read
Boost Web Performance 10× with Nginx Caching: A Step‑by‑Step Guide
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 2, 2025 · Backend Development

How to Stop Cache Penetration: 4 Proven Strategies for Robust Backends

This article explains what cache penetration is, why it occurs when requests bypass the cache to hit the database, and presents four effective mitigation techniques—including empty-result caching, Bloom filters, request validation, and distributed rate limiting—to safeguard backend performance.

Backend PerformanceBloom FilterRate Limiting
0 likes · 4 min read
How to Stop Cache Penetration: 4 Proven Strategies for Robust Backends
Code Wrench
Code Wrench
Sep 19, 2025 · Backend Development

Choosing the Right Go Web Framework: Performance, Ease‑of‑Use, and Use‑Case Guide

This article compares eight popular Go web frameworks—fasthttp, Fiber, Gin, Echo, Beego, Revel, Hertz, and Kratos—by evaluating their performance, developer friendliness, and ideal application scenarios, and provides concise code examples to help you select the best fit for high‑performance backend development.

Backend PerformanceGoWeb Frameworks
0 likes · 8 min read
Choosing the Right Go Web Framework: Performance, Ease‑of‑Use, and Use‑Case Guide
php Courses
php Courses
Sep 2, 2025 · Backend Development

Why Asynchronous PHP Will Transform Web Development by 2025

This article examines how asynchronous programming revitalizes PHP, detailing its core principles, emerging ecosystem, cloud‑native advantages, performance gains, improved developer experience, industry adoption, and the challenges ahead, forecasting that by 2025 async PHP will reshape modern web development.

Backend PerformanceSwooleasynchronous PHP
0 likes · 8 min read
Why Asynchronous PHP Will Transform Web Development by 2025
Architect
Architect
Aug 29, 2025 · Backend Development

Mastering Rate Limiting and Circuit Breaking: Practical Guidelines with Sentinel

This article explains how to identify interfaces that need pre‑emptive rate limiting, allocate resources for isolation, apply circuit‑breaking wisely, calculate thresholds based on resource capacity, and leverage Sentinel's features to ensure stable backend performance.

Backend PerformanceCircuit BreakingRate Limiting
0 likes · 10 min read
Mastering Rate Limiting and Circuit Breaking: Practical Guidelines with Sentinel
macrozheng
macrozheng
Aug 15, 2025 · Backend Development

10 Proven Strategies to Supercharge API Performance in Spring Boot

This article presents a comprehensive guide to optimizing API performance in Spring Boot projects, covering batch processing, asynchronous execution, caching, pre‑processing, pooling, parallelization, indexing, transaction management, code refactoring, pagination, SQL tuning, and lock granularity, complete with code examples and diagrams.

API optimizationBackend PerformanceSpring Boot
0 likes · 10 min read
10 Proven Strategies to Supercharge API Performance in Spring Boot
Code Mala Tang
Code Mala Tang
Jul 18, 2025 · Backend Development

Unlock Lightning-Fast Node.js: 8 Proven Backend Performance Hacks

Discover why a sluggish API hurts user retention, SEO, and costs, and learn eight practical Node.js backend optimization techniques—including mastering the event loop, avoiding blocking code, leveraging async/await, offloading heavy tasks, efficient JSON handling, caching strategies, database tuning, clustering, and continuous monitoring—to boost performance and scalability.

Backend PerformanceCachingNode.js
0 likes · 8 min read
Unlock Lightning-Fast Node.js: 8 Proven Backend Performance Hacks
Architect's Tech Stack
Architect's Tech Stack
Jun 22, 2025 · Backend Development

Boost API Performance: 12 Proven Backend Optimization Techniques

This article presents a comprehensive set of twelve backend optimization strategies—including batch processing, asynchronous execution, caching, pooling, parallelism, indexing, transaction management, and SQL tuning—to dramatically reduce API latency and improve overall system efficiency.

API optimizationBackend PerformanceBatch Processing
0 likes · 9 min read
Boost API Performance: 12 Proven Backend Optimization Techniques
Su San Talks Tech
Su San Talks Tech
Jun 7, 2025 · Backend Development

10 Proven Strategies to Supercharge API Performance in Java Applications

This article presents a comprehensive set of practical techniques—including batch processing, asynchronous execution, caching, preprocessing, pooling, parallelization, indexing, pagination, SQL tuning, and lock granularity—to dramatically reduce API latency and improve overall backend system efficiency.

API optimizationBackend PerformanceCaching
0 likes · 12 min read
10 Proven Strategies to Supercharge API Performance in Java Applications
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 5, 2025 · Backend Development

Mastering the C10K Challenge: How Nginx Handles 10,000 Concurrent Connections

This article explains the C10K problem—how a single server can manage ten thousand simultaneous connections—and outlines four essential techniques (I/O multiplexing, asynchronous non‑blocking I/O, lightweight threading models, and network stack optimization) that enable Nginx and similar servers to achieve high concurrency efficiently.

Backend PerformanceC10KI/O multiplexing
0 likes · 4 min read
Mastering the C10K Challenge: How Nginx Handles 10,000 Concurrent Connections
macrozheng
macrozheng
May 27, 2025 · Backend Development

Scaling Username Uniqueness: DB, Redis Cache & Bloom Filter

This article examines three strategies for checking username uniqueness at massive scale—direct database queries, Redis caching, and Bloom filter techniques—detailing their implementations, performance trade‑offs, memory consumption, and suitability for billions of users.

Backend PerformanceBloom FilterCaching
0 likes · 11 min read
Scaling Username Uniqueness: DB, Redis Cache & Bloom Filter
macrozheng
macrozheng
Apr 29, 2025 · Backend Development

How to Tame a 100× Traffic Surge: Practical Strategies for Backend Engineers

This guide walks backend developers through a step‑by‑step approach to handle sudden 100‑fold traffic spikes, covering emergency response, traffic analysis, robust system design, scaling techniques, circuit breaking, message queuing, and stress testing to keep services resilient and performant.

Backend PerformanceCircuit BreakingRate Limiting
0 likes · 12 min read
How to Tame a 100× Traffic Surge: Practical Strategies for Backend Engineers
Java Captain
Java Captain
Apr 4, 2025 · Backend Development

High Concurrency: Principles, Impacts, and Practical Solutions for Backend Systems

This comprehensive guide explains the nature of high concurrency, distinguishes it from parallelism, outlines its potential consequences across application, database, and service layers, and presents a systematic set of mitigation strategies—including rate limiting, asynchronous processing, redundancy, caching, and queue‑based designs—supported by real‑world case studies and code examples.

Backend PerformanceCachingDatabase Optimization
0 likes · 27 min read
High Concurrency: Principles, Impacts, and Practical Solutions for Backend Systems
macrozheng
macrozheng
Mar 28, 2025 · Backend Development

Boost API Performance: 12 Proven Backend Optimization Techniques

This article presents a comprehensive set of backend optimization strategies—including batch processing, asynchronous execution, caching, pre‑processing, pooling, parallelism, indexing, transaction management, program refactoring, pagination, SQL tuning, and fine‑grained locking—to dramatically reduce API latency and improve system efficiency.

API optimizationBackend PerformanceBatch Processing
0 likes · 10 min read
Boost API Performance: 12 Proven Backend Optimization Techniques
Radish, Keep Going!
Radish, Keep Going!
Jan 16, 2025 · Backend Development

How Hedged Requests Cut Tail Latency in Go Microservices

This article explains the hedged request pattern used by Google to combat microservice tail latency, shows how to implement it in Go with context and goroutines, discusses its impact on latency and load, and explores additional techniques such as SingleFlight and service‑class prioritization to further reduce tail delays.

Backend PerformanceGoTail Latency
0 likes · 6 min read
How Hedged Requests Cut Tail Latency in Go Microservices
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 10, 2024 · Backend Development

Understanding High Concurrency in Nginx: Configuration Tips and Best Practices

This article explains what constitutes high concurrency for Nginx, outlines the hardware and software factors that affect its performance, and provides concrete configuration examples such as worker_processes, worker_connections, and other tuning directives to help achieve stable high‑traffic handling.

Backend PerformanceHigh ConcurrencySystem Optimization
0 likes · 4 min read
Understanding High Concurrency in Nginx: Configuration Tips and Best Practices
Su San Talks Tech
Su San Talks Tech
Sep 30, 2024 · Backend Development

How JD’s Hotkey Framework Detects and Pushes Hot Data in Milliseconds

JD’s Hotkey framework provides millisecond‑level detection and cluster‑wide push of hot data, users, and interfaces, dramatically reducing backend query load, improving performance, and supporting scenarios such as local caching and rate limiting, with proven scalability demonstrated in large‑scale e‑commerce promotions.

Backend PerformanceJavadistributed caching
0 likes · 7 min read
How JD’s Hotkey Framework Detects and Pushes Hot Data in Milliseconds
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Apr 17, 2024 · Backend Development

Mastering High Concurrency: Boost Your Backend Performance

This article explains what high concurrency is, why it matters for large‑scale systems, and presents practical techniques such as distributed caching, load balancing, database optimization, traffic shaping, and distributed architecture to dramatically improve a backend's ability to handle massive simultaneous requests.

Backend PerformanceDatabase OptimizationHigh Concurrency
0 likes · 9 min read
Mastering High Concurrency: Boost Your Backend Performance
Ma Wei Says
Ma Wei Says
Mar 5, 2024 · Backend Development

How to Prevent Cache Penetration Attacks with Bloom Filters and Null Caching

The article explains what cache penetration is, why it can crash databases under malicious traffic, and presents practical mitigation techniques such as Bloom filters, null-value caching, data pre‑warming, and request validation to protect Redis‑backed systems.

Backend PerformanceBloom FilterCaching Strategies
0 likes · 6 min read
How to Prevent Cache Penetration Attacks with Bloom Filters and Null Caching
Su San Talks Tech
Su San Talks Tech
Feb 12, 2024 · Backend Development

How to Warm Up Your Cache for High‑Concurrency Systems

Cache warming, a technique used in high‑concurrency systems to preload frequently accessed data before traffic spikes, improves hit rates, reduces latency, prevents cache breakdowns, and eases backend load, with methods ranging from startup loading and scheduled jobs to Spring Boot listeners, Redis tools, and Caffeine loaders.

Backend PerformanceCaffeineJava
0 likes · 10 min read
How to Warm Up Your Cache for High‑Concurrency Systems
IT Services Circle
IT Services Circle
Jan 16, 2024 · Backend Development

Cache Prewarming Techniques and Implementation in Spring Boot and Redis

This article explains cache prewarming—its purpose, benefits, and various strategies such as startup loading, scheduled tasks, manual triggers, and cache loaders—while providing concrete Spring Boot and Redis examples, including code snippets for ApplicationReadyEvent, CommandLineRunner, InitializingBean, @PostConstruct, @Scheduled, and Caffeine cache loader.

Backend PerformanceCaffeineRedis
0 likes · 9 min read
Cache Prewarming Techniques and Implementation in Spring Boot and Redis
JD Retail Technology
JD Retail Technology
Dec 25, 2023 · Backend Development

Investigation and Resolution of JSF Asynchronous Call Timeout Causing Interface Availability Degradation

This article documents the investigation of a JSF asynchronous call timeout that reduced interface availability, explains the async call mechanisms, analyzes the root cause in the callback thread pool, and presents short‑term and long‑term solutions to restore 100% availability.

Backend PerformanceCompletableFutureJSF
0 likes · 12 min read
Investigation and Resolution of JSF Asynchronous Call Timeout Causing Interface Availability Degradation
Architect's Guide
Architect's Guide
Oct 31, 2023 · Backend Development

Understanding Distributed Tracing and the Principles of SkyWalking

Distributed tracing helps reconstruct the call chain of a request across multiple services and machines, providing insights into latency, errors, and performance; this article explains tracing concepts, OpenTracing standards, and how SkyWalking implements automatic span collection, context propagation, unique trace IDs, sampling, and its architecture and performance advantages.

Backend PerformanceOpenTracingSkyWalking
0 likes · 11 min read
Understanding Distributed Tracing and the Principles of SkyWalking
Didi Tech
Didi Tech
Jul 27, 2023 · Backend Development

Improving Service Startup Latency with a Warmup Mechanism for Dubbo Services

To eliminate the brief latency spike that occurs when new Dubbo services start, the authors introduce a @Warmup annotation and early‑startup listeners that generate mock traffic and trigger a forced GC before publishing, cutting initial response times from seconds to tens of milliseconds and improving reliability for latency‑sensitive applications.

Backend PerformanceDubboJava
0 likes · 13 min read
Improving Service Startup Latency with a Warmup Mechanism for Dubbo Services
Ctrip Technology
Ctrip Technology
Jun 1, 2023 · Backend Development

Optimizing Microservice Timeout Issues: Analysis and Practical Solutions

This article examines common timeout problems in microservice architectures, identifies root causes such as connection and socket timeouts, and presents ten practical optimization techniques—including setting appropriate timeouts, rate limiting, cache improvements, thread‑pool tuning, GC and JIT adjustments, NIO async programming, host migration, and network checks—to enhance system stability and performance.

Backend PerformanceCachingGC Tuning
0 likes · 21 min read
Optimizing Microservice Timeout Issues: Analysis and Practical Solutions
政采云技术
政采云技术
Apr 25, 2023 · Backend Development

Cache System Overview, Architecture Evolution, Pain Points, and Best Practices

This article explains the fundamentals of cache systems, describes the evolution from no‑cache to distributed and local caches, analyzes common challenges such as consistency, hot‑key detection, and cache avalanche, and provides practical guidelines and real‑world lessons for designing effective backend caching solutions.

Backend PerformanceCachingarchitecture
0 likes · 14 min read
Cache System Overview, Architecture Evolution, Pain Points, and Best Practices
Architect
Architect
Apr 20, 2023 · Backend Development

Common Interface Performance Optimization Strategies

This article summarizes practical techniques for reducing API latency, including batch processing, asynchronous execution, caching, pre‑processing, pooling, parallelization, indexing, transaction size control, program structure refactoring, deep pagination handling, SQL tuning, and proper lock granularity.

API optimizationBackend PerformanceIndexing
0 likes · 9 min read
Common Interface Performance Optimization Strategies
macrozheng
macrozheng
Apr 3, 2023 · Backend Development

Boost API Performance: 11 Proven Backend Optimization Techniques

This article presents a comprehensive set of backend API optimization strategies—including batch processing, asynchronous execution, caching, pre‑processing, pooling, parallelization, indexing, transaction management, code restructuring, deep pagination, SQL tuning, and lock granularity—to dramatically reduce response times and improve system efficiency.

API optimizationBackend PerformanceIndexing
0 likes · 10 min read
Boost API Performance: 11 Proven Backend Optimization Techniques
Ctrip Technology
Ctrip Technology
Mar 9, 2023 · Backend Development

Optimizing Hotel Query Service Memory Usage: GC Tuning, Native Memory Management, and Migration to jemalloc

This article details the systematic reduction of memory consumption for Ctrip's hotel query service by halving container memory, evaluating and tuning modern garbage collectors, diagnosing off‑heap leaks, and ultimately replacing the default ptmalloc allocator with jemalloc to achieve stable performance and lower resource costs.

Backend PerformanceContainerizationGarbage Collection
0 likes · 22 min read
Optimizing Hotel Query Service Memory Usage: GC Tuning, Native Memory Management, and Migration to jemalloc
Weimob Technology Center
Weimob Technology Center
Mar 8, 2023 · Backend Development

Mastering Elasticsearch Slow Query Automation: Profiling, DSL Extraction, and Optimization Rules

This article explains how to automate Elasticsearch slow‑query inspection by extracting DSL from slow‑log files, deduplicating queries, using the Profile API for detailed execution analysis, and applying rule‑based optimizations such as avoiding term‑long and range‑keyword queries to improve backend performance.

Backend PerformanceProfilingdsl optimization
0 likes · 14 min read
Mastering Elasticsearch Slow Query Automation: Profiling, DSL Extraction, and Optimization Rules
Architecture Digest
Architecture Digest
Jan 10, 2023 · Backend Development

Understanding Distributed Link Tracing, OpenTracing Standards, and SkyWalking Architecture

This article explains the concept of distributed link tracing, its importance for visualizing microservice call chains, introduces the OpenTracing standard, and details how SkyWalking implements automatic span collection, context propagation, unique trace IDs, sampling strategies, and performance advantages over other tracing tools.

Backend PerformanceOpenTracingSkyWalking
0 likes · 12 min read
Understanding Distributed Link Tracing, OpenTracing Standards, and SkyWalking Architecture
Top Architect
Top Architect
May 30, 2022 · Backend Development

Key Practices for Optimizing High‑Concurrency Backend Services

This article outlines practical strategies for handling high‑QPS backend services, including avoiding relational databases, employing multi‑level caching, leveraging multithreading, implementing degradation and circuit‑breaker mechanisms, optimizing I/O, using cautious retries, handling edge cases, and logging efficiently.

Backend PerformanceCachingCircuit Breaker
0 likes · 10 min read
Key Practices for Optimizing High‑Concurrency Backend Services
Top Architect
Top Architect
May 19, 2022 · Backend Development

Optimizing High‑Concurrency Services: Practical Strategies for 200k+ QPS

This article outlines practical techniques for handling ultra‑high‑traffic backend services—including abandoning relational databases, employing multi‑level caching, leveraging multithreading, applying degradation and circuit‑breaker patterns, optimizing I/O, using cautious retries, guarding boundary cases, and implementing efficient logging—to maintain sub‑300 ms response times at 200k+ QPS.

Backend PerformanceCachingCircuit Breaker
0 likes · 10 min read
Optimizing High‑Concurrency Services: Practical Strategies for 200k+ QPS
IT Architects Alliance
IT Architects Alliance
May 16, 2022 · Backend Development

Optimizing High-Concurrency Services: Strategies for Handling Over 200k QPS

This article outlines practical techniques for optimizing high‑concurrency online services handling over 200 k QPS, covering the avoidance of relational databases, multi‑level caching, multithreading, circuit‑breaker and degradation strategies, I/O reduction, cautious retry policies, boundary checks, and efficient logging.

Backend PerformanceCachingCircuit Breaker
0 likes · 10 min read
Optimizing High-Concurrency Services: Strategies for Handling Over 200k QPS
Architect
Architect
May 15, 2022 · Backend Development

Optimizing High‑Concurrency Services: Practical Strategies for QPS Over 200k

This article outlines practical techniques for handling ultra‑high‑traffic online services—such as avoiding relational databases, employing multi‑level caches, leveraging multithreading, applying degradation and circuit‑breaker patterns, optimizing I/O, using retries wisely, handling edge cases, and logging efficiently—to keep response times under 300 ms.

Backend PerformanceCircuit BreakerHigh Concurrency
0 likes · 9 min read
Optimizing High‑Concurrency Services: Practical Strategies for QPS Over 200k
Architecture & Thinking
Architecture & Thinking
Dec 9, 2021 · Backend Development

Preventing Cache Avalanche, Penetration, and Breakdown in High‑Traffic Systems

This article analyzes a real‑world cloud office system failure caused by cache avalanche, explains the concepts of cache avalanche, penetration, and breakdown, and presents practical solutions such as clustering, rate limiting, random expiration, pre‑warming, Bloom filters, and distributed locking to ensure system stability under heavy load.

Backend PerformanceCachingcache avalanche
0 likes · 13 min read
Preventing Cache Avalanche, Penetration, and Breakdown in High‑Traffic Systems
Top Architect
Top Architect
Dec 4, 2021 · Backend Development

Cache Usage Techniques and Design Solutions: Benefits, Costs, Update Strategies, Granularity, and Common Optimizations

This article explains how caching can accelerate read/write performance and reduce backend load, analyzes its benefits and costs, discusses update strategies, granularity control, and solutions for common problems such as cache penetration, empty‑hole, avalanche, and hot‑key reconstruction, providing practical guidelines for robust backend design.

Backend PerformanceCache invalidationOptimization
0 likes · 14 min read
Cache Usage Techniques and Design Solutions: Benefits, Costs, Update Strategies, Granularity, and Common Optimizations
Programmer DD
Programmer DD
Sep 16, 2021 · Backend Development

Mastering Cache Strategies: Types, Hit Rates, Eviction & Design Patterns

Explore comprehensive caching concepts—including client, server, and CDN caches—along with hit rate metrics, eviction methods, popular strategies like FIFO, LRU, LFU, and design patterns such as Cache‑Aside, Read/Write‑Through, and Write‑Behind, plus essential testing considerations for robust application performance.

Backend PerformanceCache EvictionCache Hit Rate
0 likes · 8 min read
Mastering Cache Strategies: Types, Hit Rates, Eviction & Design Patterns
Java High-Performance Architecture
Java High-Performance Architecture
May 29, 2021 · Backend Development

Unlocking Nginx Performance: Inside Its Modular, Event‑Driven Architecture

This article explains how Nginx achieves high performance through its modular design, event‑driven architecture, multi‑stage asynchronous request handling, master‑worker process model, and efficient memory‑pool implementation, contrasting it with traditional web servers and illustrating each concept with diagrams.

Backend PerformanceNginxProcess Model
0 likes · 9 min read
Unlocking Nginx Performance: Inside Its Modular, Event‑Driven Architecture
Alibaba Cloud Native
Alibaba Cloud Native
May 3, 2021 · Backend Development

Why Dubbo Fails Under C10K Load and How to Fix It

This article details a large‑scale C10K performance test of Dubbo, analyzes why service calls time out under thousands of concurrent consumers, identifies heartbeat‑induced Netty thread saturation and TCP full‑connection‑queue overflow as root causes, and presents concrete optimizations that dramatically improve latency and stability.

Backend PerformanceC10KDubbo
0 likes · 13 min read
Why Dubbo Fails Under C10K Load and How to Fix It
Liangxu Linux
Liangxu Linux
Apr 16, 2021 · Backend Development

How Zero‑Copy and sendfile Boost Server Performance

This article explains the concepts of user space and kernel space, shows how traditional file‑to‑socket transfers involve multiple data copies with read/write system calls, and demonstrates how the Linux sendfile system call implements zero‑copy to reduce copies and system calls for high‑performance servers.

Backend PerformanceLinuxsendfile
0 likes · 6 min read
How Zero‑Copy and sendfile Boost Server Performance
Programmer DD
Programmer DD
Jan 12, 2021 · Backend Development

Mastering Cache Strategies: Preventing Bottlenecks in High‑Traffic Systems

This article explains how large‑scale internet applications can use various caching patterns—such as Cache‑Aside, Read‑Through, Write‑Through, and Write‑Behind—to alleviate database pressure, maintain data consistency, and avoid pitfalls like cache penetration, avalanche, and thundering under extreme traffic loads.

Backend PerformanceCachingcache patterns
0 likes · 9 min read
Mastering Cache Strategies: Preventing Bottlenecks in High‑Traffic Systems
Programmer DD
Programmer DD
Jan 11, 2021 · Backend Development

Mastering Cache Strategies: Prevent Database Bottlenecks in High‑Traffic Systems

This article explains how large‑scale internet applications can use various caching patterns—Cache‑Aside, Read‑Through, Write‑Through, Write‑Behind—and mitigation techniques for consistency, stampede, penetration, jitter, and avalanche to keep databases from becoming performance bottlenecks under massive traffic spikes.

Backend PerformanceCachingHigh Concurrency
0 likes · 9 min read
Mastering Cache Strategies: Prevent Database Bottlenecks in High‑Traffic Systems
Programmer DD
Programmer DD
Jan 10, 2021 · Backend Development

Mastering Cache Strategies to Prevent Bottlenecks in High‑Traffic Systems

This article explains how large‑scale internet applications can use various caching patterns—such as Cache‑Aside, Read‑Through, Write‑Through, and Write‑Behind—to reduce database load, avoid consistency problems, and mitigate high‑concurrency issues like cache avalanche and penetration.

Backend PerformanceCachingcache patterns
0 likes · 9 min read
Mastering Cache Strategies to Prevent Bottlenecks in High‑Traffic Systems
Liangxu Linux
Liangxu Linux
Dec 30, 2020 · Backend Development

Master High-Performance Backend Development: 10 Essential Techniques

This guide walks developers through a step‑by‑step progression of performance‑boosting techniques—including zero‑copy I/O, epoll, thread pools, lock‑free programming, IPC, RPC, database indexing, caching, Bloom filters, full‑text search, and load balancing—to help build faster, more scalable backend services.

Backend PerformanceConcurrencyI/O optimization
0 likes · 22 min read
Master High-Performance Backend Development: 10 Essential Techniques
Java Backend Technology
Java Backend Technology
Nov 19, 2020 · Backend Development

Why Long Database Transactions Crash Services and How to Prevent Them

The article explains how long‑running database transactions can exhaust connection pools, block threads, and cause widespread service failures, then offers practical strategies—including keeping transactions short, removing RPC calls, enhancing monitoring, and reviewing code—to detect and prevent these high‑risk issues.

Backend PerformanceDatabase Connection PoolSpring
0 likes · 7 min read
Why Long Database Transactions Crash Services and How to Prevent Them
dbaplus Community
dbaplus Community
Jul 2, 2020 · Backend Development

Why High Concurrency Is Really About Squeezing CPU Performance

The article explains that high concurrency in distributed systems is measured by QPS, but its essence lies in effectively utilizing CPU resources, discusses control‑variable analysis of the HTTP request flow, compares PHP‑Swoole and Java‑Netty implementations, and shows how coroutine‑based designs can dramatically boost throughput when I/O blocking is present.

Backend PerformanceCPU utilizationHigh Concurrency
0 likes · 15 min read
Why High Concurrency Is Really About Squeezing CPU Performance
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jul 23, 2019 · Backend Development

Designing Ultra‑Fast High‑Concurrency Systems: Principles and a 60k QPS Flash‑Sale Case Study

This article outlines core principles for building high‑concurrency back‑end systems—doing less and doing it cleverly—then demonstrates their application in a real‑world flash‑sale (秒杀) scenario that handled 60,000 queries per second through careful feature selection, data reduction, caching strategies, queue control, and asynchronous processing.

Backend PerformanceCachingFlash Sale
0 likes · 18 min read
Designing Ultra‑Fast High‑Concurrency Systems: Principles and a 60k QPS Flash‑Sale Case Study
Programmer DD
Programmer DD
Jun 4, 2019 · Backend Development

How to Tackle Hotspot Key Bottlenecks in High‑Traffic Systems

This article explains why hotspot keys occur in large‑scale services, outlines the performance risks they create, and presents multiple mitigation strategies—including server‑side caching, Memcache/Redis, local caches, read/write separation, and proactive hotspot detection—to keep systems stable under heavy load.

Backend PerformanceCachingRead-Write Separation
0 likes · 8 min read
How to Tackle Hotspot Key Bottlenecks in High‑Traffic Systems
Architect's Tech Stack
Architect's Tech Stack
Nov 13, 2018 · Databases

Understanding Hot Key Issues and Effective Solutions in Distributed Caching Systems

This article explains the causes of hot key problems in high‑traffic scenarios, outlines their potential impact on system performance, and presents multiple mitigation strategies—including server‑side caching, Memcache/Redis, local caches, read‑write separation, and proactive hot‑data detection—while comparing their advantages and trade‑offs.

Backend PerformanceHot KeyRead-Write Separation
0 likes · 7 min read
Understanding Hot Key Issues and Effective Solutions in Distributed Caching Systems
Java Captain
Java Captain
Sep 1, 2018 · Backend Development

Thoughts on High‑Concurrency Traffic Control and Rate‑Limiting Techniques

This article shares practical insights on handling high‑concurrency traffic, explaining what constitutes large traffic, common mitigation strategies such as caching, downgrade, and focusing on rate‑limiting techniques—including counters, sliding windows, leaky‑bucket and token‑bucket algorithms—and demonstrates using Guava’s RateLimiter for Java applications.

Backend PerformanceGuavaHigh Concurrency
0 likes · 6 min read
Thoughts on High‑Concurrency Traffic Control and Rate‑Limiting Techniques
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 7, 2018 · Backend Development

Understanding Distributed Caching: Use Cases, Memcached vs Redis Comparison, and Common Challenges

This article explains why distributed caching is essential for high‑concurrency systems, outlines typical use cases, compares Memcached and Redis across features and performance, and discusses common problems such as cache avalanche, penetration, warm‑up, update strategies, and degradation.

Backend PerformanceCaching StrategiesMemcached
0 likes · 8 min read
Understanding Distributed Caching: Use Cases, Memcached vs Redis Comparison, and Common Challenges
JD Tech
JD Tech
Jul 26, 2018 · Backend Development

Why Design Caches? Multi‑Level Cache Strategies, Synchronization Schemes, and Common Pitfalls

This article explains the motivation behind cache design, compares CPU and application‑level caches, discusses multi‑level and distributed caching, outlines synchronization methods, eviction policies, and answers frequent cache‑related questions to help reduce database load and improve system performance.

Backend PerformanceCache EvictionCaching
0 likes · 13 min read
Why Design Caches? Multi‑Level Cache Strategies, Synchronization Schemes, and Common Pitfalls
Java Captain
Java Captain
Jun 27, 2018 · Backend Development

High Concurrency Traffic Control and Rate Limiting Techniques

This article discusses practical approaches to handling massive traffic spikes—defining high‑traffic scenarios, common mitigation methods such as caching, degradation, and various rate‑limiting algorithms (counter, sliding window, leaky bucket, token bucket), including Guava's RateLimiter and brief notes on distributed implementations.

Backend PerformanceGuavaHigh Concurrency
0 likes · 6 min read
High Concurrency Traffic Control and Rate Limiting Techniques
Architecture Digest
Architecture Digest
Feb 12, 2018 · Backend Development

Handling High Traffic: Common Rate‑Limiting Techniques and Guava RateLimiter

This article discusses the definition of high traffic, common mitigation methods such as caching, degradation, and especially various rate‑limiting algorithms—including counters, sliding windows, leaky bucket, and token bucket—and demonstrates using Guava's RateLimiter for practical throttling.

Backend PerformanceGuavaHigh Concurrency
0 likes · 7 min read
Handling High Traffic: Common Rate‑Limiting Techniques and Guava RateLimiter
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 8, 2018 · Backend Development

How Tengine Boosts HTTPS Performance with Intel QAT Async Acceleration

This article explains how Alibaba’s lightweight web server Tengine leverages Intel QuickAssist Technology to offload SSL operations via an async ssl_async module, detailing its architecture, integration with OpenSSL, performance gains across various cipher suites, and the resulting multi‑fold increase in HTTPS throughput.

Backend PerformanceHTTPS accelerationIntel QAT
0 likes · 8 min read
How Tengine Boosts HTTPS Performance with Intel QAT Async Acceleration
Efficient Ops
Efficient Ops
Aug 7, 2017 · Backend Development

How Adjusting PHP‑FPM max_requests Stabilizes CPU and Memory Usage

This article explains how tuning the PHP‑FPM max_requests setting and modifying its source code can eliminate periodic CPU_IDLE and MEM_USED fluctuations in high‑traffic web services, resulting in smoother resource utilization and more reliable performance.

Backend PerformanceCPU OptimizationMemory usage
0 likes · 6 min read
How Adjusting PHP‑FPM max_requests Stabilizes CPU and Memory Usage
ITPUB
ITPUB
May 18, 2017 · Backend Development

How to Prevent Cache Breakdown, Expiration, and Hot Key Issues in Distributed Systems

This article explains common problems of distributed caching such as cache breakdown, cache expiration, and hot‑key bottlenecks, and provides practical mitigation techniques including default null values, staggered expiration times, distributed locking, client‑side caching, and key sharding to maintain high‑concurrency performance.

Backend PerformanceCaching StrategiesHot Key
0 likes · 5 min read
How to Prevent Cache Breakdown, Expiration, and Hot Key Issues in Distributed Systems
Meituan Technology Team
Meituan Technology Team
Feb 17, 2017 · Backend Development

How Dynamic Log Level Adjustment Boosts Reliability in High‑Throughput Delivery Services

The article explains the design, implementation, and operational benefits of a middleware component that dynamically adjusts log levels in Java services, helping large‑scale delivery platforms balance comprehensive debugging information with system performance and avoid catastrophic failures during peak traffic.

Backend PerformanceJavaLog Management
0 likes · 13 min read
How Dynamic Log Level Adjustment Boosts Reliability in High‑Throughput Delivery Services
21CTO
21CTO
Feb 4, 2016 · Backend Development

How to Detect Hotspots with a Rate‑Limiting System Using Concurrent LRU Maps

This article explains how a rate‑limiting system can identify hot‑spot resources by using time‑window statistics, a concurrent LRU hash map, and cluster‑wide aggregation to efficiently track and evict low‑frequency keys while maintaining high throughput.

Backend PerformanceRate Limitingconcurrent data structures
0 likes · 9 min read
How to Detect Hotspots with a Rate‑Limiting System Using Concurrent LRU Maps
Java High-Performance Architecture
Java High-Performance Architecture
Oct 27, 2015 · Backend Development

How Consistent Hashing Powers Scalable Memcached Clusters

Caching dramatically improves website performance by storing data in memory for faster responses and reducing database load, with Memcached and Redis as popular solutions; proper routing algorithms like consistent hashing are essential to scale clusters without causing cache misses or service disruption.

Backend PerformanceCachingMemcached
0 likes · 2 min read
How Consistent Hashing Powers Scalable Memcached Clusters
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 28, 2015 · Backend Development

Optimizing Asynchronous Processing in Distributed Systems: Insights from Facebook and Alibaba

The article summarizes Zhao Haiping’s 2015 QCon talk on how asynchronous processing, profiling, and dependency‑tree scheduling can dramatically improve performance and scalability of distributed backend systems, drawing lessons from Facebook’s migration to async PHP and Alibaba’s ongoing optimization efforts.

@AsyncBackend PerformanceConcurrency
0 likes · 12 min read
Optimizing Asynchronous Processing in Distributed Systems: Insights from Facebook and Alibaba