This article shares ten practical pitfalls encountered while moving hour‑level Spark session processing jobs to Apache Flink, covering parallelism skew, state TTL, checkpoint handling, logging, debugging, state migration, Reduce vs Process, input validation, event‑time handling, and the trade‑offs of storing data inside Flink.
A developer discovers that massive OFFSET values in MySQL pagination cause full‑table scans and severe latency, then reproduces the issue with simulated data, benchmarks the slowdown, and presents three practical solutions—including index‑covering subqueries, cursor‑based pagination, and offset limits—to restore query performance.
This article presents a collection of Java best‑practice guidelines—including using the Builder pattern for many constructor arguments, privatizing utility class constructors, minimizing object creation, avoiding finalizers, applying the Law of Demeter, preferring enums, and careful use of var‑args—to improve code readability, memory usage, and runtime performance.
A production incident shows that using Java 8 parallel streams for message processing can dramatically reduce throughput, making them slower than a straightforward for‑loop due to the shared ForkJoinPool and thread‑pool sizing issues.
This article explains how NetEase Cloud's audio‑video service overcomes the limitations of TCP in poor network conditions by adopting a QUIC‑based acceleration proxy architecture, detailing its design, key optimizations, and performance gains in latency, packet loss resistance, and bandwidth utilization.
This article outlines how Alinode has evolved from a Node.js performance diagnostic tool into a comprehensive observability and scheduling platform for serverless environments, detailing its Insight monitoring features, remote debugging, crash analysis, standardization efforts, and runtime optimizations that improve cost and performance.
To meet the LEDAO platform’s need for rapid anomaly detection, full‑stack observability, and reliable alerting across more than 100 microservices, iQIYI evaluated OpenFalcon, Prometheus and CAT, selected CAT, deployed separate mainland and overseas clusters, added configurable access, health‑check and integrated alert channels, enabling five‑minute service onboarding, near‑zero‑intrusion instrumentation, and real‑time business‑level monitoring.
This article compares Redis and Memcached across thread model, data structures, eviction policies, pipelining, persistence, high availability, and clustering, helping developers choose the most suitable in‑memory database for their specific performance and feature requirements.
FlutterWorker is a Dart‑based cross‑platform logic framework that runs client‑side processing for Xianyu’s mobile app, unifying data handling across iOS, Android and Flutter, reducing server‑side BFF reliance, cutting memory and CPU overhead, improving latency by about five percent, and dramatically increasing development efficiency.
This article explains what synchronous and asynchronous Python code mean, how they are implemented in web servers, the performance factors of context switching and scalability, and the specific scenarios where async can outperform sync.
This article dissects Linux's synchronous blocking network I/O implementation, explaining how socket creation, recv handling, and soft‑interrupt processing each incur context‑switch overhead that makes BIO unsuitable for high‑concurrency server workloads.
The article analyzes the challenges of moving traditional on‑premise big‑data platforms to the cloud, outlines the cost‑saving opportunities of cloud‑native data lakes, presents three core architectural principles, and reviews Tencent Cloud's data lake product suite and its key use cases.
This article explains why synchronous blocking network I/O (BIO) is a performance bottleneck in high‑concurrency Linux servers, detailing the kernel‑level steps of socket creation, the recv path, soft‑interrupt handling, and how processes are blocked and later awakened.
The article explains how Java's String class was re‑engineered in JDK 9 to use a byte‑array with a coder flag, enabling Latin‑1 encoding, halving memory consumption, reducing GC pauses, and boosting overall application performance.
This article documents a developer’s attempt to run Ethereum mining software on an M1‑based MacBook Air, detailing the required patches, compilation steps, observed hash rates, daily earnings, and how the performance compares with traditional GPU miners.
This article investigates why MySQL recommends auto_increment over UUID or non‑sequential snowflake IDs by creating three tables, running insert and query benchmarks with Spring Boot and JdbcTemplate, analyzing index structures, and summarizing the performance trade‑offs and security considerations of each primary‑key strategy.
This article explains how to diagnose and resolve MySQL slave replication failures that occur when XtraBackup’s --kill-long-queries-timeout and --kill-long-query-type options interrupt long‑running queries, detailing steps such as checking performance_schema, reviewing error logs, restarting replication, and adjusting backup parameters.
This article evaluates three ways to insert records into a SQL Server database—repeated single inserts, XML‑based SQL concatenation, and batch processing—under a Spring Boot environment, providing code examples, performance test results, and practical recommendations for different data volumes.
An engineer’s costly mistake using MySQL’s INSERT INTO SELECT for nightly data migration led to out‑of‑memory crashes, full‑table scans, and payment record loss, prompting a deep dive into locking behavior, transaction isolation, and how proper indexing can safely rescue large‑scale inserts.
The article presents Sogou's open‑source C++ Workflow framework, highlighting its industrial‑grade performance, simple asynchronous API for servers and clients, benchmark results, and key features such as integrated task scheduling, extensive documentation, and real‑world adoption across many companies.
This article explains how the V8 JavaScript engine creates garbage data, the steps of its garbage‑collection algorithms, the roles of the minor (scavenger) and major (mark‑sweep) collectors, and modern optimizations like parallel, incremental, and concurrent collection to improve performance.
This article walks through the complete journey of a URL entered in a browser, covering URL parsing, DNS lookup, TCP handshake, OSI‑layer packet transmission, caching strategies, HTML parsing, rendering pipeline, and practical performance‑optimisation tips.
This article details a step‑by‑step optimization of a Java backend Excel import pipeline, covering migration from POI to EasyExcel, caching database lookups, batch insertion with MySQL VALUES, and parallel processing to reduce a 100k‑row import from minutes to under two minutes.
This article compiles fifty‑two actionable tips for improving SQL query performance, covering index creation, query rewriting, use of temporary tables, proper data types, server configuration, and best practices for MySQL and other relational databases.
The article explains that an infinite View animation continuously posts invalidate messages to the MessageQueue, preventing the idle handler from running and causing the Activity's onStop and onDestroy callbacks, scheduled with a 10‑second idle timeout, to be delayed until the queue becomes idle.
This article details the background, architecture, step‑by‑step troubleshooting, analysis of network and server queues, and the final configuration changes that resolved the intermittent slow response times of the Octavia load‑balancer API in an OpenStack environment.
This article presents a comprehensive guide to Redis monitoring and alerting, covering metric classification, threshold settings, client traffic collection, host resource usage, instance health checks, cluster failover diagnostics, and detailed explanations of Redis INFO sections with practical code examples.
The study compares four image‑blur approaches for a Flutter music app—real‑time BackdropFilter, CPU‑intensive StackBlur, server‑side GaussianBlur, and compact BlurHash—showing that BackdropFilter causes frame‑rate stutter, StackBlur adds decode overhead, server GaussianBlur offloads work with caching benefits, while BlurHash minimizes storage at the cost of visual fidelity, guiding developers to select the method that fits their performance and quality needs.
This article examines several MySQL pagination techniques—including basic LIMIT, subquery‑based, ID‑range, and temporary‑table methods—provides detailed performance measurements on a multi‑million‑row table, and offers practical recommendations for fast and scalable data retrieval.
This article revisits traditional hash table design, then introduces a novel approach that deliberately leverages a controlled probability of hash collisions combined with SIMD parallelism, presenting the B16 and B16Compact hash tables, their structures, algorithms, and experimental results showing superior speed and space efficiency compared to unordered_map and F14.
This guide explains how to customize Xdebug's profiler output filename using the xdebug.profiler_output_name setting, shows where the generated cachegrind files are stored on macOS, and provides steps to install Graphviz and qcachegrind for performance analysis, plus cleanup commands to remove old profiles.
After mastering the Socket protocol and a fixed‑QPS load‑testing model, I built a comprehensive Socket.IO performance test that simulates a teacher‑student scenario, measures message latency, identifies calculation errors and logging overhead, and reveals several bugs and optimization opportunities in the asynchronous handling and compensation threads.
This article explains how MySQL treats NULL values, why columns defined with NULL can invalidate indexes, demonstrates the behavior of IS NULL, IS NOT NULL, the spaceship operator, IFNULL, COUNT, DISTINCT, GROUP BY and ORDER BY with NULLs, and offers practical recommendations for schema design.
This article compiles fifty‑two practical SQL tuning strategies—including proper indexing, query rewriting, avoiding full table scans, using temporary tables, managing locks, and choosing the right storage engine—to help developers dramatically improve database query performance and scalability.
This article analyzes common causes of slow MySQL queries—especially index misuse—offers practical indexing techniques, explains MDL locks and large‑table bottlenecks, and then compares ElasticSearch and HBase as complementary solutions for high‑performance search and storage.
This article compiles 52 practical SQL tuning strategies—including index best practices, query rewriting, use of temporary tables, proper data types, and server configuration tips—to dramatically improve MySQL query speed and overall database efficiency.
This article analyzes the performance bottlenecks of PageHelper's pagination in MyBatis, demonstrates how large offsets degrade MySQL query speed, and presents a more efficient sub‑query join solution along with suggestions for refactoring the interceptor to improve backend pagination efficiency.
This article compiles 52 practical SQL performance‑tuning strategies—including indexing rules, query‑writing shortcuts, join optimizations, lock handling, temporary tables, storage‑engine choices, data‑type recommendations, backup tips, and useful code examples—to help developers dramatically improve query speed and overall database efficiency.
This article walks through the root causes of a live‑streaming outage caused by traffic spikes, explains core performance metrics such as response time and concurrency, and details a systematic set of optimizations—including timeout tuning, caching, fallback, retry policies, parallel processing, and API redesign—that restored system stability and improved latency.
This article explains how to optimize Elasticsearch for cross‑month and multi‑year queries on billions of records, covering Lucene fundamentals, index and search performance tweaks, configuration settings, and practical testing results to achieve sub‑second response times.
This article describes a series of improvements to a Spring‑Boot based Java RPC framework—including support for Protobuf and Kryo serialization, multiple load‑balancing algorithms, client‑side service caching, TCP long‑connection reuse via Netty, and a performance test that reduces request latency by more than tenfold.
This article explains why a small table should drive a large table in SQL queries, demonstrates data preparation, compares IN and EXISTS performance when the small table is either the inner or outer query, and concludes with practical guidelines for choosing between IN and EXISTS.
This article presents a comprehensive collection of 52 practical tips for optimizing SQL queries, covering index usage, query rewriting, data type selection, storage engine choices, transaction handling, and backup strategies to improve database performance and reduce resource consumption.
To improve SaaS B2B product efficiency and revenue retention, the article examines the unique challenges of frontend development in enterprise services, proposes a client‑side logging library—woodpecker‑log—detailing its design, storage with IndexedDB, performance considerations, API, and integration for rapid customer issue diagnosis.
The article presents a series of Java benchmarks that compare per‑iteration and cumulative string concatenation using String versus StringBuilder, explains why the compiler optimises String concatenation to StringBuilder, and draws conclusions about the most efficient usage patterns in loop‑heavy code.
This article compares the performance of common JavaScript looping constructs—including for, reverse for, forEach, for...of, for...in, and for...await—provides benchmark code on a million‑element array, explains the speed differences, and offers guidance on choosing the right loop for readability and maintainability.
This article explains how to enable and fine‑tune Nginx’s Gzip compression, detailing the benefits for CSS, JS, XML and HTML delivery, providing configuration directives, recommended parameter values, and example snippets for both local and production environments.
This article traces MySQL’s evolution, introduces its fork MariaDB, and presents a comprehensive performance benchmark—covering single and batch inserts, indexed and non‑indexed queries—on identical hardware, revealing that MariaDB generally delivers faster execution times albeit with higher memory usage.
This article provides a comprehensive overview of Oasis Engine, detailing its component‑based architecture, TypeScript implementation, key features such as Transform, resource and shader systems, its stability and performance achievements, historical development phases, and future roadmap for cross‑platform and open‑source enhancements.
Although Docker offers many benefits, this article outlines seven key reasons—data safety, performance, networking, statefulness, resource isolation, cloud platform incompatibility, and environment requirements—that make deploying databases in Docker containers generally unsuitable, while also suggesting scenarios where lightweight or distributed databases may still be viable.
In 2020 OceanBase achieved a world‑record TPC‑C benchmark of 7.07 billion tpmC, spun off as an independent company, attracted dozens of marquee customers, built a four‑layer ecosystem, delivered ultra‑high performance for enterprises, and introduced Paxos‑based disaster‑recovery that guarantees RPO = 0 and minute‑level RTO.
This article empirically investigates whether Java reflection incurs performance penalties, describing a series of benchmark tests that compare direct method/field access with reflective calls, analyzing results, identifying the main cost factors, and offering practical guidelines to mitigate reflection overhead in production code.
The QQ Music/Karaoke team migrated their Android app from 32‑bit to Arm64‑v8a by reconfiguring Gradle builds, recompiling or replacing over 120 native libraries, extending the dynamic‑resource loader for ABI selection, implementing ABI‑aware update channels, and fixing issues such as library path limits, I/O reliability, camera latency, and WebView cache corruption, completing the transition in early 2021.
This article compares several Java microservice frameworks—including Spring Cloud, Vert.x, SparkJava, Micronaut, Javalin, and Quarkus—by describing their features, required infrastructure, and performance results from 30‑second stress tests, while also noting resource consumption and startup times.
This article explains Kafka's underlying storage architecture, details the zero‑copy transferTo technique in Java, compares traditional four‑copy I/O with zero‑copy, and presents parallel FileTransferTo performance tests on a multi‑core Linux system environment.
Xianyu’s server‑side rendering solution uses a serverless Node.js app on Alibaba Cloud to aggregate backend data and render HTML, routing through Nginx and caching via CDN, which cuts first‑meaningful‑paint time, maintains high stability with low O&M, and seamlessly falls back to client‑side rendering when needed.
This article details the challenges of JD Pay's Android SDK growth, proposes a refactor using Scene, Interactor, and UserCase concepts to decouple business logic, presents architectural redesign, code examples, and quantitative performance improvements after the overhaul.
This article presents a series of benchmarks that compare direct method and field access with reflective calls in Java, analyzes where the performance overhead originates, and offers practical guidelines to mitigate reflection‑related slowdown in real‑world applications.
This article provides a comprehensive analysis of the Caffeine Java caching library, covering its performance‑focused W‑TinyLFU eviction algorithm, detailed source‑code walkthroughs of frequency sketching, read/write buffers, timer‑wheel expiration, and practical usage examples compared with Guava Cache.
This article presents a practical Netty‑based RPC solution using Protostuff serialization, detailing large‑scale stress testing, performance bottlenecks, and code‑level optimizations that enable handling hundreds of thousands of objects per second reliably.
This article explains Java's reflection mechanism, its core classes, practical uses such as accessing private members and dynamic loading, demonstrates code examples, discusses performance, security and compatibility issues, and provides guidance for Android developers.
This guide explains how to identify OutOfMemoryError crashes in Android applications caused by excessive thread‑pool creation, using tools like Android CPU Profiler, adb ps commands, and code hooks, and provides concrete steps to refactor OkHttp, RxJava, and SDK usage to prevent resource leaks.
This article explains Caffeine, a high‑performance Java local cache, comparing it with Guava Cache, detailing its W‑TinyLFU eviction policy, asynchronous read/write buffers, timer‑wheel expiration, and provides extensive source code analysis to illustrate its design and optimization techniques.
This article explains why Nginx HTTPS latency matters for instant search, describes how TLS handshake round‑trips affect response time, and provides step‑by‑step Nginx TLS configuration tweaks—including HTTP/2, cipher ordering, OCSP stapling, buffer sizing, and session caching—that together reduced real‑world latency by about 30%.
Protocol Buffers (ProtoBuf) is a language‑neutral, binary serialization format that enables compact, fast data exchange and easy backward‑compatible schema evolution across many languages, with automatic code generation, making it ideal for gRPC and storage despite being non‑human‑readable.
Caffeine is a high‑performance Java 8 local‑cache library that replaces Guava by using the W‑TinyLFU algorithm with three‑queue LRU structures and lock‑free read/write buffers, offering extensive configuration, dynamic runtime adjustments, and safe back‑source loading with distributed locks to prevent cache‑stampede.
This article explains the twenty‑one key non‑functional characteristics of software architecture—such as performance, reliability, scalability, security and maintainability—detailing their definitions, typical metrics, and practical techniques for improvement, while linking each trait to ISO‑25010 and real‑world engineering practices.
DiDi migrated over 10,000 Hive SQL tasks to Spark SQL using a lightweight dual‑run pipeline that extracts, rewrites, compares, and switches tasks, fixing syntax and UDF differences while adding features such as small‑file merging and enhanced partition pruning, resulting in Spark handling 85 % of workloads with 40 % faster execution, 21 % lower CPU and 49 % lower memory usage.
This article walks through systematic analysis of backend performance bottlenecks across a typical Nginx‑Tomcat‑Redis‑MySQL stack, covering bandwidth limits, OS ulimit settings, kernel TCP parameters, Nginx connection limits, Tomcat connector modes, Redis key handling, and MySQL query and hardware issues.
This article explains why message queues are essential for decoupling systems, enabling asynchronous processing and peak‑shaving, outlines their advantages and disadvantages, compares popular MQ products, and provides practical guidance on high availability, reliability, ordering, and architectural design.
Zhihu’s Moneta service, handling over a trillion rows of user‑read data, migrated from MySQL sharding to the open‑source HTAP database TiDB, achieving millisecond query latency, high availability, and horizontal scalability while detailing architecture changes, performance metrics, and lessons learned.
This article explains how Linux manages TCP sockets at the kernel level, demonstrates how to adjust port ranges and file‑descriptor limits, and shows the key data structures and lookup functions that enable high‑concurrency TCP connections, providing practical guidance for scaling client connections.
This article examines Baidu's home‑grown MVVM framework San, tracing its origins, core features, size and performance benchmarks, ecosystem tools such as CLI and DevTools, and real‑world deployments across Baidu App, feed pages, and mini‑programs, highlighting why it became the unified front‑end solution.
Redis can experience latency spikes due to factors such as complex commands, big keys, expiration patterns, memory limits, fork overhead, AOF persistence, CPU binding, swap usage, memory fragmentation, and network saturation, and this article provides a systematic troubleshooting methodology and practical optimization solutions for each scenario.
This article describes JD's research and production deployment of a self‑developed Remote Shuffle Service for Spark, covering its motivations, architectural design, cloud‑native features, monitoring, performance benchmarks against external shuffle solutions, and a real‑world promotion‑period case study that demonstrates improved stability and resource efficiency.
This article explains the shift from x86 to ARM architectures, outlines why services should be migrated to ARM‑based Kunpeng cloud servers, describes Huawei's migration tools and community support, and provides concrete C/C++ migration examples and common pitfalls for backend developers.
This article explains the layered design of Linux file I/O, describes how data moves from application buffers through libc, page cache, and kernel I/O queues to disk, discusses synchronization primitives, consistency issues, and performance factors such as scheduling algorithms and hardware characteristics.
This article provides an in‑depth guide to MySQL internals, covering the SQL execution process, server and storage engine layers, binlog/redo/undo logs, index structures, transaction isolation levels, lock types, MVCC implementation, buffer pool management, and practical optimization techniques.
This article outlines a comprehensive process for diagnosing and optimizing performance problems in production business systems, covering hardware, OS, database, middleware, JVM tuning, code inefficiencies, monitoring tools, and the limitations of pre‑release testing, with practical guidelines and visual references.
This article explains the concept of zero-copy I/O, covering buffer types, virtual memory, mmap+write and sendfile techniques in Java, and demonstrates how Java NIO, Netty, and other frameworks like RocketMQ and Kafka leverage zero-copy to reduce data copying and improve performance.
This comprehensive guide details the essential redis.conf parameters—including daemonization, networking, memory limits, logging, slowlog, advanced data structure encodings, replication options, and persistence settings—providing clear explanations and recommended values for optimal Redis deployment.
The D2 Language & Framework session covered Ben Lesh’s RxJS refactoring to reduce bundle size and boost speed, Ujjwal’s deep dive into ES2020/2021 features, monadic lift functions versus optional chaining, and practical performance gains achievable by targeting modern JavaScript standards.
Gaode Map’s low‑cost, long‑term performance strategy for super‑apps combines an adaptive resource‑scheduling framework, full‑dimension monitoring, and closed‑loop control to cut startup time over 70%, shrink memory use 30% and binary size 20%, delivering up to three‑fold speed gains on low‑end devices while preserving development efficiency.
PowerScrollView is a high‑performance Flutter flow‑layout framework that composes section‑based slivers for lists, grids and waterfalls, adds automatic exposure, scroll‑to‑index, fine‑grained refresh and element‑reuse optimizations, and uses frame‑by‑frame rendering to deliver smooth scrolling across Xianyu’s core pages.
This article provides a comprehensive overview of Linux I/O fundamentals, covering the layered I/O stack, buffer interactions, system call flow, scheduler algorithms, consistency and safety considerations, and performance characteristics, supplemented with code examples and illustrative diagrams.
This article introduces MapStruct, explains why traditional JavaBean conversion methods like reflection are inefficient, shows how to set up Maven dependencies, define entities and DTOs, write mapper interfaces, run tests, and highlights the performance, debugging, simplicity, and dependency‑free advantages of the generated code.
This article explains the functional and performance differences among SQL count(1), count(*), and count(column) expressions, including how they handle NULL values and when each method is most efficient, illustrated with a MySQL example.
This article introduces four approaches—simple time‑difference calculation, StopWatch‑like utilities, functional interfaces, and AutoCloseable—to accurately measure arbitrary code segment durations in Java, providing code examples and discussing their advantages and trade‑offs.
This article walks through three progressively better implementations for a complex e‑commerce search API—starting with a monolithic SQL query, then splitting the query and adding indexes, and finally using Redis sets and sorted sets to cache filter results, handle pagination, and achieve production‑grade performance.
The article presents an in‑depth interview with Alibaba Cloud Serverless leader Bu Chen, discussing the evolution, technical challenges, performance requirements, functional needs, and real‑world use cases of Serverless computing, while outlining Alibaba Cloud's vision to make Serverless the essential, user‑centric cloud infrastructure.
This article explains why SQL performance is critical for fast‑response web services, presents database‑agnostic optimization techniques—such as preferring EXISTS over IN, using JOINs, avoiding unnecessary ORDER BY, leveraging UNION ALL, and applying indexes—to dramatically reduce query latency and resource consumption.
This article describes a real‑world requirement to import over 2 billion records into MySQL, analyzes the challenges, introduces XeLabs TokuDB with its optimizations, details the test schema and configuration, demonstrates bulk loading commands, presents performance metrics showing up to 570 k rows per second, and concludes with practical recommendations and environment details.
This article presents an interview scenario where a candidate is asked about Redis cache avalanche, explains the phenomenon, and offers four practical mitigation strategies—including cache pre‑warming, mutex locking, staggered expiration, and high‑availability designs—to keep backend databases from being overwhelmed.
This article examines the source‑code implementations of Java HashMap and C# Dictionary, explaining their data structures, initialization, insertion, resizing, treeification, and deletion mechanisms, and compares their design choices to highlight performance and memory trade‑offs.
After replacing its three‑year‑old Arm.js stack with a Vue.js + Node.js architecture, iQIYI’s smart‑cloud video platform tackled loading, rendering, and API bottlenecks by using CDN‑served library DLLs, refined Webpack splitChunks, lazy‑loaded components with skeleton screens, and rewrote the BFF in NestJS, cutting bundle size by two‑thirds, reducing first‑page load to 790 ms and halving core API latency.
By integrating SIMD‑accelerated ISA‑L and parallel Zstandard (Pzstd) into Meituan’s build‑and‑deployment pipeline, compression time for typical 200 MiB–1 GiB packages dropped from over a minute to about one second—a 90%‑plus speedup that preserves gzip compatibility while dramatically accelerating overall build latency.
This article compiles 52 practical SQL performance‑tuning strategies—including index best practices, query rewrites, use of temporary tables, proper data types, and server configuration tips—to help developers dramatically speed up MySQL and other relational database queries while avoiding common pitfalls.
This article walks backend developers through the challenges of implementing a multi‑criteria search interface, demonstrates three progressive solutions—from a monolithic SQL query to indexed sub‑queries and finally a Redis‑based caching strategy—while addressing performance, pagination, and data‑update concerns.
This article shares a senior architect’s ten‑year journey with caching, covering local page and object caches, refresh policies, distributed solutions like Redis and Memcached, pagination caching techniques, multi‑level cache architectures, common pitfalls, and practical optimization lessons for high‑performance backend systems.
This article compiles 52 practical SQL optimization strategies—including index usage, query rewriting, avoiding full table scans, proper data types, and server configuration tips—to help developers dramatically improve query speed and overall database performance.
