BestHub
Sign in
Tagged articles

performance optimization

2019 articles · Page 6 of 21
Senior Tony
Senior Tony
Dec 6, 2024 · Databases

Why MySQL COUNT(*) Can Be Milliseconds Fast: Engine Tricks & Optimization Strategies

This article explains why COUNT(*) on a large InnoDB table can take seconds while MyISAM returns instantly, explores the underlying storage‑engine differences, and presents six practical techniques—including Redis counters, counting tables with transactions or triggers, parallel read threads, secondary indexes, and SHOW TABLE STATUS—to dramatically speed up row counting in MySQL.

COUNTInnoDBMySQL
0 likes · 9 min read
Why MySQL COUNT(*) Can Be Milliseconds Fast: Engine Tricks & Optimization Strategies
JD Tech Talk
JD Tech Talk
Dec 6, 2024 · Frontend Development

Performance Optimization Practices for Taro Mini‑Program: Skyline Rendering Engine and Resource Loading Improvements

During the Double‑11 promotion, our team applied a series of Taro mini‑program performance optimizations—including Skyline rendering engine migration, lazy loading of feed resources, image size reduction, and parallel API requests—to significantly reduce cold‑start, hot‑start, and rendering times, improving overall user experience.

Mini ProgramSkylineTaRO
0 likes · 8 min read
Performance Optimization Practices for Taro Mini‑Program: Skyline Rendering Engine and Resource Loading Improvements
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Dec 5, 2024 · Databases

Key Elasticsearch Performance Tweaks: Cutting Query Latency from 50 ms to Under 1 ms

In a micro‑service that uses Elasticsearch to fetch product listings, a series of targeted optimizations—including shard reduction, segment merging, keyword mapping, request‑cache activation, and PIT‑based sorting—slashed query latency from 50‑60 ms to under 1 ms and boosted throughput to about 50 k queries per second.

ElasticsearchKeyword MappingPIT
0 likes · 11 min read
Key Elasticsearch Performance Tweaks: Cutting Query Latency from 50 ms to Under 1 ms
Programmer1970
Programmer1970
Dec 2, 2024 · Backend Development

Unlock Efficient Search and Storage with Elasticsearch Index Mapping

This article explains Elasticsearch index mapping fundamentals, covering field types such as text, keyword, numeric and date, key index options like analyzer, doc_values, null_value, and multi‑field strategies, and provides concrete code examples and optimization tips for efficient search and storage.

AnalyzersElasticsearchField Types
0 likes · 19 min read
Unlock Efficient Search and Storage with Elasticsearch Index Mapping
StarRocks
StarRocks
Dec 2, 2024 · Big Data

How Paimon Revamps Lakehouse Management and Supercharges Queries with StarRocks

This article details Tongcheng Travel's migration from Hive/Kudu/Hudi to Paimon for lakehouse integration, highlighting a 30% resource reduction, three‑fold write speed gains, significant query acceleration via StarRocks, the end‑to‑end architecture across ODS‑DWD‑DWS‑ADS layers, and future roadmap plans.

Big DataFlinkLakehouse
0 likes · 18 min read
How Paimon Revamps Lakehouse Management and Supercharges Queries with StarRocks
Top Architect
Top Architect
Dec 1, 2024 · Backend Development

Diagnosing Slow Asynchronous Log Printing in Java: From Mapping Overhead to Disruptor and JNI Analysis

This article investigates why a large number of quality‑check mappings cause severe latency in a Java service, traces the slowdown to excessive asynchronous log printing, explains the Disruptor‑based async logger internals, evaluates stack‑trace location handling and JNI overhead, and proposes practical configuration and code‑level fixes.

DisruptorJNIJava
0 likes · 20 min read
Diagnosing Slow Asynchronous Log Printing in Java: From Mapping Overhead to Disruptor and JNI Analysis
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Dec 1, 2024 · Backend Development

Optimizing Million-Row Excel Export with EasyExcel: Design, Implementation, and Performance Tuning

This article presents a comprehensive guide to efficiently exporting millions of rows to Excel using EasyExcel, covering performance bottlenecks, resource consumption, asynchronous processing, thread‑pool design, batch querying, streaming writes, and practical code examples to achieve fast, memory‑friendly report generation.

EasyExcelExcel exportJava
0 likes · 35 min read
Optimizing Million-Row Excel Export with EasyExcel: Design, Implementation, and Performance Tuning
Sohu Tech Products
Sohu Tech Products
Nov 27, 2024 · Frontend Development

Optimizing React Applications with Code Splitting and Dynamic Imports

By using code splitting and dynamic imports, React developers can break large bundles into on‑demand chunks—loading only needed libraries, components, or routes after user actions—thereby shrinking initial download size, speeding up first render, and delivering a more responsive, scalable application.

Code SplittingReActdynamic import
0 likes · 9 min read
Optimizing React Applications with Code Splitting and Dynamic Imports
Python Programming Learning Circle
Python Programming Learning Circle
Nov 21, 2024 · Fundamentals

Python Performance Optimization Techniques: Built‑in Functions, List Comprehensions, Generators, Caching, NumPy, Multiprocessing and More

This article introduces a range of Python performance‑optimization methods—including built‑in functions, list comprehensions, generator expressions, avoiding globals, functools.lru_cache, NumPy, pandas, multiprocessing, Cython, PyPy, and line_profiler—illustrated with clear code examples and a practical image‑processing case study.

built-in functionslist comprehensionmultiprocessing
0 likes · 8 min read
Python Performance Optimization Techniques: Built‑in Functions, List Comprehensions, Generators, Caching, NumPy, Multiprocessing and More
JD Tech Talk
JD Tech Talk
Nov 21, 2024 · Mobile Development

Understanding Android Power Consumption: Fundamentals, Components, and Measurement Tools

This article explains the basic concepts of Android power consumption, the components that contribute to battery drain, the role of power_profile.xml, and various measurement methods such as PowerMonitor, dumpsys batterystats, system power ranking, and Battery Historian, providing practical steps and tools for developers to analyze and optimize app energy usage.

AndroidBattery StatsPower Consumption
0 likes · 11 min read
Understanding Android Power Consumption: Fundamentals, Components, and Measurement Tools
Baidu Geek Talk
Baidu Geek Talk
Nov 20, 2024 · Artificial Intelligence

Boosting ANN Search with GPU: Inside RAFT’s IVF_INT8 Implementation

This article examines how Baidu and NVIDIA leveraged the open‑source RAFT library to build a GPU‑accelerated approximate nearest neighbor (ANN) retrieval system, detailing algorithm choices, offline indexing, online batch processing, performance results, and practical guidelines for deploying ANN on GPUs.

ANNGPUIVF_INT8
0 likes · 20 min read
Boosting ANN Search with GPU: Inside RAFT’s IVF_INT8 Implementation
Tencent Cloud Developer
Tencent Cloud Developer
Nov 19, 2024 · Backend Development

Ten Common Interface Performance Optimization Techniques

Ten practical techniques—early validation, batch queries, asynchronous processing, parallel execution, caching, connection pooling, response compression, message‑queue decoupling, security best practices, and reusable design patterns—collectively reduce latency, boost throughput, and improve scalability of high‑concurrency interfaces.

Asynchronous ProgrammingDesign PatternsGo
0 likes · 29 min read
Ten Common Interface Performance Optimization Techniques
Architecture & Thinking
Architecture & Thinking
Nov 15, 2024 · Databases

How Baidu’s TDE‑ClickHouse Delivers Sub‑Second Analytics on Billion‑Row Datasets

This article explains how Baidu’s TDE‑ClickHouse, as a core engine of the Turing 3.0 ecosystem, overcomes platform fragmentation, quality issues, and usability challenges through the OneData+ development paradigm, multi‑level aggregation, projection, query‑caching, bulk‑load ingestion, and a cloud‑native architecture to achieve sub‑second query response for massive data volumes.

Big DataClickHousecloud-native
0 likes · 22 min read
How Baidu’s TDE‑ClickHouse Delivers Sub‑Second Analytics on Billion‑Row Datasets
Java Tech Enthusiast
Java Tech Enthusiast
Nov 9, 2024 · Databases

Java Connection Pool Optimization with HikariCP

The article examines Java connection pool technologies, comparing Commons Pool 2 with HikariCP and showing through JMH benchmarks that HikariCP delivers up to five‑times higher throughput, while detailing lifecycle management, configuration, eviction strategies, sizing best practices, and real‑world uses such as database, HTTP, and RPC connections.

DatabaseHikariCPJava
0 likes · 12 min read
Java Connection Pool Optimization with HikariCP
dbaplus Community
dbaplus Community
Nov 5, 2024 · Backend Development

How a Two‑Level Cache Boosted High‑Concurrency Performance in a Kubernetes System

The article details how designing a two‑level cache architecture—combining local and distributed caches—dramatically reduced CPU usage, response time, and improved system capacity under high QPS workloads in a Kubernetes‑based container environment, while evaluating trade‑offs of several caching strategies.

Two-level Cachebackend developmentcaching
0 likes · 11 min read
How a Two‑Level Cache Boosted High‑Concurrency Performance in a Kubernetes System
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
Nov 4, 2024 · Big Data

How Apache SeaTunnel Redefines Data Integration for Modern Data Platforms

This article reviews the evolution of data‑integration architectures toward EtLT, explains the core capabilities of Apache SeaTunnel, and details how a Chinese data‑platform vendor applied and extended SeaTunnel to simplify batch and streaming ingestion, unify multi‑engine processing, and reduce development and operational costs.

Apache SeaTunnelBig DataConnector Development
0 likes · 17 min read
How Apache SeaTunnel Redefines Data Integration for Modern Data Platforms
Top Architect
Top Architect
Nov 2, 2024 · Backend Development

Optimizing MyBatis-Plus Batch Insert Performance with rewriteBatchedStatements and Multithreading

This article explains how to dramatically speed up MyBatis-Plus batch inserts by enabling the rewriteBatchedStatements JDBC property, creating custom batch insert/update methods, and applying multithreading, providing code examples, performance test results, and practical recommendations for handling large data synchronizations.

Batch InsertDatabaseJava
0 likes · 15 min read
Optimizing MyBatis-Plus Batch Insert Performance with rewriteBatchedStatements and Multithreading
Architect's Guide
Architect's Guide
Oct 31, 2024 · Databases

Designing an Efficient Pipeline for Importing One Billion Records into MySQL

This article presents a comprehensive engineering guide for importing one billion 1 KB unstructured log records stored in HDFS or S3 into MySQL, covering data sizing, B‑tree limits, batch insertion strategies, storage‑engine choices, sharding, file‑reading techniques, concurrency control, and reliable task coordination using Redis, Redisson, and Zookeeper.

Batch InsertMySQLRedis
0 likes · 17 min read
Designing an Efficient Pipeline for Importing One Billion Records into MySQL
Java Architect Essentials
Java Architect Essentials
Oct 29, 2024 · Backend Development

Optimizing Batch Insert Performance with MyBatis-Plus: Configuration, Custom Methods, and Multithreading

This article explains why MyBatis-Plus's saveBatch() can be slow for large data sets, shows how enabling rewriteBatchedStatements in the JDBC URL dramatically speeds up inserts, and demonstrates custom batch insert/update methods and multithreaded execution to further improve performance, complete with code examples and test results.

Batch InsertDatabaseJava
0 likes · 14 min read
Optimizing Batch Insert Performance with MyBatis-Plus: Configuration, Custom Methods, and Multithreading
dbaplus Community
dbaplus Community
Oct 28, 2024 · Operations

How We Built a Real‑Time Cross‑Platform Troubleshooting System for Live Streaming

The article describes a high‑efficiency, cross‑device real‑time troubleshooting system for live‑streaming services, covering its motivation, key monitoring, unified trace design, component evolution, data processing, storage, and visualization, and demonstrates how these measures dramatically improved issue‑resolution speed and system stability.

ObservabilityReal‑time MonitoringSystem Design
0 likes · 14 min read
How We Built a Real‑Time Cross‑Platform Troubleshooting System for Live Streaming
Architect
Architect
Oct 27, 2024 · Backend Development

How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks

This article details the end‑to‑end architecture and step‑by‑step performance tuning of a high‑traffic lottery platform, covering server‑level rate limiting, application‑level throttling, semaphore usage, user‑behavior detection, caching strategies, database optimizations, and hardware upgrades that together enabled stable handling of millions of daily requests.

Database ScalingSemaphorebackend architecture
0 likes · 15 min read
How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Oct 21, 2024 · Frontend Development

Understanding Vue 3.5 Version Counting and Lazy Update Mechanism

Vue 3.5 introduces version counting and a bidirectional linked‑list to optimize lazy updates, using a globalVersion counter, dep.version tracking, and batch processing to efficiently determine when computed and effect functions need recomputation, reducing memory usage and unnecessary calculations.

Reactive SystemVersion CountingVue
0 likes · 15 min read
Understanding Vue 3.5 Version Counting and Lazy Update Mechanism
Programmer1970
Programmer1970
Oct 20, 2024 · Backend Development

Essential Questions Every Backend Engineer Should Ask

The article presents a comprehensive checklist of critical questions covering API design, system architecture, performance tuning, data consistency, reliability, automation, and advanced features that guide backend developers toward building scalable, secure, and high‑performance services.

API designMonitoringReliability
0 likes · 8 min read
Essential Questions Every Backend Engineer Should Ask
Selected Java Interview Questions
Selected Java Interview Questions
Oct 20, 2024 · Backend Development

Optimizing XML‑to‑MySQL Bulk Import: Reducing Execution Time from 300 s to 4 s with JDBC Batch and Disruptor

This article details how a Java‑based XML‑to‑MySQL import of over 60,000 records was accelerated from 300 seconds to just 4 seconds by enabling JDBC batch processing, configuring rewriteBatchedStatements, and employing a multithreaded Disruptor pipeline for asynchronous writes, while also discussing further tuning options.

DisruptorJavaMySQL
0 likes · 11 min read
Optimizing XML‑to‑MySQL Bulk Import: Reducing Execution Time from 300 s to 4 s with JDBC Batch and Disruptor
JD Tech
JD Tech
Oct 19, 2024 · Mobile Development

HarmonyOS Long List Rendering Solutions: ForEach, LazyForEach, CacheCount, and Component Reuse

This article explains HarmonyOS long‑list rendering techniques, comparing the one‑time ForEach approach with the on‑demand LazyForEach method, and detailing cacheCount and @Reusable component reuse strategies, migration challenges from iOS/Android, ArkTS and C‑API implementations, and performance test results.

HarmonyOSLazyForEachLong List
0 likes · 17 min read
HarmonyOS Long List Rendering Solutions: ForEach, LazyForEach, CacheCount, and Component Reuse
JD Tech
JD Tech
Oct 19, 2024 · Mobile Development

JD Finance HarmonyOS NEXT Migration: Architecture, Challenges, and Practices

This article details JD Finance’s end‑to‑end migration of its financial app to HarmonyOS NEXT, covering the system’s architecture, component selection, cross‑platform strategies, performance optimizations, new OS features, and lessons learned from the trial and official releases.

HarmonyOSJD Financearchitecture
0 likes · 26 min read
JD Finance HarmonyOS NEXT Migration: Architecture, Challenges, and Practices
DaTaobao Tech
DaTaobao Tech
Oct 18, 2024 · Artificial Intelligence

Taobao AI Virtual Try-On: Offline Data Processing and Performance Optimization

Taobao’s AI virtual‑try‑on system pre‑computes fitting results offline, writes them into the Item Center via scalable ScheduleX tasks, optimizes pagination, locking and flow‑control, and thereby processes millions of apparel items in under thirty minutes with 99.9% success and reliable checkpoint‑resume monitoring.

AIBig DataTask Scheduling
0 likes · 16 min read
Taobao AI Virtual Try-On: Offline Data Processing and Performance Optimization
Java Architecture Stack
Java Architecture Stack
Oct 18, 2024 · Big Data

How to Fix Spark OOM Errors: Practical Memory & Performance Tuning

This guide analyzes common Spark Out‑Of‑Memory scenarios—such as massive data volumes, data skew, and improper resource allocation—and provides step‑by‑step configurations, memory‑management tweaks, partitioning strategies, and shuffle optimizations to prevent OOM failures in production.

Big DataMemory TuningOOM
0 likes · 8 min read
How to Fix Spark OOM Errors: Practical Memory & Performance Tuning
Tencent Advertising Technology
Tencent Advertising Technology
Oct 17, 2024 · Artificial Intelligence

Long Sequence Modeling for Advertising Recommendation: TIN, Disentangled Side‑Info TIN, Stacked TIN, and Target‑aware SASRec

This article presents a comprehensive solution for heterogeneous long‑behavior sequence modeling in advertising recommendation, introducing the TIN backbone, Disentangled Side‑Info TIN, Stacked TIN, and Target‑aware SASRec, along with platform‑level optimizations that enable million‑scale sequences while delivering significant online performance gains.

AdvertisingDeep LearningSequence Modeling
0 likes · 15 min read
Long Sequence Modeling for Advertising Recommendation: TIN, Disentangled Side‑Info TIN, Stacked TIN, and Target‑aware SASRec
Su San Talks Tech
Su San Talks Tech
Oct 12, 2024 · Databases

Master MySQL: Essential Database Design and Performance Guidelines

This article compiles comprehensive MySQL best‑practice guidelines covering charset selection, storage engine choice, naming conventions, field design, index optimization, SQL development tips, and operational procedures to improve performance, maintainability, and reliability of database systems.

IndexingMySQLSQL Best Practices
0 likes · 23 min read
Master MySQL: Essential Database Design and Performance Guidelines
JD Tech Talk
JD Tech Talk
Oct 11, 2024 · Backend Development

Transformation of JD Insurance Agent System: Architecture, Challenges, and Solutions

The article details the comprehensive redesign of JD's insurance agent platform, outlining its original limitations, the modular and rule‑engine‑driven architecture, performance and stability improvements, and future directions for automation and intelligent operations to support over 40,000 agents.

Insurance TechnologyModular DesignRule Engine
0 likes · 16 min read
Transformation of JD Insurance Agent System: Architecture, Challenges, and Solutions
JD Cloud Developers
JD Cloud Developers
Oct 11, 2024 · Backend Development

How JD Insurance Rebuilt Its Core System for Scalability and 99.99% Accuracy

This article details JD Insurance's journey from a fragmented, high‑maintenance legacy platform to a modular, rule‑engine‑driven backend architecture that improves performance, flexibility, and reliability, achieving near‑perfect accuracy and supporting over 40,000 agents.

Insurance TechnologyRule EngineSystem Architecture
0 likes · 16 min read
How JD Insurance Rebuilt Its Core System for Scalability and 99.99% Accuracy
BirdNest Tech Talk
BirdNest Tech Talk
Oct 9, 2024 · Fundamentals

Unlocking the Power of Bit Manipulation: Real‑World Uses and Go Tips

This article explains why bit manipulation is a staple technique in computer science, detailing performance gains, state flag encoding, mask operations, data compression, cryptography, image processing, hash structures, binary counting, and algorithm design, with practical Go examples.

GoHashingbit manipulation
0 likes · 3 min read
Unlocking the Power of Bit Manipulation: Real‑World Uses and Go Tips
Alibaba Cloud Observability
Alibaba Cloud Observability
Oct 9, 2024 · Cloud Native

How iLogtail Evolved Over 13 Years to Lead Cloud‑Native Observability

iLogtail, a lightweight log collector, has transformed over 13 years from a simple log‑gathering tool into a full‑stack, cloud‑native observability platform, introducing Go plugins, high‑performance C++ pipelines, SPL processing, modular architecture, and advanced self‑monitoring, reflecting broader trends in data collection technology.

Observabilitylog collectionperformance optimization
0 likes · 22 min read
How iLogtail Evolved Over 13 Years to Lead Cloud‑Native Observability
Architect
Architect
Oct 3, 2024 · Databases

How to Tame Massive MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article walks through evaluating massive MySQL tables, explains why large row counts slow queries, and compares three practical solutions—table partitioning, database sharding, and hot/cold archiving—while highlighting their trade‑offs and offering guidance on selecting the right approach for a given workload.

Hot Cold ArchivingMySQLdatabase partitioning
0 likes · 18 min read
How to Tame Massive MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Architect
Architect
Oct 1, 2024 · Backend Development

How We Engineered a Million‑User Lottery System to Survive Massive Spikes

This article details the end‑to‑end architecture, rate‑limiting strategies, caching layers, database optimizations, and hardware upgrades that enabled a lottery service to handle daily traffic exceeding one million users during peak promotional events.

Database Scalingbackend architecturecaching
0 likes · 15 min read
How We Engineered a Million‑User Lottery System to Survive Massive Spikes
Architect's Guide
Architect's Guide
Oct 1, 2024 · Databases

Efficient Full‑Table Updates in MySQL: Handling Row‑Based Binlog, Deep Pagination, and Batch Processing

The article explains why executing a full‑table UPDATE on large MySQL tables using row‑based binlog can overload replication, discusses the inefficiencies of deep pagination and IN clauses, and presents a batch‑processing strategy that leverages SQL_NO_CACHE and FORCE INDEX to safely and efficiently migrate data.

Full Table UpdateMySQLSQL_NO_CACHE
0 likes · 8 min read
Efficient Full‑Table Updates in MySQL: Handling Row‑Based Binlog, Deep Pagination, and Batch Processing
Su San Talks Tech
Su San Talks Tech
Sep 29, 2024 · Backend Development

5 Proven Optimizations That Supercharged Our Category Tree API Performance

This article walks through five successive performance optimizations—adding Redis caching, scheduling async updates, introducing a Caffeine local cache, enabling Nginx GZip compression, and compressing Redis data—to dramatically reduce the size and latency of a category‑tree API in a SpringBoot application.

CaffeineSpringBootThymeleaf
0 likes · 10 min read
5 Proven Optimizations That Supercharged Our Category Tree API Performance
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 27, 2024 · Backend Development

Master JVM Tuning: Practical Steps, Tools, and Real-World Code Example

This article explains why JVM tuning is essential for performance, outlines a step‑by‑step optimization workflow—including GC monitoring, heap dumps, parameter tuning, and tool usage—provides a concrete Java code example that triggers memory pressure, and shares effective JVM flags to prevent out‑of‑memory errors.

Garbage CollectionJVMJava
0 likes · 7 min read
Master JVM Tuning: Practical Steps, Tools, and Real-World Code Example
Java Backend Technology
Java Backend Technology
Sep 25, 2024 · Databases

How to Safely Update Billion‑Row MySQL Tables Without Overloading Binlog

This article explains why a simple full‑table UPDATE on massive MySQL tables can cripple master‑slave replication, analyzes deep‑pagination inefficiencies, and presents a step‑by‑step batch‑update strategy using NO_CACHE and FORCE INDEX to keep binlog size and buffer‑pool impact under control.

Deep PaginationFull Table UpdateMySQL
0 likes · 9 min read
How to Safely Update Billion‑Row MySQL Tables Without Overloading Binlog
Top Architect
Top Architect
Sep 21, 2024 · Databases

Implementing Pagination and Multi‑Condition Fuzzy Query in Redis

This article explains how to implement pagination, multi‑condition fuzzy search, and their combination using Redis Sorted Sets and Hashes, discusses performance optimizations and expiration strategies, and also contains promotional material for ChatGPT services and a community offering.

DatabaseFuzzy SearchHash
0 likes · 12 min read
Implementing Pagination and Multi‑Condition Fuzzy Query in Redis
JD Tech
JD Tech
Sep 18, 2024 · Frontend Development

Migrating a Webpack Project to Vite: A Golden Circle Approach

This article explains how to apply Simon Sinek's Golden Circle framework to migrate a large‑scale Webpack‑based frontend project to Vite, detailing the motivations, the faster development experience, step‑by‑step migration procedures, configuration adjustments, and the resulting performance improvements.

Build ToolsJavaScriptVite
0 likes · 13 min read
Migrating a Webpack Project to Vite: A Golden Circle Approach
Baobao Algorithm Notes
Baobao Algorithm Notes
Sep 18, 2024 · Artificial Intelligence

Why Training on 1,000 GPUs Is Harder Than You Think—and How to Tame It

Training deep learning models on a thousand GPUs faces steep communication overhead, higher failure probability, and scaling inefficiencies, but by profiling each step, overlapping compute and communication, using gradient bucketing and accumulation, and employing elastic training techniques, practitioners can approach near‑linear performance while mitigating common pitfalls.

Distributed TrainingGPU scalingLarge Models
0 likes · 13 min read
Why Training on 1,000 GPUs Is Harder Than You Think—and How to Tame It
Alibaba Cloud Developer
Alibaba Cloud Developer
Sep 11, 2024 · Backend Development

How a Two‑Level Cache Boosted High‑Concurrency Container Performance

By redesigning the caching layer with a two‑level architecture combining local and distributed caches, the author dramatically reduced CPU usage, lowered response times, and increased system capacity under high QPS workloads, while evaluating trade‑offs of various cache strategies, pre‑warming, refresh mechanisms, and operational considerations.

Two-level Cachecachingdistributed systems
0 likes · 11 min read
How a Two‑Level Cache Boosted High‑Concurrency Container Performance
Java Tech Enthusiast
Java Tech Enthusiast
Sep 3, 2024 · Databases

Implementing Pagination and Multi‑Condition Fuzzy Search in Redis

By leveraging Redis sorted sets for ordered pagination and hash fields with HSCAN for multi‑condition fuzzy matching, the article shows how to build a cached query pipeline that creates temporary ZSets keyed by pattern, supports efficient page retrieval, and uses expirations and refresh strategies to balance freshness and performance.

Fuzzy SearchHashRedis
0 likes · 9 min read
Implementing Pagination and Multi‑Condition Fuzzy Search in Redis
Linux Kernel Journey
Linux Kernel Journey
Sep 2, 2024 · Backend Development

How eBPF Powers Modern Software Network Functions

The article examines why eBPF has become a core building block for cloud‑native network functions, outlines its performance, security and flexibility advantages, discusses technical challenges such as memory constraints and missing SIMD support, and presents the eNetSTL library that mitigates these issues with concrete design details and benchmark results.

eBPFeNetSTLkernel programming
0 likes · 12 min read
How eBPF Powers Modern Software Network Functions
Selected Java Interview Questions
Selected Java Interview Questions
Sep 2, 2024 · Databases

Optimizing Full‑Table Updates in MySQL with Row‑Based Binlog: Strategies and Best Practices

This article explains the challenges of executing full‑table UPDATE statements on large MySQL tables using row‑based binlog replication, analyzes deep pagination issues, and presents a batch‑processing strategy with FORCE INDEX, SQL_NO_CACHE and controlled rate limiting to safely migrate data at scale.

Full Table UpdateMySQLPagination
0 likes · 8 min read
Optimizing Full‑Table Updates in MySQL with Row‑Based Binlog: Strategies and Best Practices
DataFunSummit
DataFunSummit
Aug 29, 2024 · Artificial Intelligence

Intelligent NPC Practices in Tencent Games: Multi‑Modal LLM Solutions and System Optimizations

This article details Tencent Game's end‑to‑end approach to building intelligent NPCs, covering the opportunities brought by AI, the practical implementation of multimodal LLM‑driven dialogue, knowledge‑augmented retrieval, long‑context handling, safety measures, multimodal expression (voice and facial animation), and system‑level performance optimizations for real‑time deployment.

AILLMMultimodal
0 likes · 18 min read
Intelligent NPC Practices in Tencent Games: Multi‑Modal LLM Solutions and System Optimizations
vivo Internet Technology
vivo Internet Technology
Aug 28, 2024 · Backend Development

Time Wheel Algorithm: Evolution, Implementation, and Applications

The article chronicles the time wheel algorithm from its 1997 origins, explains simple, round‑based, and hierarchical wheel designs, compares them to queue timers, details Dubbo’s HashedWheelTimer implementation, and shows how combining the wheel with a delay‑message queue can dramatically improve service scalability and efficiency.

Data StructuresDubbobackend development
0 likes · 20 min read
Time Wheel Algorithm: Evolution, Implementation, and Applications
Baidu Geek Talk
Baidu Geek Talk
Aug 28, 2024 · Artificial Intelligence

How PaddlePaddle 3.0 Simplifies Large‑Model Distributed Training with Automatic Parallelism

This article explains the challenges of scaling large AI models, introduces PaddlePaddle 3.0's four‑dimensional hybrid parallelism and its unified automatic parallel framework, details core concepts such as ProcessMesh and Placements, provides step‑by‑step code examples, and outlines performance‑optimizing strategies like operator fusion and pipeline scheduling.

Distributed TrainingHybrid ParallelLarge Models
0 likes · 17 min read
How PaddlePaddle 3.0 Simplifies Large‑Model Distributed Training with Automatic Parallelism
Linux Kernel Journey
Linux Kernel Journey
Aug 25, 2024 · Fundamentals

Analyzing Linux Memory Management Locks and Key Optimization Cases

The article examines the role of various locks in Linux kernel memory management, explains their APIs and sleeping constraints, presents detailed case studies of lock‑related performance patches—including per‑memcg LRU, mmap_lock IO‑fault path, SPF, PVL, fault‑around, unmap, and rmap lockless optimizations—and summarizes common strategies for reducing lock contention and improving scalability.

LinuxMemory Managementkernel
0 likes · 28 min read
Analyzing Linux Memory Management Locks and Key Optimization Cases
Architect's Guide
Architect's Guide
Aug 18, 2024 · Backend Development

Why HikariCP Is So Fast: An In‑Depth Look at Its Design and Implementation

This article explains the core concepts of connection‑pool technology, details the architectural choices behind HikariCP such as dual HikariPool instances, FastList, custom ConcurrentBag, ThreadLocal caching, and byte‑code generation, and walks through the key source code that makes the pool exceptionally fast.

HikariCPJDBCJava
0 likes · 15 min read
Why HikariCP Is So Fast: An In‑Depth Look at Its Design and Implementation
Programmer DD
Programmer DD
Aug 16, 2024 · Backend Development

How a Hidden Uint Overflow Triggered Massive Traffic Spikes and the Memory‑Leak Mystery I Solved

This article recounts a developer's journey from a fresh graduate to a senior backend engineer, detailing two real‑world incidents—a pseudo‑memory‑leak in a C++ service and a uint overflow that caused traffic bursts—showing the analysis steps, code fixes, and lessons learned for reliable backend development.

C++incident analysismemory leak
0 likes · 19 min read
How a Hidden Uint Overflow Triggered Massive Traffic Spikes and the Memory‑Leak Mystery I Solved
FunTester
FunTester
Aug 15, 2024 · Backend Development

9 Proven Techniques to Supercharge Service Performance

This article outlines nine practical methods—caching, parallelization, batch processing, data compression, lock‑free design, sharding, request avoidance, pooling, and asynchronous handling—demonstrating how each can be applied to backend services to dramatically reduce latency and improve throughput.

AsynchronousBatch ProcessingLock-Free
0 likes · 25 min read
9 Proven Techniques to Supercharge Service Performance
Sohu Tech Products
Sohu Tech Products
Aug 14, 2024 · Frontend Development

Mastering Theme Switching in React with Context API: A Complete Guide

This article explains how to use React's Context API to implement elegant multi‑theme switching, avoid props drilling, manage multiple contexts, and apply memoization techniques to prevent unnecessary re‑renders, improving performance and maintainability.

Context APIReActTheme Switching
0 likes · 11 min read
Mastering Theme Switching in React with Context API: A Complete Guide
DataFunSummit
DataFunSummit
Aug 14, 2024 · Big Data

Solving Typical Issues in Migrating to Spark 3.1: Multiple Catalog, Hive‑SQL to Spark‑SQL Migration, and Performance & Stability Optimizations at Xiaomi

This article shares Xiaomi's experience building a next‑generation one‑stop data development platform on Spark 3.1, covering typical challenges such as Multiple Catalog implementation, Hive‑SQL to Spark‑SQL migration, offline Spark performance and stability optimizations, and future roadmap plans.

Apache SparkBig DataSQL migration
0 likes · 18 min read
Solving Typical Issues in Migrating to Spark 3.1: Multiple Catalog, Hive‑SQL to Spark‑SQL Migration, and Performance & Stability Optimizations at Xiaomi
php Courses
php Courses
Aug 13, 2024 · Backend Development

Using Swoole to Implement Database Connection Pooling in Laravel

This course provides an in‑depth exploration of integrating Swoole with Laravel to create and manage a database connection pool, covering fundamental concepts, integration steps, performance optimization, real‑world case studies, and best practices for both Laravel and Swoole developers.

case studydatabase-connection-poollaravel
0 likes · 3 min read
Using Swoole to Implement Database Connection Pooling in Laravel
Architects' Tech Alliance
Architects' Tech Alliance
Aug 12, 2024 · Industry Insights

How Shanghai Jiao Tong University Built China’s First Campus‑Scale ARM HPC Cluster with Huawei Kunpeng

This article details Shanghai Jiao Tong University's design and deployment of the nation’s first campus‑level high‑performance computing cluster based on Huawei Kunpeng 920 ARM processors, covering background, user challenges, unified storage, network topology, containerized software delivery, and performance validation with LAMMPS and GATK.

ARMHPCInfiniBand
0 likes · 12 min read
How Shanghai Jiao Tong University Built China’s First Campus‑Scale ARM HPC Cluster with Huawei Kunpeng
Top Architect
Top Architect
Aug 12, 2024 · Backend Development

Understanding Nginx Architecture, Modules, Process Model, and Performance Optimization

This article provides a comprehensive overview of Nginx, covering its high‑performance architecture, module types and functions, master‑worker process model, asynchronous non‑blocking I/O mechanisms, FastCGI and PHP‑FPM integration, as well as detailed configuration and optimization techniques for production deployments.

System Architectureperformance optimization
0 likes · 48 min read
Understanding Nginx Architecture, Modules, Process Model, and Performance Optimization
php Courses
php Courses
Aug 12, 2024 · Backend Development

Effective Resource Loading and Autoloading Strategies in PHP

This article explains the concepts of resource loading, preloading, lazy loading, conditional and batch loading in PHP, and provides detailed guidance on using autoloading mechanisms such as __autoload(), spl_autoload_register(), PSR‑4, and Composer to improve performance and maintainability of backend applications.

Autoloadingperformance optimizationresource-loading
0 likes · 16 min read
Effective Resource Loading and Autoloading Strategies in PHP
Volcano Engine Developer Services
Volcano Engine Developer Services
Aug 8, 2024 · Cloud Native

How HTTPDNS Edge Migration Boosted Performance and Cut Costs by 35%

This article details the end‑to‑end migration of ByteDance's HTTPDNS service from a central cloud to edge nodes, covering technical challenges in service placement and traffic scheduling, the edge‑native solutions implemented with visualization models and GTM, and the resulting performance, cost and reliability gains.

HTTPDNSTraffic Schedulingperformance optimization
0 likes · 13 min read
How HTTPDNS Edge Migration Boosted Performance and Cut Costs by 35%
Python Programming Learning Circle
Python Programming Learning Circle
Aug 6, 2024 · Fundamentals

Top 10 Python Performance Optimization Techniques

This article presents ten practical Python performance optimization techniques—including using generators, built‑in libraries, local variables, list comprehensions, efficient string joining, reducing loop work, multithreading/multiprocessing, JIT compilation, and profiling—to help developers write faster, more efficient code.

Code EfficiencyPythonperformance optimization
0 likes · 6 min read
Top 10 Python Performance Optimization Techniques
Wukong Talks Architecture
Wukong Talks Architecture
Aug 6, 2024 · Databases

Migrating Tencent Music's Data Infrastructure from ClickHouse and Druid to StarRocks: Strategy, Implementation, and Best Practices

This article details how Tencent Music’s data‑infrastructure team migrated thousands of ClickHouse and Druid nodes to a StarRocks compute‑storage‑separated lakehouse, achieving 40‑50% cost reduction while maintaining query performance, and shares the technical challenges, solutions, and best‑practice recommendations gathered during the process.

ClickHouseData MigrationDruid
0 likes · 19 min read
Migrating Tencent Music's Data Infrastructure from ClickHouse and Druid to StarRocks: Strategy, Implementation, and Best Practices
Tencent Cloud Developer
Tencent Cloud Developer
Aug 6, 2024 · Backend Development

Nine Common Techniques for Service Performance Optimization

The article outlines nine broadly applicable techniques—caching, parallel and batch processing, data compression, lock‑free design, sharding, eliminating unnecessary requests, and resource pooling—that together can dramatically cut service latency and improve throughput, as demonstrated by an 80% latency reduction in a real‑world project.

Rediscachingconcurrency
0 likes · 28 min read
Nine Common Techniques for Service Performance Optimization
Baidu Geek Talk
Baidu Geek Talk
Aug 5, 2024 · Backend Development

Cache Algorithm Optimization for SSD-Based Advertising Retrieval System

The paper presents SsdEngine, a hierarchical SSD‑based advertising retrieval cache that combines a thread‑local ART cache with a lock‑free central array, uses flying pointer‑swizzling to cut duplicate I/O, and evaluates eviction policies (LRU, DoubleClock, TinyLFU, ARC), showing LRU excels under Zipfian locality while TinyLFU improves small‑cache hit rates.

DoubleClockLRU evictionNVMe SSD
0 likes · 23 min read
Cache Algorithm Optimization for SSD-Based Advertising Retrieval System
Architect
Architect
Aug 1, 2024 · Backend Development

How a Structured Refactor Cut Game Service MQ Calls by Up to 80%

Facing a 600k/min rate‑limit alert on a game’s product‑update MQ, the team analyzed scattered consumers, designed a new Flyweight‑Strategy architecture with Spring AOP idempotency, executed a three‑phase migration, and achieved a 50‑80% reduction in downstream interface calls.

MQ RefactorSpring AOPbackend architecture
0 likes · 12 min read
How a Structured Refactor Cut Game Service MQ Calls by Up to 80%
DeWu Technology
DeWu Technology
Jul 31, 2024 · Big Data

Custom Flink Scheduler Enhancements: Resource Balancing, Task Migration, and TmRestart Strategy

The article details Dewu’s custom Flink scheduler, DwScheduler, which adds JSON‑based resource specifications, per‑TaskManager slot sharing for balanced CPU use, hot TaskManager migration callbacks, and a new TmRestart strategy for rapid pod‑process recovery, offering practical techniques to enhance real‑time stream processing stability and performance.

Apache FlinkStreamingTask Migration
0 likes · 9 min read
Custom Flink Scheduler Enhancements: Resource Balancing, Task Migration, and TmRestart Strategy
Tencent Cloud Developer
Tencent Cloud Developer
Jul 31, 2024 · R&D Management

From Zero to One: Designing and Operating Tencent's Search Platform XSearch

The article recounts Tencent PCG’s journey from concept to a fully managed, customer‑centric search platform XSearch—detailing its evolution as a middle‑platform product, performance‑and‑cost‑optimized architecture, flexible functional design, streamlined R&D and operations processes, comprehensive documentation, and long‑term strategic outlook.

R&D managementSearch Platformoperational efficiency
0 likes · 15 min read
From Zero to One: Designing and Operating Tencent's Search Platform XSearch
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jul 28, 2024 · Frontend Development

Performance Optimization of a Vue2 + ElementUI Cloud Management Platform

This article describes how a legacy Vue2‑based cloud management system was profiled with Lighthouse and webpack‑bundle‑analyzer, then optimized through static asset compression, dead‑code removal, tree‑shaking, code‑splitting, async loading and server tweaks, achieving a three‑fold reduction in bundle size and a 13.6‑second improvement in first‑contentful‑paint time.

Code SplittingLighthouseVue
0 likes · 11 min read
Performance Optimization of a Vue2 + ElementUI Cloud Management Platform
Architects' Tech Alliance
Architects' Tech Alliance
Jul 28, 2024 · Artificial Intelligence

Design and Optimization Practices for Intelligent Computing Platforms in the Era of Large Models

The article examines the new characteristics, challenges, and technical practices of intelligent computing platforms required for large‑model AI workloads, covering infrastructure adaptation, heterogeneous scheduling, application acceleration, operation reliability, and future directions for simplifying GPU usage and connecting heterogeneous resources.

AI platforminfrastructureperformance optimization
0 likes · 6 min read
Design and Optimization Practices for Intelligent Computing Platforms in the Era of Large Models
Sohu Tech Products
Sohu Tech Products
Jul 17, 2024 · Backend Development

Java Thread Pool: Working Mechanism, States, and Rejection Policies

Java thread pools efficiently manage and reuse threads by applying a producer‑consumer model, transitioning through RUNNING, SHUTDOWN, STOP, and TERMINATED states, handling task queues, and employing configurable rejection policies such as Abort, CallerRuns, Discard, and DiscardOldest, while improving performance, resource utilization, and stability across web servers, asynchronous processing, and other concurrent workloads, distinct from connection pools which manage database connections.

JavaJava concurrencyThreadPoolExecutor
0 likes · 12 min read
Java Thread Pool: Working Mechanism, States, and Rejection Policies
Sohu Tech Products
Sohu Tech Products
Jul 17, 2024 · Frontend Development

Optimizing Flutter Web Startup: main.dart.js Splitting, CanvasKit Loading, and Font Loading Optimization

By splitting the main.dart.js bundle with deferred components, serving CanvasKit assets and Google fonts from a private CDN, and optionally using the HTML renderer during development, Flutter Web apps can cut their startup time by five to six seconds, achieving sub‑second load performance.

CDNCanvasKitDeferred Components
0 likes · 19 min read
Optimizing Flutter Web Startup: main.dart.js Splitting, CanvasKit Loading, and Font Loading Optimization
FunTester
FunTester
Jul 17, 2024 · Backend Development

Mastering Backend Caching: Strategies, Types, and Common Pitfalls

This article provides a comprehensive guide to backend caching, covering fundamental concepts, usage scenarios, read‑through and cache‑aside strategies, local and distributed cache types, popular services like Redis and Memcached, eviction algorithms such as FIFO, LRU, LFU, and common issues like consistency, avalanche, penetration, and stampede, along with practical mitigation techniques.

Cache EvictionCache strategiesbackend development
0 likes · 14 min read
Mastering Backend Caching: Strategies, Types, and Common Pitfalls
php Courses
php Courses
Jul 16, 2024 · Backend Development

Implementing a Data Cache Class in PHP for Efficient Web Applications

This article explains how to improve PHP application performance by implementing a data caching class, illustrates a weather‑API example, shows how to set cache duration, avoid duplicate data storage, and discusses production considerations such as concurrency, large data, security, and expiration handling.

Cache ManagementData Cachingperformance optimization
0 likes · 8 min read
Implementing a Data Cache Class in PHP for Efficient Web Applications
Baobao Algorithm Notes
Baobao Algorithm Notes
Jul 11, 2024 · Artificial Intelligence

Why Separate Prefill and Decode? A Deep Dive into DistServe’s Split Inference Architecture

This article explores the two‑stage LLM inference pipeline, introduces TTFT and TPOT metrics, explains the motivation for prefilling‑decoding separation, presents experimental comparisons between split and merged architectures, and details optimization techniques and parallel‑strategy modeling for DistServe.

DistServeGoodputLLM inference
0 likes · 28 min read
Why Separate Prefill and Decode? A Deep Dive into DistServe’s Split Inference Architecture
Top Architect
Top Architect
Jul 10, 2024 · Backend Development

Optimizing a High-Concurrency Interface: Reducing Response Time from 30 s to 0.8 s with SQL Refactoring and Caffeine Caching

This article presents a real‑world case of optimizing a high‑concurrency transaction‑statistics API, detailing diagnosis of a 30‑second latency, SQL refactoring with array_agg and unnest, Java‑level improvements, and Caffeine caching, while also sharing promotional offers for ChatGPT services and a developer community.

CaffeineJavaPostgreSQL
0 likes · 13 min read
Optimizing a High-Concurrency Interface: Reducing Response Time from 30 s to 0.8 s with SQL Refactoring and Caffeine Caching
Top Architect
Top Architect
Jul 5, 2024 · Databases

Efficient Insertion of 300,000 Records Using MyBatis and JDBC

This article demonstrates how to insert 300,000 rows into a MySQL table efficiently by defining a User entity, configuring MyBatis and JDBC, comparing direct batch insertion, row‑by‑row insertion, and optimized batch strategies with configurable batch sizes and wait times, and provides performance results and best‑practice recommendations.

JDBCJavaMyBatis
0 likes · 15 min read
Efficient Insertion of 300,000 Records Using MyBatis and JDBC
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 5, 2024 · Backend Development

Nine High-Performance Optimization Techniques for Large-Scale Backend Architecture

This article presents nine comprehensive performance‑optimization strategies—including load balancing, sharding, read/write separation, caching, indexing, CDN, asynchronous processing, code refinement, and algorithm improvement—aimed at boosting the efficiency and scalability of large‑scale backend systems.

cachingindex optimizationload balancing
0 likes · 7 min read
Nine High-Performance Optimization Techniques for Large-Scale Backend Architecture
DataFunTalk
DataFunTalk
Jun 28, 2024 · Big Data

Accelerating Spark with ClickHouse: Native Optimization Techniques and Performance Evaluation

This article presents a comprehensive technical overview of using ClickHouse as a native backend to accelerate Spark SQL execution, covering Spark performance bottlenecks, ClickHouse's CPU‑level optimizations, the design and implementation of the Spark‑Native integration, and detailed TPC‑DS benchmark results demonstrating up to 3.5× speedup.

Big DataClickHouseSpark
0 likes · 33 min read
Accelerating Spark with ClickHouse: Native Optimization Techniques and Performance Evaluation
TAL Education Technology
TAL Education Technology
Jun 27, 2024 · Cloud Native

Case Study: Integrating the AiFenxi BI Platform with Apache APISIX Gateway for Improved Performance and Stability

This case study details how the AiFenxi business intelligence platform integrated Apache APISIX as a high‑performance API gateway within Tencent Cloud TKE, addressing latency, scalability, and security challenges, and outlines the architectural changes, deployment steps, and resulting performance improvements.

API GatewayAPISIXBI platform
0 likes · 7 min read
Case Study: Integrating the AiFenxi BI Platform with Apache APISIX Gateway for Improved Performance and Stability
Open Source Tech Hub
Open Source Tech Hub
Jun 23, 2024 · Backend Development

Why PHP Climbed to #15 in TIOBE’s June Rankings: Resilience and Future Outlook

The article examines PHP’s rise to the 15th spot in the TIOBE June index, analyzing its deep web roots, mature frameworks, performance gains, vibrant community, and integration with modern technologies like Docker and front‑end frameworks, while also discussing future challenges such as scalability, type safety, and cloud‑native adoption.

CommunityDockerPHP
0 likes · 8 min read
Why PHP Climbed to #15 in TIOBE’s June Rankings: Resilience and Future Outlook
Past Memory Big Data
Past Memory Big Data
Jun 20, 2024 · Big Data

How Meituan Scaled Spark with Vectorized Execution Using Gluten + Velox

This article details Meituan's production‑grade adoption of Spark vectorized execution via the open‑source Gluten and Velox stack, explaining SIMD fundamentals, performance motivations, the end‑to‑end integration workflow, staged rollout, encountered challenges, and the resulting resource savings and speedups.

Big DataGlutenORC
0 likes · 33 min read
How Meituan Scaled Spark with Vectorized Execution Using Gluten + Velox