BestHub
Sign in
Tagged articles

Optimization

1054 articles · Page 5 of 11
Data Thinking Notes
Data Thinking Notes
May 10, 2023 · Big Data

Mastering Hive Small File Management: Strategies to Boost Performance

This article explains why tiny Hive files degrade storage and query efficiency, outlines how they are created, and presents practical Spark and Hive configuration techniques—including dynamic partitioning, AQE, Reduce tuning, and automated daily merge jobs—to effectively consolidate small files and improve overall data‑warehouse performance.

HiveOptimizationSpark
0 likes · 10 min read
Mastering Hive Small File Management: Strategies to Boost Performance
HomeTech
HomeTech
May 10, 2023 · Frontend Development

Comprehensive Guide to H5 Page Load Performance Optimization

This article details comprehensive strategies for accelerating H5 page load times, covering background analysis, performance metrics, loading strategies, preload/prefetch, DNS prefetch, preconnect, skeleton screens, image compression with WebP, CDN caching, bundle optimization with Vite/Webpack, and provides practical code examples and configuration snippets.

H5OptimizationVite+
0 likes · 15 min read
Comprehensive Guide to H5 Page Load Performance Optimization
DaTaobao Tech
DaTaobao Tech
May 10, 2023 · Mobile Development

Multi-Code Scanning Framework and Optimization for Mobile Apps

The article details how a mobile app’s scanner was re‑engineered from single‑code to multi‑code detection by overhauling the logic pipeline, adding UI overlays, implementing a rotation‑and‑scale transformation algorithm, integrating iOS Vision alongside the existing SDK, applying confidence filtering, deduplication, edge‑intelligence prediction, and memory‑optimized caching, ultimately boosting recognition rates by over 30 percentage points and reducing miss‑detections.

Barcode ScanningMobile DevelopmentOptimization
0 likes · 11 min read
Multi-Code Scanning Framework and Optimization for Mobile Apps
Top Architect
Top Architect
May 9, 2023 · Databases

Performance Testing and Optimization of MySQL Pagination for Large Datasets

This article demonstrates how to generate, insert, and query ten‑million‑row MySQL tables, measures the latency of ordinary LIMIT pagination, analyzes the impact of offset size and result set size, and presents practical optimization techniques such as sub‑query pagination and ID‑range filtering to dramatically improve query speed.

Large DataMySQLOptimization
0 likes · 12 min read
Performance Testing and Optimization of MySQL Pagination for Large Datasets
Java High-Performance Architecture
Java High-Performance Architecture
May 9, 2023 · Databases

How to Efficiently Paginate 10 Million MySQL Records: Real‑World Tests & Optimizations

This article walks through creating a 10‑million‑row MySQL table, measuring pagination query times under different offsets and result sizes, and presents practical optimizations such as sub‑queries, ID‑range filtering, and column selection to dramatically improve performance while explaining why using SELECT * is discouraged.

Large DataMySQLOptimization
0 likes · 11 min read
How to Efficiently Paginate 10 Million MySQL Records: Real‑World Tests & Optimizations
DataFunSummit
DataFunSummit
May 8, 2023 · Fundamentals

Understanding Data Distributions: Normal vs. Power Law in Content Ecosystems

This article explores how data in content ecosystems is distributed, contrasting the classic normal distribution with heavy‑tailed power‑law patterns, explains why power‑law appears frequently, discusses its statistical properties and risks, and presents practical optimization and causal‑inference methods applied to creator incentives and platform strategies.

Data DistributionOptimizationPower Law
0 likes · 20 min read
Understanding Data Distributions: Normal vs. Power Law in Content Ecosystems
MaGe Linux Operations
MaGe Linux Operations
May 5, 2023 · Operations

Boost Your NGINX Performance: 8 Proven Tuning Tips

This guide explains how to optimize NGINX on Linux by adjusting worker processes, connection limits, GZIP compression, timeout values, buffer sizes, log handling, static content caching, and open file caching, providing step‑by‑step commands and configuration snippets for maximum server efficiency.

ConfigurationLinuxNginx
0 likes · 8 min read
Boost Your NGINX Performance: 8 Proven Tuning Tips
DataFunTalk
DataFunTalk
Apr 30, 2023 · Artificial Intelligence

Integrated Multi‑Relation Graph Neural Network (EMR‑GNN)

This article presents a unified optimization framework for graph neural networks, derives an integrated multi‑relation GNN (EMR‑GNN) with a novel message‑passing mechanism, and demonstrates its theoretical advantages and empirical superiority over existing relational GNN models.

EMR-GNNMulti-RelationOptimization
0 likes · 15 min read
Integrated Multi‑Relation Graph Neural Network (EMR‑GNN)
DeWu Technology
DeWu Technology
Apr 28, 2023 · Operations

Analysis of Live Streaming Latency Causes and Optimization Strategies

The article examines why live‑streaming latency—averaging about five seconds on the studied platform versus three seconds on top e‑commerce services—remains high, pinpointing encoder, transcoding, CDN GOP‑cache, and player buffering as key contributors, and proposes optimizations such as shrinking GOP size, minimizing CDN cache tiers, tightening player buffers, and adopting ultra‑low‑latency protocols like RTS, RTM, or QUIC to achieve sub‑second delays.

CDNGOPOptimization
0 likes · 16 min read
Analysis of Live Streaming Latency Causes and Optimization Strategies
Top Architect
Top Architect
Apr 27, 2023 · Backend Development

Optimizing SpringBoot Startup Performance by Reducing Bean Scanning and Monitoring Bean Initialization

This article explains how to diagnose and dramatically reduce SpringBoot application startup time—from several minutes to seconds—by analyzing the SpringApplicationRunListener and BeanPostProcessor phases, limiting component scanning, customizing bean registration, and handling cache auto‑configuration issues, with detailed code examples and performance measurements.

BeanScanningJavaOptimization
0 likes · 20 min read
Optimizing SpringBoot Startup Performance by Reducing Bean Scanning and Monitoring Bean Initialization
Efficient Ops
Efficient Ops
Apr 18, 2023 · Databases

Mastering MongoDB Clusters: Setup, Monitoring, Migration, and Optimization

This comprehensive guide explains MongoDB cluster architecture, component roles, common use cases, monitoring commands, essential maintenance operations, data migration steps, troubleshooting of typical production issues, and practical optimization recommendations for high‑performance deployments.

ClusterMongoDBOptimization
0 likes · 20 min read
Mastering MongoDB Clusters: Setup, Monitoring, Migration, and Optimization
Aotu Lab
Aotu Lab
Apr 13, 2023 · Frontend Development

How to Triple Your Web App’s Speed: A Front‑End Performance Optimization Playbook

This article walks through a comprehensive front‑end performance optimization process—starting from diagnosing issues with Lighthouse, identifying bottlenecks such as large bundle size and uncompressed assets, applying code splitting, lazy loading, image optimization, CSP, SEO tweaks, and finally setting up continuous monitoring with a custom platform—to achieve a 279% improvement in Lighthouse performance scores and near‑three‑fold speed gains.

LighthouseOptimizationSEO
0 likes · 11 min read
How to Triple Your Web App’s Speed: A Front‑End Performance Optimization Playbook
Liangxu Linux
Liangxu Linux
Apr 11, 2023 · Operations

Master Linux Performance Tuning: Practical Steps for Faster Systems

This guide explains why Linux performance depends on both hardware and software, outlines key factors such as CPU, memory, disk I/O, network, OS installation, kernel parameters, file systems, and application design, and provides a step‑by‑step process for administrators, architects, and developers to diagnose and optimize system speed.

HardwareLinuxOptimization
0 likes · 16 min read
Master Linux Performance Tuning: Practical Steps for Faster Systems
Laravel Tech Community
Laravel Tech Community
Apr 5, 2023 · Backend Development

PHP Performance Optimization: String Handling, Statements, Functions, Variables, Arrays and Architecture

This article presents a comprehensive set of PHP performance‑optimization techniques, covering efficient string operations, statement usage, function design, variable handling, array manipulation and architectural choices such as compression, static pages and caching, all illustrated with concrete code examples.

BackendCoding PracticesOptimization
0 likes · 14 min read
PHP Performance Optimization: String Handling, Statements, Functions, Variables, Arrays and Architecture
Bilibili Tech
Bilibili Tech
Apr 4, 2023 · Big Data

How Bilibili’s Flink‑Based Real‑Time Incremental Pipeline Cuts Costs and Boosts Latency

This article details Bilibili’s migration from a Spark‑based offline ODS‑to‑DWD sharding process to a Flink real‑time incremental pipeline, explaining the background challenges, the design of multi‑level partitioning, small‑file optimizations, stability enhancements, and the measurable performance gains achieved.

FlinkIncremental ProcessingOptimization
0 likes · 19 min read
How Bilibili’s Flink‑Based Real‑Time Incremental Pipeline Cuts Costs and Boosts Latency
360 Quality & Efficiency
360 Quality & Efficiency
Mar 24, 2023 · Operations

Performance Testing and Optimization of a Web Application Using JMeter and BlazeMeter

This article details a comprehensive performance testing workflow—including requirement analysis, script recording with BlazeMeter, data construction, iterative optimization, and final results—targeting a web application that must handle over 5,000 TPS with 2 million database records, highlighting bottlenecks in Redis, MySQL, and code logic.

BlazeMeterJMeterMySQL
0 likes · 7 min read
Performance Testing and Optimization of a Web Application Using JMeter and BlazeMeter
Efficient Ops
Efficient Ops
Mar 22, 2023 · Databases

8 Common SQL Pitfalls and How to Optimize Them for Lightning‑Fast Queries

This article reveals frequent SQL mistakes—such as misuse of LIMIT, implicit type conversion, sub‑query updates, mixed ordering, EXISTS, condition push‑down, premature filtering, and intermediate result push‑down—and provides concrete rewrite techniques that dramatically improve MySQL query performance.

MySQLOptimizationPerformance
0 likes · 14 min read
8 Common SQL Pitfalls and How to Optimize Them for Lightning‑Fast Queries
dbaplus Community
dbaplus Community
Mar 14, 2023 · Backend Development

How to Detect and Solve Java Application Performance Bottlenecks: A Practical Guide

This article walks through the evolution of a system’s performance concerns, defines speed and pressure dimensions, explains how to calculate RT, QPS and concurrency, compares QPS with TPS, and provides step‑by‑step methods using tools like Arthas, JMeter and JVM diagnostics to identify and fix CPU, memory and pressure issues before applying layered optimization strategies.

ArthasJMeterJava
0 likes · 12 min read
How to Detect and Solve Java Application Performance Bottlenecks: A Practical Guide
macrozheng
macrozheng
Mar 14, 2023 · Backend Development

Boost Java Performance: 15 Proven Code Optimization Tricks

This article presents a collection of practical Java performance tips, covering visibility reduction, bit‑shift arithmetic, minimizing repeated calculations, avoiding RuntimeException catches, using local variables, lazy loading, proper static access, StringBuilder concatenation, hashCode implementation, collection pre‑sizing, loop object handling, efficient Map traversal, thread‑safe random usage, LongAdder counters, and reflection reduction.

JavaOptimizationPerformance
0 likes · 10 min read
Boost Java Performance: 15 Proven Code Optimization Tricks
DaTaobao Tech
DaTaobao Tech
Mar 13, 2023 · Artificial Intelligence

AI‑Driven 3D Content Creation and Optimization for E‑commerce

The article presents an AI‑driven pipeline that creates, delivers, and optimizes 3D e‑commerce content by leveraging diffusion‑based generation, txt2img/img2img style transfer, Shapley‑value interpretability, and a multi‑level traffic amplification framework to overcome modeling efficiency, asset scarcity, and production cost challenges.

3D contentAI generationOptimization
0 likes · 12 min read
AI‑Driven 3D Content Creation and Optimization for E‑commerce
Model Perspective
Model Perspective
Mar 7, 2023 · Fundamentals

Mastering Nonlinear Programming with Python: Two Practical Optimization Cases

This article introduces nonlinear programming, explains its challenges compared to linear programming, and demonstrates two concrete optimization examples solved with Python's SciPy library using gradient‑descent and SLSQP algorithms, complete with code and result interpretation.

Optimizationgradient descentnonlinear programming
0 likes · 5 min read
Mastering Nonlinear Programming with Python: Two Practical Optimization Cases
Model Perspective
Model Perspective
Mar 6, 2023 · Operations

Master Linear Programming: Theory, Methods, and Python Implementation

Linear programming optimizes a linear objective under linear constraints, and this article explains its theory, common solution methods such as Simplex, Interior‑Point, and Branch‑and‑Bound, illustrates a production‑planning case, and provides a complete Python implementation using SciPy’s linprog function.

Linear ProgrammingOptimizationPython
0 likes · 7 min read
Master Linear Programming: Theory, Methods, and Python Implementation
Programmer DD
Programmer DD
Mar 3, 2023 · Fundamentals

Why Clean Code Can Slow Your C++ Programs by 15× – A Performance Deep Dive

An extensive performance analysis shows that strictly following clean‑code rules—such as using polymorphism, avoiding switch statements, and keeping functions tiny—can dramatically increase execution time, with measured slowdowns up to fifteen times, while alternative table‑driven or flat‑structure approaches achieve orders‑of‑magnitude speed gains.

C++OptimizationPerformance
0 likes · 24 min read
Why Clean Code Can Slow Your C++ Programs by 15× – A Performance Deep Dive
Architect's Guide
Architect's Guide
Mar 3, 2023 · Databases

SQL Optimization: Common Steps, Index Types, and Practical Case Analyses

This article explains how to identify slow SQL statements, analyze execution plans with EXPLAIN, use profiling and optimizer trace, and apply practical solutions such as index optimization, query rewriting, and alternative storage, illustrated with ten real‑world MySQL case studies.

MySQLOptimizationPerformance
0 likes · 11 min read
SQL Optimization: Common Steps, Index Types, and Practical Case Analyses
DataFunTalk
DataFunTalk
Mar 1, 2023 · Databases

Evolution and Optimization of Tencent Music Content Library Data Platform: From Architecture 1.0 to 4.0

This article details the evolution of Tencent Music's content library data platform from version 1.0 to 4.0, describing business requirements, architectural redesigns—including migration from ClickHouse to Apache Doris, introduction of a semantic layer, and extensive write, query, and cost optimizations—while sharing practical lessons and future directions.

Apache DorisFlinkOptimization
0 likes · 21 min read
Evolution and Optimization of Tencent Music Content Library Data Platform: From Architecture 1.0 to 4.0
Model Perspective
Model Perspective
Feb 28, 2023 · Artificial Intelligence

Master Simulated Annealing, Genetic Algorithm, and PSO with Python

Explore three powerful optimization techniques—Simulated Annealing, Genetic Algorithm, and Particle Swarm Optimization—through clear explanations, step-by-step procedures, and complete Python implementations that demonstrate how to find global minima of complex functions in practice and compare their performance.

OptimizationParticle Swarm Optimizationgenetic algorithm
0 likes · 14 min read
Master Simulated Annealing, Genetic Algorithm, and PSO with Python
macrozheng
macrozheng
Feb 28, 2023 · Big Data

How Tencent Music Scaled Its Content Data Platform with Apache Doris: From ClickHouse to 4.0 Architecture

This article details the evolution of Tencent Music's content data platform from version 1.0 to 4.0, describing the migration from ClickHouse to Apache Doris, the introduction of a semantic layer, optimization of data ingestion, query performance, and cost reduction strategies that dramatically improved data timeliness, operational efficiency, and storage costs.

Apache DorisFlinkOptimization
0 likes · 23 min read
How Tencent Music Scaled Its Content Data Platform with Apache Doris: From ClickHouse to 4.0 Architecture
ITPUB
ITPUB
Feb 27, 2023 · Databases

Mastering SQL Joins: Boost Performance When Migrating from Oracle to Open‑Source Databases

This article explains why SQL join execution plans often cause severe performance drops after moving from Oracle to domestic or open‑source databases, demonstrates each join type with PostgreSQL examples, shows how plan choices like HASH JOIN versus NESTED LOOP affect speed, and offers rewrite techniques such as NOT EXISTS or UNION to restore efficiency.

JOINOptimizationOracle
0 likes · 8 min read
Mastering SQL Joins: Boost Performance When Migrating from Oracle to Open‑Source Databases
Sohu Tech Products
Sohu Tech Products
Feb 22, 2023 · Cloud Native

Optimizing Docker Build Time for a BI Project Using Jenkins and Cache Strategies

This article describes how to dramatically reduce Jenkins‑based Docker build times for a BI project by analyzing the build pipeline, enabling Docker layer and application‑level caches, persisting node_modules with BuildKit, and applying minimal configuration changes that cut build duration from over 20 minutes to around four minutes.

CI/CDDockerJenkins
0 likes · 10 min read
Optimizing Docker Build Time for a BI Project Using Jenkins and Cache Strategies
Open Source Linux
Open Source Linux
Feb 20, 2023 · Databases

8 Common SQL Pitfalls and How to Optimize Them for Lightning‑Fast Queries

This article examines eight frequent SQL anti‑patterns—including misuse of LIMIT, implicit type conversion, sub‑query updates, mixed ordering, EXISTS clauses, condition push‑down, premature data reduction, and intermediate result handling—explaining why they degrade performance and providing concrete rewrite strategies and code examples to dramatically speed up queries.

MySQLOptimizationPerformance
0 likes · 14 min read
8 Common SQL Pitfalls and How to Optimize Them for Lightning‑Fast Queries
Huolala Tech
Huolala Tech
Feb 14, 2023 · Frontend Development

When Does a React Component Re‑Render and How to Optimize It?

This article explains what triggers a React component re‑render, distinguishes required from unnecessary renders, and presents practical techniques—such as narrowing render scope, using memo, useMemo, useCallback, and context selectors—to improve performance in complex applications.

HooksOptimizationPerformance
0 likes · 11 min read
When Does a React Component Re‑Render and How to Optimize It?
Model Perspective
Model Perspective
Feb 13, 2023 · Big Data

Optimizing Port Data & Analytics: A Maturity Model for Competitive Edge

This paper presents a comprehensive framework for assessing and enhancing the maturity of data and analytics (D&A) systems in port logistics, combining fuzzy comprehensive evaluation, EWM‑AHP weighting, linear programming, system dynamics, and network analysis to guide strategic investments and improve operational confidence.

Data AnalyticsEWM-AHPMaturity Model
0 likes · 15 min read
Optimizing Port Data & Analytics: A Maturity Model for Competitive Edge
Model Perspective
Model Perspective
Feb 12, 2023 · Artificial Intelligence

AI-Driven Adaptive Grid Model Beats Traditional Gold & Bitcoin Trading Strategies

This article reviews the award‑winning 2022 MCM/ICM C‑problem papers that develop and compare adaptive grid, ARIMA, LSTM, Prophet, and XGBoost‑based models for daily gold and Bitcoin trading, analyzing profitability, risk, transaction‑cost sensitivity, and providing evidence of superior strategy performance.

Optimizationquantitative financetrading strategy
0 likes · 28 min read
AI-Driven Adaptive Grid Model Beats Traditional Gold & Bitcoin Trading Strategies
Model Perspective
Model Perspective
Feb 11, 2023 · Operations

How to Optimize Colorado River Water & Power Distribution for Five States

This article presents a comprehensive multi‑model study of water and hydro‑electric power allocation among Arizona, California, Wyoming, New Mexico, and Colorado, detailing background, negotiation constraints, mathematical formulations, optimization results, sensitivity analyses, and policy recommendations for sustainable resource management.

Colorado RiverOptimizationResource Allocation
0 likes · 22 min read
How to Optimize Colorado River Water & Power Distribution for Five States
ByteFE
ByteFE
Feb 6, 2023 · Frontend Development

Front‑End Performance Optimization: Key Metrics and Practical Techniques to Reduce First Paint and Improve Interactivity

This article explains essential front‑end performance metrics such as FP, FCP, LCP, TTI, FID, TBT and CLS, and provides a comprehensive set of network, code, CSS, image, and build‑time optimization techniques—including gzip, HTTP/2, lazy loading, SSR, debouncing, and tree‑shaking—to dramatically shorten white‑screen time and improve user experience on H5 pages.

OptimizationWebmetrics
0 likes · 18 min read
Front‑End Performance Optimization: Key Metrics and Practical Techniques to Reduce First Paint and Improve Interactivity
DataFunSummit
DataFunSummit
Feb 2, 2023 · Artificial Intelligence

Exploring Super Automation in JD Supply Chain: Architecture, Applications, and Future Outlook

This article presents JD's super automation approach for its supply chain, detailing the business background, challenges, AI‑driven forecasting, procurement, intelligent allocation, inventory clearing, integrated decision making, and future directions toward fully automated, optimal end‑to‑end operations.

JD.comOptimizationSupply Chain
0 likes · 17 min read
Exploring Super Automation in JD Supply Chain: Architecture, Applications, and Future Outlook
dbaplus Community
dbaplus Community
Feb 1, 2023 · Backend Development

Mastering Software Performance: 6 Core Techniques to Trade Time and Space

This article explains how software performance optimization is fundamentally a trade‑off between time and space, introduces six universal techniques—indexing, compression, caching, prefetching, peak‑shaving, and batch processing—covers their principles, common data structures, practical usage patterns, and the associated drawbacks, and finally offers guidance on choosing the right approach.

OptimizationPerformance
0 likes · 40 min read
Mastering Software Performance: 6 Core Techniques to Trade Time and Space
DataFunSummit
DataFunSummit
Jan 31, 2023 · Big Data

Data-Driven Production and Operations Management Decision-Making

This presentation explores how enterprises can transform massive operational data into precise decisions by applying statistical, machine‑learning, and optimization techniques across four topics: data‑to‑decision pipelines, promotion analysis metrics, long‑tail product pricing, and fast‑yet‑accurate unmanned‑warehouse management.

Optimizationdata-drivenmachine learning
0 likes · 13 min read
Data-Driven Production and Operations Management Decision-Making
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jan 16, 2023 · Operations

Low‑Latency Video Streaming Optimizations for Douyin During the World Cup

This article details the end‑to‑end low‑latency video streaming architecture, measurement methods, and optimization techniques—including FLV‑2s, RTM, MiniSDP, buffer‑driven speed‑up, and CDN strategies—that Douyin's Volcano Engine video cloud employed to achieve sub‑2‑second latency and high QoE for World Cup live broadcasts.

FLVOptimizationQoE
0 likes · 21 min read
Low‑Latency Video Streaming Optimizations for Douyin During the World Cup
Model Perspective
Model Perspective
Jan 2, 2023 · Operations

How to Linearize Non‑Linear Optimization Problems: Practical Techniques

This article presents a collection of practical techniques for transforming seemingly non‑linear optimization models—such as those with max/min operators, absolute values, fractional objectives, binary products, and special constraints—into equivalent linear programming formulations, enabling the use of mature LP solvers.

Linear ProgrammingOptimizationmodel linearization
0 likes · 6 min read
How to Linearize Non‑Linear Optimization Problems: Practical Techniques
ITPUB
ITPUB
Jan 2, 2023 · Databases

Choosing the Right OLAP Engine: Druid vs ClickHouse and Optimization Tips

This article introduces OLAP concepts, compares major OLAP engines such as Druid, Kylin, Doris, and ClickHouse, outlines real‑world application scenarios, and provides detailed optimization techniques—including materialized views, caching, tiered storage, and skip‑index configurations—to improve query performance.

AnalyticsClickHouseDruid
0 likes · 16 min read
Choosing the Right OLAP Engine: Druid vs ClickHouse and Optimization Tips
Aikesheng Open Source Community
Aikesheng Open Source Community
Dec 31, 2022 · Databases

Understanding ClickHouse Performance: Storage Engine and Compute Engine Perspectives

This article explains why ClickHouse delivers high query speed by detailing storage‑engine optimizations such as pre‑sorting, columnar layout and compression, and compute‑engine techniques like vectorized execution, built‑in functions and minimal join usage, while also promoting the related book and giveaway.

ClickHouseOLAPOptimization
0 likes · 9 min read
Understanding ClickHouse Performance: Storage Engine and Compute Engine Perspectives
DeWu Technology
DeWu Technology
Dec 28, 2022 · Frontend Development

Frontend Performance Optimization for SCM Application

By shrinking HTML to under 14 KB, replacing large global packages with selective imports, introducing dynamic and lazy loading, externalizing stable libraries via CDN, and caching menu data, the SCM frontend’s common bundle dropped from 1.4 MB to below 200 KB, dramatically improving first‑paint rates and overall page‑load performance.

OptimizationSCMVue
0 likes · 11 min read
Frontend Performance Optimization for SCM Application
Tencent Advertising Technology
Tencent Advertising Technology
Dec 27, 2022 · Big Data

Design and Optimization of Tencent Advertising Log Data Lake Using Iceberg, Spark, and Flink

The article details how Tencent Advertising re‑architected its massive log pipeline by consolidating heterogeneous real‑time and offline logs into an Iceberg‑based data lake, introducing multi‑level partitioning, Spark and Flink ingestion, and numerous performance and cost optimizations for scalable big‑data analytics.

Data LakeFlinkLog Processing
0 likes · 20 min read
Design and Optimization of Tencent Advertising Log Data Lake Using Iceberg, Spark, and Flink
Model Perspective
Model Perspective
Dec 25, 2022 · Operations

How Quantum Particle Swarm Optimizes Cold-Chain Logistics Networks

Using a nonlinear mixed-integer programming model and a quantum-behaved particle swarm optimization algorithm, this study designs and solves the cold-chain logistics network for fresh agricultural products, determining optimal locations for pre-cooling stations and distribution centers while minimizing construction and transportation costs.

OptimizationSupply Chaincold chain logistics
0 likes · 14 min read
How Quantum Particle Swarm Optimizes Cold-Chain Logistics Networks
Programmer DD
Programmer DD
Dec 23, 2022 · Backend Development

Unlock High Performance: 6 Proven Techniques to Supercharge Your Software

This article presents six practical performance‑optimization methods—indexing, compression, caching, prefetching, peak‑shaving, and batch processing—explains their principles, trade‑offs, and real‑world applications, and then dives into four advanced strategies for scaling and parallelism, all illustrated with memorable analogies.

CompressionOptimizationPerformance
0 likes · 36 min read
Unlock High Performance: 6 Proven Techniques to Supercharge Your Software
Zhuanzhuan Tech
Zhuanzhuan Tech
Dec 21, 2022 · Big Data

OLAP Technology Overview, Selection, and Optimization Practices

This article introduces OLAP concepts, compares ROLAP, MOLAP, and HOLAP, evaluates mainstream OLAP engines such as Druid, Kylin, Doris, and ClickHouse, and presents practical optimization techniques including materialized views, caching, tiered storage, and query tuning for large‑scale analytical workloads.

ClickHouseDruidOLAP
0 likes · 17 min read
OLAP Technology Overview, Selection, and Optimization Practices
Model Perspective
Model Perspective
Dec 17, 2022 · Fundamentals

Can Mathematical Modeling Optimize Food Storage? Exploring the Problem

A personal anecdote about receiving assorted frozen and fresh foods leads to a request for mathematical modeling approaches to efficiently organize limited refrigerator space, posing questions about problem formulation, model design, validation, and broader applicability.

Optimizationfood storagelogistics
0 likes · 2 min read
Can Mathematical Modeling Optimize Food Storage? Exploring the Problem
FunTester
FunTester
Dec 14, 2022 · Backend Development

Using async-profiler to Optimize CPU Usage in a Dynamic QPS Test Case

The article details how the author used async-profiler to analyze a Java dynamic QPS test case, identified a CPU hotspot in a time‑checking method, replaced it with a timestamp check, and achieved a modest 0.1% reduction in overall CPU usage, illustrated with flame‑graph images and code snippets.

CPU profilingJava performanceOptimization
0 likes · 12 min read
Using async-profiler to Optimize CPU Usage in a Dynamic QPS Test Case
Java Backend Technology
Java Backend Technology
Dec 12, 2022 · Backend Development

Does Java Reflection Really Slow Down Your Apps? A Deep Performance Test

Through systematic benchmarks comparing direct method calls, field access, and reflective invocations in Java, this article reveals that reflection can significantly degrade performance, especially beyond 100 calls, and identifies the underlying costs of getMethod, getDeclaredField, invoke, and set operations.

JavaOptimizationReflection
0 likes · 10 min read
Does Java Reflection Really Slow Down Your Apps? A Deep Performance Test
ITPUB
ITPUB
Dec 10, 2022 · Backend Development

Unlock Kafka’s Speed: Deep Dive into Performance Optimizations

This article explores Kafka's performance secrets by examining network, disk, and algorithmic factors, detailing sequential writes, zero‑copy techniques, page‑cache usage, Reactor‑based networking, batching, compression, partition concurrency, and file‑structure optimizations, and provides practical guidance for high‑throughput deployments.

OptimizationPerformanceReactor Model
0 likes · 18 min read
Unlock Kafka’s Speed: Deep Dive into Performance Optimizations
Model Perspective
Model Perspective
Dec 9, 2022 · Fundamentals

How the Golden Ratio Optimizes Milk Carton Design for Cost Savings

This article explores how mathematical modeling and the golden ratio can be applied to optimize the length‑width‑height proportions of a fixed‑volume milk carton, minimizing surface area and packaging cost while revealing the harmonious geometry behind its design.

Optimizationgeometrygolden ratio
0 likes · 3 min read
How the Golden Ratio Optimizes Milk Carton Design for Cost Savings
Sohu Tech Products
Sohu Tech Products
Dec 7, 2022 · Databases

How to Diagnose and Resolve Redis Performance Issues

This article explains how to identify Redis latency problems, measure baseline performance, monitor slow commands, and address common causes such as network RTT, forked RDB snapshots, transparent huge pages, swap usage, AOF configuration, key expiration bursts, and big keys, providing practical solutions and a checklist for remediation.

OptimizationPerformanceRedis
0 likes · 18 min read
How to Diagnose and Resolve Redis Performance Issues
Top Architect
Top Architect
Nov 26, 2022 · Backend Development

Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing

This article presents a comprehensive guide to performance optimization, covering six fundamental techniques—indexing, compression, caching, prefetching, throttling, and batch processing—along with deeper strategies for focusing, transformation, adaptation, and system-wide planning to maximize throughput while managing trade‑offs.

CompressionOptimizationscalability
0 likes · 38 min read
Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing
Big Data Technology & Architecture
Big Data Technology & Architecture
Nov 22, 2022 · Big Data

Comprehensive Guide to Metadata Management, Data Quality, and Optimization in Big Data Systems

This article provides an in-depth overview of metadata concepts, their technical and business classifications, value in data management, applications such as data profiling and lineage, optimization techniques for compute and storage, lifecycle management, and comprehensive data quality assurance practices within large‑scale big data environments.

Optimizationbig-datadata-quality
0 likes · 38 min read
Comprehensive Guide to Metadata Management, Data Quality, and Optimization in Big Data Systems
21CTO
21CTO
Nov 18, 2022 · Big Data

How to Supercharge Elasticsearch for Billion‑Row Queries: Proven Optimization Techniques

This article details a real‑world case study of optimizing Elasticsearch for massive daily data volumes, covering the underlying Lucene architecture, shard routing, index and search performance tweaks, practical configuration settings, and benchmark results that achieve sub‑second query responses on billions of records.

LuceneOptimizationbig-data
0 likes · 13 min read
How to Supercharge Elasticsearch for Billion‑Row Queries: Proven Optimization Techniques
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Nov 18, 2022 · Frontend Development

Deep Dive into Webpack Core Workflow, Loader/Plugin Execution Order, and Optimization Strategies

This article explores Webpack's core build process—from startup and compilation to module handling and asset emission—clarifies the execution sequence of loaders versus plugins, explains loader chaining mechanics, and discusses practical optimization techniques for improving build speed and bundle size.

Optimizationbuild processloader
0 likes · 11 min read
Deep Dive into Webpack Core Workflow, Loader/Plugin Execution Order, and Optimization Strategies
Su San Talks Tech
Su San Talks Tech
Nov 16, 2022 · Databases

Why count(*) Slows Down MySQL and How to Optimize It

This article explains why MySQL's count(*) can become a performance bottleneck, especially with InnoDB, and presents practical optimization techniques such as Redis caching, second‑level in‑memory caches, parallel execution, reducing unnecessary joins, and using column‑store databases like ClickHouse.

COUNTClickHouseMySQL
0 likes · 10 min read
Why count(*) Slows Down MySQL and How to Optimize It
Su San Talks Tech
Su San Talks Tech
Nov 16, 2022 · Databases

Why count(*) Is Slow in MySQL InnoDB and How to Speed It Up

This article explains why MySQL's count(*) can be slow on InnoDB, compares different count variations, and presents practical optimization techniques such as Redis caching, second‑level caches, multithreading, reducing joins, and using ClickHouse for massive datasets.

COUNTClickHouseInnoDB
0 likes · 12 min read
Why count(*) Is Slow in MySQL InnoDB and How to Speed It Up
Model Perspective
Model Perspective
Nov 15, 2022 · Fundamentals

How Mathematical Models Drive Economic Growth, Banking, and Market Decisions

This article explores how various mathematical models—such as linear, compound interest, annuity, and optimization frameworks—are applied to national economic analysis, banking operations, securities, insurance, consumer pricing, and production management, illustrating their role in forecasting, decision‑making, and improving market competitiveness.

Interest RatesOptimizationeconomics
0 likes · 9 min read
How Mathematical Models Drive Economic Growth, Banking, and Market Decisions
Efficient Ops
Efficient Ops
Nov 15, 2022 · Operations

Master Linux Performance: Key Metrics, Tools, and Optimization Strategies

This comprehensive guide explains Linux performance optimization by defining key metrics such as throughput and latency, interpreting average load, analyzing CPU context switches, memory management, and I/O behavior, and recommending practical tools and techniques—including vmstat, pidstat, perf, and dstat—to identify and resolve bottlenecks.

CPULinuxMemory
0 likes · 45 min read
Master Linux Performance: Key Metrics, Tools, and Optimization Strategies
Model Perspective
Model Perspective
Nov 7, 2022 · Artificial Intelligence

How Genetic Algorithms Mimic Evolution to Solve Complex Optimization Problems

This article introduces genetic algorithms, explains their biological inspiration, outlines key concepts and operators, details the step-by-step optimization process, and demonstrates their application to a traveling‑salesman case with Python code, highlighting encoding, selection, crossover, mutation, and fitness evaluation.

Evolutionary ComputationOptimizationTraveling Salesman
0 likes · 14 min read
How Genetic Algorithms Mimic Evolution to Solve Complex Optimization Problems
Model Perspective
Model Perspective
Nov 7, 2022 · Fundamentals

How Simulated Annealing Mimics Physical Annealing to Find Global Optima

Simulated Annealing, inspired by the physical annealing of solids, uses a Monte‑Carlo based stochastic search that gradually lowers temperature to probabilistically accept worse solutions, enabling it to escape local minima and effectively solve combinatorial optimization problems such as TSP, knapsack, and graph coloring.

Monte CarloOptimizationcombinatorial optimization
0 likes · 5 min read
How Simulated Annealing Mimics Physical Annealing to Find Global Optima
Architecture Digest
Architecture Digest
Nov 7, 2022 · Backend Development

Comprehensive Guide to Software Performance Optimization: Indexing, Compression, Caching, Prefetching, Throttling, and Batch Processing

This article presents a thorough, multi‑part exploration of software performance optimization techniques—including indexing, compression, caching, prefetching, peak‑shaving, and batch processing—explaining their principles, trade‑offs, practical applications, and how they relate to hardware constraints and system design.

Batch ProcessingCompressionOptimization
0 likes · 36 min read
Comprehensive Guide to Software Performance Optimization: Indexing, Compression, Caching, Prefetching, Throttling, and Batch Processing
Model Perspective
Model Perspective
Nov 1, 2022 · Fundamentals

Why Mathematical Modeling Is as Crucial as Experiments in Modern Engineering

Mathematical models have become indispensable alongside experiments in engineering, enabling quantitative predictions for material selection, system design, reliability analysis, and complex simulations—from satellite re‑entry to aircraft design—thereby reducing cost, time, and the need for impractical physical testing.

OptimizationSimulationengineering
0 likes · 7 min read
Why Mathematical Modeling Is as Crucial as Experiments in Modern Engineering
ITPUB
ITPUB
Nov 1, 2022 · Databases

Why RocksDB 7.5.3 Beats 6.2.9: Deep Dive into Performance Optimizations

The new RocksDB 7.5.3 release dramatically reduces write‑stall time, lock contention and CPU usage while improving OPS and latency compared with 6.2.9.x, as shown by detailed memtier benchmark tests on a 4‑CPU, 32 GiB VM with NVMe storage.

OptimizationPerformanceRocksDB
0 likes · 11 min read
Why RocksDB 7.5.3 Beats 6.2.9: Deep Dive into Performance Optimizations
DeWu Technology
DeWu Technology
Oct 26, 2022 · Operations

Optimization of Packaging Box Design Using Linear and Genetic Algorithms

By formulating the Aurora Blue box design as an integer programming problem and applying both exact linear methods and a tailored genetic algorithm, the study identified an eight‑to‑fifteen‑type solution that raises packing efficiency by 5.49%, cuts paper use 7.6% and trims shipping cost by 0.06 CNY.

Linear ProgrammingOptimizationPackaging
0 likes · 13 min read
Optimization of Packaging Box Design Using Linear and Genetic Algorithms
Data Thinking Notes
Data Thinking Notes
Oct 24, 2022 · Big Data

How to Diagnose and Fix Spark Data Skew: Practical Optimization Techniques

This article explains the causes of Spark data skew, how to locate skewed tasks using the Web UI, and presents six optimization methods—including increasing shuffle parallelism, filtering abnormal keys, two‑stage aggregation, map‑join, key sampling, and random‑prefix joins—plus a real‑world case study.

Data SkewJOINOptimization
0 likes · 21 min read
How to Diagnose and Fix Spark Data Skew: Practical Optimization Techniques
Top Architect
Top Architect
Oct 22, 2022 · Backend Development

High‑Performance Nginx HTTPS TLS Tuning to Reduce Request Latency by 30%

This article explains why reducing Nginx HTTPS latency is crucial for instant‑search services, describes how TLS handshakes add round‑trips, and provides concrete Nginx configuration tweaks—including enabling HTTP/2, optimizing cipher suites, activating OCSP stapling, adjusting ssl_buffer_size and SSL session cache—that together cut end‑to‑end request latency by roughly 30%.

HTTP/2OptimizationSSL
0 likes · 15 min read
High‑Performance Nginx HTTPS TLS Tuning to Reduce Request Latency by 30%
ByteDance Web Infra
ByteDance Web Infra
Oct 20, 2022 · Frontend Development

Optimizing ByteDance Frontend Monitoring SDK: Size Reduction, Benchmarking, and Real‑World Performance Analysis

This article explains how ByteDance’s frontend monitoring SDK is continuously optimized for bundle size and runtime performance through micro‑ and macro‑level code refactoring, benchmark testing with Benny and Puppeteer, and real‑world analysis using Perfsee Lab, ultimately achieving minimal impact on page load metrics.

OptimizationPuppeteerSDK
0 likes · 18 min read
Optimizing ByteDance Frontend Monitoring SDK: Size Reduction, Benchmarking, and Real‑World Performance Analysis
Model Perspective
Model Perspective
Oct 16, 2022 · Artificial Intelligence

Unlocking the Seagull Optimization Algorithm: Principles, Migration & Attack Mechanics

This article introduces the Seagull Optimization Algorithm (SOA), explains how it mimics seagull migration and attack behaviors to solve optimization problems, details its migration and prey‑attack phases, outlines the step‑by‑step workflow, and provides a full Python implementation with code examples.

OptimizationPythonSeagull Optimization Algorithm
0 likes · 10 min read
Unlocking the Seagull Optimization Algorithm: Principles, Migration & Attack Mechanics
ByteDance Terminal Technology
ByteDance Terminal Technology
Oct 13, 2022 · Frontend Development

Optimizing the Size and Performance of a Frontend Monitoring SDK

This article explains how ByteDance's frontend monitoring SDK was systematically reduced in bundle size and runtime overhead through micro‑optimizations such as avoiding long class names, using functional patterns, minimizing polyfills, splitting files, leveraging Puppeteer‑based benchmarks, and applying requestIdleCallback scheduling to improve user experience on both web and mobile platforms.

OptimizationSDKbenchmark
0 likes · 19 min read
Optimizing the Size and Performance of a Frontend Monitoring SDK
Laravel Tech Community
Laravel Tech Community
Oct 12, 2022 · Databases

MySQL Index Optimization, EXPLAIN Usage, and Common Pitfalls

This article provides a comprehensive guide for MySQL developers on index selection, EXPLAIN interpretation, SQL best‑practice tips, lock handling, online schema changes, slow‑query analysis, and common performance pitfalls, offering practical commands and optimization strategies for large‑scale databases.

EXPLAINOptimizationindex
0 likes · 17 min read
MySQL Index Optimization, EXPLAIN Usage, and Common Pitfalls
Top Architect
Top Architect
Oct 12, 2022 · Databases

SQL Execution Order and Performance Optimization Techniques

This article explains the logical execution order of SQL statements, highlights common performance pitfalls such as inefficient LIMIT usage, implicit type conversion, sub‑query updates, mixed sorting, EXISTS clauses, and demonstrates how to rewrite queries with JOINs, early range reduction, CTEs, and other optimizations to achieve dramatically faster execution times.

MySQLOptimizationSQL
0 likes · 15 min read
SQL Execution Order and Performance Optimization Techniques
Java High-Performance Architecture
Java High-Performance Architecture
Oct 11, 2022 · Operations

How Meituan Optimized Kafka for Massive Scale: Reducing Latency and Managing Clusters

This article details Meituan's real‑world challenges with a 15,000‑node Kafka deployment and explains the application‑layer and system‑layer optimizations—such as disk balancing, migration pipeline acceleration, fetcher isolation, RAID acceleration, cgroup isolation, and an SSD‑based cache—that together dramatically cut read/write latency and simplify large‑scale cluster management.

MeituanOptimizationPerformance
0 likes · 23 min read
How Meituan Optimized Kafka for Massive Scale: Reducing Latency and Managing Clusters
Code Ape Tech Column
Code Ape Tech Column
Oct 11, 2022 · Databases

13 Redis Performance Optimization Rules

This article presents thirteen practical guidelines for optimizing Redis performance, covering command selection, key management, data structures, persistence settings, hardware choices, clustering, and memory fragmentation mitigation to achieve significant speed improvements.

BackendMemoryOptimization
0 likes · 11 min read
13 Redis Performance Optimization Rules
Model Perspective
Model Perspective
Oct 7, 2022 · Artificial Intelligence

Master Gradient Descent: From Intuition to Advanced Variants

This comprehensive guide explains the mathematical foundation, intuitive intuition, algorithmic steps, tuning strategies, and variants of gradient descent, comparing it with other optimization methods and illustrating its use in machine‑learning models such as linear regression.

Linear RegressionOptimizationgradient descent
0 likes · 14 min read
Master Gradient Descent: From Intuition to Advanced Variants
Model Perspective
Model Perspective
Oct 2, 2022 · Artificial Intelligence

Modeling Human Growth with Heuristic Algorithms: Simulated Annealing, GA, PSO

When multivariate functions are hard to solve analytically, heuristic methods such as simulated annealing, genetic algorithms, particle swarm and bee algorithms—drawn from physical and biological processes—can approximate optimal solutions and even simulate complex phenomena like a student’s multidimensional development over time.

Optimizationgenetic algorithmheuristic algorithms
0 likes · 3 min read
Modeling Human Growth with Heuristic Algorithms: Simulated Annealing, GA, PSO
Wukong Talks Architecture
Wukong Talks Architecture
Sep 30, 2022 · Backend Development

Performance Optimization Techniques Illustrated with Naruto Analogies

This article presents ten performance‑optimization techniques—including indexing, compression, caching, prefetching, throttling, batch processing, resource squeezing, horizontal scaling, sharding, and lock‑free designs—explained through Naruto‑themed analogies and practical guidance for backend systems.

OptimizationPerformancecaching
0 likes · 37 min read
Performance Optimization Techniques Illustrated with Naruto Analogies
Python Programming Learning Circle
Python Programming Learning Circle
Sep 29, 2022 · Fundamentals

Python Performance Optimization Tips

This article presents practical Python performance optimization techniques—including using local variables, minimizing function calls, avoiding repeated loop calculations, preferring direct imports, leveraging dictionaries for lookups, iterating over items, employing generator expressions, and pre‑compiling code—to improve speed and reduce resource consumption.

OptimizationPython
0 likes · 6 min read
Python Performance Optimization Tips
Alibaba Terminal Technology
Alibaba Terminal Technology
Sep 27, 2022 · Mobile Development

How to Shrink iOS App Size: Proven Strategies and ROI from Alibaba.com

This article explains why app package size matters for download conversion and uninstall rates, presents business value data, and details a comprehensive set of iOS app slimming techniques—including component, resource, and compilation optimizations, code removal, and anti‑regression mechanisms—along with practical ROI analysis and implementation steps.

App SizeMobile DevelopmentOptimization
0 likes · 26 min read
How to Shrink iOS App Size: Proven Strategies and ROI from Alibaba.com
dbaplus Community
dbaplus Community
Sep 25, 2022 · Databases

How to Speed Up MySQL Deep Pagination on Millions of Rows

This article explains why using LIMIT with large offsets slows MySQL queries, analyzes the execution flow, and presents four practical optimization techniques—including subqueries, INNER JOIN, bookmark (tag‑record) method, and BETWEEN range scans—backed by real‑world performance data and code examples.

B+TreeMySQLOptimization
0 likes · 10 min read
How to Speed Up MySQL Deep Pagination on Millions of Rows
Architect
Architect
Sep 23, 2022 · Databases

Elasticsearch Index and Search Performance Optimization for Billion‑Scale Data

This article presents a comprehensive case study of optimizing Elasticsearch and its underlying Lucene structures to achieve sub‑second query responses on billions of records, covering architecture basics, index design, doc‑values tuning, bulk‑write strategies, and extensive performance testing.

LuceneOptimizationbig-data
0 likes · 12 min read
Elasticsearch Index and Search Performance Optimization for Billion‑Scale Data
Model Perspective
Model Perspective
Sep 22, 2022 · Operations

Optimizing Facility Placement: A Mathematical Model for Customer Allocation

Companies must strategically decide where to locate facilities such as factories, warehouses, or hospitals, and this article presents a mathematical model for the facility location problem that minimizes total distance to customer clusters, incorporating constraints on facility numbers and ensuring each cluster is served by its nearest open facility.

Optimizationcustomer allocationfacility location
0 likes · 4 min read
Optimizing Facility Placement: A Mathematical Model for Customer Allocation
Liangxu Linux
Liangxu Linux
Sep 21, 2022 · Databases

Essential MySQL Performance Tools: mysqltuner.pl, tuning-primer.sh, pt-variable-advisor & pt-query-digest

This guide explains why regular MySQL health checks are crucial and introduces four open‑source performance tools—mysqltuner.pl, tuning-primer.sh, pt‑variable‑advisor, and pt‑query‑digest—detailing how to download, run, and interpret their reports to optimize configuration, detect bottlenecks, and improve security.

MySQLOptimizationPercona
0 likes · 9 min read
Essential MySQL Performance Tools: mysqltuner.pl, tuning-primer.sh, pt-variable-advisor & pt-query-digest
DataFunSummit
DataFunSummit
Sep 17, 2022 · Operations

Decision Intelligence in Manufacturing: In‑Depth Practices and Research Presentations at DataFun Summit 2022

The DataFun Summit 2022 featured a series of expert talks on data‑driven decision intelligence for large‑scale manufacturing networks, covering inventory safety stock optimization, AI‑based production planning, industrial solver applications, and real‑world case studies to help attendees improve supply‑chain efficiency and adopt intelligent manufacturing technologies.

Decision IntelligenceOptimizationSupply Chain
0 likes · 11 min read
Decision Intelligence in Manufacturing: In‑Depth Practices and Research Presentations at DataFun Summit 2022
DataFunTalk
DataFunTalk
Sep 17, 2022 · Big Data

Real-Time Data Warehouse Practices with Hudi at ByteDance

This presentation details ByteDance's real‑time data‑warehouse implementations using Apache Hudi, covering scenario classifications, challenges of traditional offline warehouses, practical solutions for ingestion, upsert, validation, indexing, query optimization, and future plans for extensible indexing and unified batch‑stream processing.

Data LakeHudiOptimization
0 likes · 16 min read
Real-Time Data Warehouse Practices with Hudi at ByteDance
DataFunSummit
DataFunSummit
Sep 16, 2022 · Operations

Decision Intelligence and Operations Optimization in the Automotive Industry: Practices, Challenges, and Lessons Learned

This article explores how decision‑intelligence and operations‑research techniques are applied across the automotive supply chain, detailing the industry’s structure, optimization methods at strategic, planning and execution levels, implementation difficulties, and practical lessons drawn from real‑world projects.

Decision IntelligenceOptimizationSupply Chain
0 likes · 14 min read
Decision Intelligence and Operations Optimization in the Automotive Industry: Practices, Challenges, and Lessons Learned
Architect
Architect
Sep 15, 2022 · Big Data

Meituan's Kafka Optimizations: Challenges, Latency Improvements, and Large‑Scale Cluster Management

This article describes how Meituan's massive Kafka deployment—over 15,000 machines and petabytes of daily traffic—faces scalability challenges such as slow nodes, load imbalance, and resource contention, and details the multi‑layer optimizations applied at the application, system, and cluster‑management levels to reduce read/write latency and improve reliability.

KafkaOptimizationbig-data
0 likes · 22 min read
Meituan's Kafka Optimizations: Challenges, Latency Improvements, and Large‑Scale Cluster Management