Memory Optimization

Tencent Docs Tech Team

May 29, 2025 · Operations

Memory Optimization Strategies for the Tencent Docs Desktop Client

This technical report details the background, proposed solutions, implementation steps, and measurable results of a series of memory‑saving optimizations applied to the Tencent Docs desktop application built with Electron, including container merging, tombstone mechanisms, Windows EmptyWorkingSet API, and Chromium page‑freezing techniques.

Desktop ApplicationElectronMemory Optimization

0 likes · 9 min read

Memory Optimization Strategies for the Tencent Docs Desktop Client

Code Mala Tang

May 17, 2025 · Backend Development

How Lazy Imports Can Slash Python Startup Time by 80%

Learn how Python's eager import mechanism can cause slow startup in large projects and discover practical lazy import techniques—including function-level imports, custom LazyLoader classes, context manager approaches, and standard library solutions—that dramatically reduce launch time and memory usage while maintaining IDE support.

Memory OptimizationPerformancePython

0 likes · 11 min read

How Lazy Imports Can Slash Python Startup Time by 80%

360 Zhihui Cloud Developer

Apr 27, 2025 · Databases

Why MySQL Memory Stays High and How to Optimize It

This article explains MySQL's memory architecture, why memory usage often stays high after spikes, and provides practical steps—including connection checks, slow query analysis, workload scaling, and switching to jemalloc—to diagnose and reduce memory consumption on 360's internal cloud platform.

Connection ManagementDatabase PerformanceMemory Optimization

0 likes · 7 min read

Why MySQL Memory Stays High and How to Optimize It

macrozheng

Apr 7, 2025 · Big Data

How to Deduplicate 4 Billion QQ Numbers Using a Bitmap Under 1 GB

This article explains how to efficiently remove duplicates from 4 billion QQ numbers within a 1 GB memory limit by replacing the naïve HashSet approach with a memory‑saving Bitmap data structure, complete with calculations, algorithm steps, Java code, and a discussion of its pros and cons.

Big DataBitmapJava

0 likes · 9 min read

How to Deduplicate 4 Billion QQ Numbers Using a Bitmap Under 1 GB

php中文网 Courses

Mar 27, 2025 · Fundamentals

Understanding Python List Comprehensions and Generator Expressions

This article explores Python's list comprehensions and generator expressions, detailing their syntax, performance characteristics, memory usage, multi‑level nesting, and practical tips such as dictionary/set comprehensions and integration with functional programming, helping developers choose the appropriate tool for efficient data processing.

Data ProcessingMemory OptimizationPerformance

0 likes · 6 min read

Understanding Python List Comprehensions and Generator Expressions

Lobster Programming

Mar 21, 2025 · Databases

How to Count Website Visits Efficiently with Redis: Hash, Bitmap, and HyperLogLog

This article explains three Redis-based methods—Hash, Bitmap, and HyperLogLog—for tracking website user visits, detailing how each structure works, their implementation steps, memory and accuracy trade‑offs, and guidance on choosing the best approach for different traffic scenarios.

BitmapDatabase PerformanceHyperLogLog

0 likes · 6 min read

How to Count Website Visits Efficiently with Redis: Hash, Bitmap, and HyperLogLog

php中文网 Courses

Mar 12, 2025 · Backend Development

Using PHP Generator Functions to Create Infinite Iterable Objects for Large Data Processing

This article explains how PHP generator functions, introduced in PHP 5.5 and optimized in PHP 7, can be used to create infinite iterable objects such as a Fibonacci sequence, enabling efficient processing of large data sets by yielding values on demand and reducing memory consumption.

Generator FunctionsLarge Data ProcessingMemory Optimization

0 likes · 5 min read

Using PHP Generator Functions to Create Infinite Iterable Objects for Large Data Processing

php中文网 Courses

Mar 5, 2025 · Backend Development

Using PHP Generator Functions to Create Infinite Iterable Objects for Large Data Processing

The article explains how PHP generator functions can create infinite iterable objects, such as a Fibonacci sequence, to process large data sets efficiently by yielding values on demand, reducing memory usage and improving performance, with practical code examples and discussion of advantages and use cases.

GeneratorMemory Optimizationlarge-data

0 likes · 5 min read

Cognitive Technology Team

Mar 1, 2025 · Databases

Understanding and Mitigating Redis Large‑Key Issues

The article explains what constitutes a Redis large key, outlines its performance and stability risks, describes common scenarios and root causes, and provides practical detection commands, mitigation techniques such as splitting, compression, proper data modeling, and monitoring strategies to prevent future issues.

Memory OptimizationMonitoringPerformance

0 likes · 6 min read

Understanding and Mitigating Redis Large‑Key Issues

DataFunSummit

Feb 2, 2025 · Artificial Intelligence

BladeDISC++: A Dynamic‑Shape AI Compiler for Memory‑Peak Optimization in Deep Learning Training

The article introduces BladeDISC++, a dynamic‑shape AI compiler from Alibaba Cloud PAI, explains the memory‑peak challenges of dynamic‑shape deep‑learning workloads, describes its symbolic‑shape graph, joint compile‑time/runtime optimizations such as operation fusion, scheduling and just‑in‑time rematerialization, and presents Llama2 experiments showing significant GPU memory savings and throughput gains.

AI CompilerBladeDISC++Dynamic Shape

0 likes · 15 min read

BladeDISC++: A Dynamic‑Shape AI Compiler for Memory‑Peak Optimization in Deep Learning Training

php中文网 Courses

Jan 24, 2025 · Backend Development

Using PHP Generator Functions to Create Infinite Iterable Objects

This article explains PHP generator functions introduced in PHP 5.5 and enhanced in PHP 7, demonstrating how to implement infinite iterable objects such as a Fibonacci sequence, and discusses their advantages for processing large data sets, memory efficiency, and typical use cases like log handling and pagination.

GeneratorLarge Data ProcessingMemory Optimization

0 likes · 5 min read

Using PHP Generator Functions to Create Infinite Iterable Objects

php中文网 Courses

Jan 20, 2025 · Backend Development

PHP Memory Optimization Techniques

This article presents a comprehensive guide to PHP memory optimization, covering strategies such as using unset() to free variables, processing data in chunks, manual garbage collection, monitoring usage, optimizing loops, generators, lazy class loading, database tuning, profiling tools, serialization practices, Opcache, session handling, large file processing, and Composer dependency management.

Best PracticesCodeGC

0 likes · 9 min read

DataFunSummit

Dec 28, 2024 · Artificial Intelligence

Memory Optimization for Large Model Inference: Virtual Tensor and LayerKV Techniques

This talk presents the Ant Group team's recent work on large‑model inference memory optimization, covering GPU memory challenges, virtual memory management (VMM), the Virtual Tensor framework, LayerKV techniques, performance comparisons with Page Attention and FlashAttention, and extensive experimental results demonstrating reduced latency and higher QPS.

GPUMemory OptimizationPerformance

0 likes · 25 min read

Memory Optimization for Large Model Inference: Virtual Tensor and LayerKV Techniques

vivo Internet Technology

Dec 11, 2024 · Databases

RocksDB Memory Usage Analysis and Optimization: Troubleshooting Excessive Memory Consumption in Production

The article examines a production RocksDB memory‑usage problem where two instances consumed 59 GB on a 32‑CPU, 64‑GB server, identifies glibc ptmalloc’s unreclaimed free memory as the main cause, and shows that switching to jemalloc cuts usage by roughly 25 % while improving I/O and CPU efficiency.

Database PerformanceLinux Memory ManagementMemory Optimization

0 likes · 11 min read

RocksDB Memory Usage Analysis and Optimization: Troubleshooting Excessive Memory Consumption in Production

Python Programming Learning Circle

Nov 23, 2024 · Fundamentals

Useful Python Tricks and Advanced Techniques

This article presents a collection of lesser‑known Python tricks—including string cleaning with translate, iterator slicing via itertools.islice, skipping header lines, keyword‑only functions, custom context managers, memory‑saving __slots__, resource limits, import control, and total_ordering—to help developers write cleaner, more efficient code.

Context ManagerMemory OptimizationResource Limits

0 likes · 10 min read

Useful Python Tricks and Advanced Techniques

vivo Internet Technology

Oct 30, 2024 · Fundamentals

vivo's Linux Kernel Innovation at the 19th China Linux Kernel Developer Conference

At the 19th China Linux Kernel Developer Conference, vivo unveiled nine open‑source innovations—including DMA‑BUF DIO for AI model loading, ZHP memory compression, EROFS and f2fs filesystem enhancements, and I/O optimizations—contributing significant performance gains and demonstrating its commitment to Linux kernel advancement worldwide.

DMA-BUFEROFSF2FS

0 likes · 6 min read

vivo's Linux Kernel Innovation at the 19th China Linux Kernel Developer Conference

Architecture Development Notes

Sep 12, 2024 · Fundamentals

Boost Rust Performance with Clone‑On‑Write (COW): When and How to Use It

This article explains Rust's Clone‑On‑Write (COW) feature, showing how it reduces unnecessary memory allocations, detailing its internal enum variants, typical use cases, performance benefits, limitations, and providing practical code examples for function return values and string concatenation.

COWClone on WriteEnum

0 likes · 7 min read

Boost Rust Performance with Clone‑On‑Write (COW): When and How to Use It

360 Smart Cloud

Jul 17, 2024 · Artificial Intelligence

Parallelism and Memory‑Optimization Techniques for Distributed Large‑Scale Transformer Training

This article reviews the principles and practical implementations of data, pipeline, tensor, sequence, and context parallelism together with memory‑saving strategies such as recomputation and ZeRO, and demonstrates how the QLM framework leverages these techniques to accelerate large‑model training and fine‑tuning on multi‑GPU clusters.

GPUMegatron-LMMemory Optimization

0 likes · 18 min read

Parallelism and Memory‑Optimization Techniques for Distributed Large‑Scale Transformer Training

php中文网 Courses

Jun 12, 2024 · Backend Development

Using PHP Generator Functions to Create Infinite Iterable Objects for Large Data Processing

This article explains how PHP generator functions can create infinite iterable objects, demonstrating with a Fibonacci sequence example to efficiently handle large data sets while reducing memory usage and improving performance in backend development.

GeneratorInfinite SequenceMemory Optimization

0 likes · 5 min read

IT Services Circle

May 3, 2024 · Fundamentals

Deep Dive into Java String: Memory Layout, Immutability, and Optimization Techniques

This article explores Java String internals across JDK versions, explaining its memory representation, immutability, substring behavior, and how techniques like StringBuilder, intern(), and shared objects can dramatically reduce memory usage from gigabytes to megabytes in high‑scale applications.

JavaMemory OptimizationPerformance

0 likes · 13 min read

Deep Dive into Java String: Memory Layout, Immutability, and Optimization Techniques