Skip to content
Tagged articles

memory optimization

253 articles · Page 2 of 3
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
May 15, 2024 · Artificial Intelligence

How Baidu’s AIAK‑LLM Supercharges Large‑Model Training and Inference

The article explains the scaling challenges of ever‑larger LLMs, introduces the MFU performance metric, surveys industry parallelism and memory‑saving techniques, and details Baidu’s AIAK‑LLM suite—including resource, component and acceleration layers—as well as concrete training and inference optimizations that raise MFU by 30‑60% and cut deployment costs.

AI infrastructureMFUParallelism
0 likes · 25 min read
How Baidu’s AIAK‑LLM Supercharges Large‑Model Training and Inference
DeWu Technology
DeWu Technology
Apr 8, 2024 · Operations

Analyzing and Optimizing ZooKeeper WatchManager Memory Usage

By replacing ZooKeeper’s default WatchManager hash‑set tables with concurrent maps and bitmap‑based structures, the authors cut watch‑related heap usage from several gigabytes to under 12 MB, lowered lock contention, and achieved 5‑6× latency gains, delivering up to 91 % memory reduction and ten‑fold SLA improvement in production clusters.

JavaWatchManagerZooKeeper
0 likes · 13 min read
Analyzing and Optimizing ZooKeeper WatchManager Memory Usage
NewBeeNLP
NewBeeNLP
Mar 18, 2024 · Artificial Intelligence

Mastering RAG and LLM Techniques: From Retrieval to Fine‑Tuning

This article provides a comprehensive technical guide on Retrieval‑Augmented Generation (RAG), open‑source large language models such as LLaMA, fine‑tuning methods, evaluation metrics, memory‑optimization tricks, and attention‑related optimizations for modern AI systems.

AttentionLLMLangChain
0 likes · 19 min read
Mastering RAG and LLM Techniques: From Retrieval to Fine‑Tuning
Python Programming Learning Circle
Python Programming Learning Circle
Jan 25, 2024 · Fundamentals

Python Memory Optimization Techniques: __slots__, Generators, mmap, Data Types, and String Interning

This article explains practical Python memory‑saving methods—including inspecting memory usage, using __slots__, generators, memory‑mapped files, choosing efficient data structures, and string interning—providing code examples and performance comparisons to help developers write more memory‑efficient programs.

Data StructuresPythonmemory optimization
0 likes · 11 min read
Python Memory Optimization Techniques: __slots__, Generators, mmap, Data Types, and String Interning
macrozheng
macrozheng
Jan 25, 2024 · Backend Development

How to Slash Spring Boot Memory Usage by Over 40% for Local Development

This guide explains why Spring Boot applications consume memory, shows how to configure the JVM and Tomcat settings, and demonstrates using Docker‑compose to apply these tweaks, enabling developers to reduce local memory usage by more than 40% and speed up development cycles.

JVMSpring Bootconfiguration
0 likes · 7 min read
How to Slash Spring Boot Memory Usage by Over 40% for Local Development
Open Source Linux
Open Source Linux
Jan 24, 2024 · Game Development

How 128KB Made a Classic Game: Secrets of Retro Graphics, Audio, and Code

This article explains how 1980s game developers squeezed full‑screen scrolling, rich music, and extensive gameplay into just 128 KB by using tile‑based graphics, specialized audio chips, and ultra‑compact code, revealing the technical tricks behind classic titles like Contra.

Retro GamingTile Graphicsaudio synthesis
0 likes · 6 min read
How 128KB Made a Classic Game: Secrets of Retro Graphics, Audio, and Code
IT Niuke
IT Niuke
Jan 2, 2024 · Fundamentals

How the Flyweight Pattern Cuts Memory Use in Real‑World Java Services

The article explains the Flyweight design pattern, shows how a surge of 30 KB country objects caused memory pressure in a marketing service, and demonstrates a Java implementation with Flyweight, FlyweightFactory, and related code, while comparing it to Singleton and caching approaches.

Design PatternsJavacaching
0 likes · 8 min read
How the Flyweight Pattern Cuts Memory Use in Real‑World Java Services
Liangxu Linux
Liangxu Linux
Dec 11, 2023 · Fundamentals

How to Squeeze Extra RAM on a Resource‑Constrained Embedded Linux Device

This article examines memory usage on a Junzheng T31ZC embedded Linux board, breaks down physical and kernel allocations, and presents practical techniques—such as trimming kernel symbols, stripping ELF files, optimizing rootfs, and manually dropping caches—to reclaim valuable RAM without adding hardware.

EmbeddedLinuxRootFS
0 likes · 13 min read
How to Squeeze Extra RAM on a Resource‑Constrained Embedded Linux Device
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Nov 2, 2023 · Industry Insights

OPPO’s Kernel Tweaks: Dynamic HugePages and Scheduler Boosts for Smoother ColorOS

At the 18th China Linux Kernel Developer Conference, OPPO unveiled memory and scheduler optimizations—including a dynamic 64 KB huge‑page scheme, LRU reclamation improvements, and a latency‑aware scheduler balance—that collectively raise memory access performance by over 10 %, reduce lock contention, and lower frame‑drop and audio‑stutter rates, demonstrating the impact of programmable kernel technologies on Android smoothness.

Linux kernelMobile OSPerformance Tuning
0 likes · 7 min read
OPPO’s Kernel Tweaks: Dynamic HugePages and Scheduler Boosts for Smoother ColorOS
php Courses
php Courses
Oct 31, 2023 · Backend Development

Using Generators in PHP 7 for Efficient Data Processing

This article explains PHP 7 generators, describing their concept, memory‑saving benefits, and how to implement them with a practical example that reads a large file and yields squared numbers, demonstrating efficient data processing and lazy loading in backend development.

PHPbackend developmentgenerator
0 likes · 5 min read
Using Generators in PHP 7 for Efficient Data Processing
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Sep 22, 2023 · Mobile Development

Advances in Android Memory Optimization and Linux Kernel Techniques Presented at CCF ESTC 2023

At the 2023 CCF ESTC conference, OPPO showcased its 64 KB dynamic large‑page technology that can increase memory‑access bandwidth up to sixteenfold and improve app startup and frame rates, while also co‑hosting a Linux‑kernel forum on scheduler, lock contention, memory defragmentation and hot‑cold page optimization, underscoring the company’s push for industry‑academic collaboration and future OS research.

AndroidDynamic Large PagesOperating Systems
0 likes · 8 min read
Advances in Android Memory Optimization and Linux Kernel Techniques Presented at CCF ESTC 2023
21CTO
21CTO
Sep 21, 2023 · Operations

How Desktop QQ Tamed Memory Bloat: Deep Dive into Electron Optimization

This article details the systematic memory‑usage analysis and multi‑stage optimization performed on the desktop QQ Electron client, covering background challenges, target metrics, tooling, code and resource slimming, rendering layer tuning, Lottie handling, online monitoring, and the resulting stable sub‑300 MB memory footprint.

ElectronQQdesktop application
0 likes · 24 min read
How Desktop QQ Tamed Memory Bloat: Deep Dive into Electron Optimization
Tencent Cloud Developer
Tencent Cloud Developer
Sep 21, 2023 · Frontend Development

Memory Optimization of Desktop QQ: A Stage Summary

To curb Desktop QQ’s excessive Electron memory consumption, the team applied comprehensive profiling, code and resource slimming, thumbnail image generation, visible‑only DOM rendering, layer merging, Lottie animation tuning, API caching, and leak removal, achieving average usage around 228 MB and keeping all six processes below 300 MB with ongoing monitoring.

ElectronQQdesktop application
0 likes · 24 min read
Memory Optimization of Desktop QQ: A Stage Summary
Sohu Tech Products
Sohu Tech Products
Sep 20, 2023 · Mobile Development

Memory Optimization and GPUImage‑Based Gaussian Blur for iOS Live‑Stream Images

The iOS live‑stream app was crashing from out‑of‑memory due to high‑resolution images and CPU‑based Gaussian blur, so the solution reduced download size, skipped downloads during fast scrolling, limited cached blurred images, and switched to GPUImage‑accelerated blur with a custom composite shader, cutting memory use and processing time.

GPUImageGaussian BluriOS
0 likes · 12 min read
Memory Optimization and GPUImage‑Based Gaussian Blur for iOS Live‑Stream Images
Architecture Digest
Architecture Digest
Sep 12, 2023 · Fundamentals

Understanding Java Integer Caching and the == Operator

This article explains how Java caches Integer objects in the range -128 to 127, why the == operator behaves differently for small and large integers, and demonstrates how to inspect and manipulate the cache using reflection.

Integer cachingJavaReference Equality
0 likes · 4 min read
Understanding Java Integer Caching and the == Operator
High Availability Architecture
High Availability Architecture
Aug 30, 2023 · Backend Development

Diagnosing and Optimizing JVM Memory Issues in a Core Service

This article details the identification, analysis, and resolution of JVM memory problems in a core music metadata service, covering GC tuning, large‑object handling, fault‑tolerance strategies, custom Dubbo codec monitoring, and non‑intrusive memory object tracking to improve performance and stability.

DubboGCJVM
0 likes · 14 min read
Diagnosing and Optimizing JVM Memory Issues in a Core Service
政采云技术
政采云技术
Aug 15, 2023 · Databases

Understanding and Handling Redis Bigkey Issues

This article explains what Redis bigkeys are, their impact on performance and memory, how they are generated, methods to detect and analyze them—including built‑in commands, SCAN, memory usage, and RDB file inspection—and practical steps to mitigate their effects.

BigKeyRDB analysisRedis
0 likes · 12 min read
Understanding and Handling Redis Bigkey Issues
ITPUB
ITPUB
Aug 9, 2023 · Operations

Why Is My Elasticsearch Cluster Using 15 GB Heap? A Deep Dive into Memory Bottlenecks

The article examines a 7‑node Elasticsearch cluster with 500 million documents, uncovering excessive heap usage, high OS memory pressure, numerous deleted documents, large translog, low query‑cache hit rate, and an over‑sharded design, then offers concrete tuning and redesign recommendations to restore performance.

Cluster OperationsElasticsearchheap usage
0 likes · 16 min read
Why Is My Elasticsearch Cluster Using 15 GB Heap? A Deep Dive into Memory Bottlenecks
dbaplus Community
dbaplus Community
Aug 1, 2023 · Operations

Why Is My Elasticsearch Cluster Consuming 15 GB Heap? A Deep Dive into Memory, Sharding, and Performance Bottlenecks

A 7‑node Elasticsearch cluster handling 500 million documents shows excessive heap usage, many deleted documents, high translog size, saturated OS memory, and inefficient sharding, prompting a detailed analysis of stats, root‑cause identification, and concrete recommendations for mapping, shard design, and JVM tuning.

Cluster MonitoringIndexingJVM
0 likes · 16 min read
Why Is My Elasticsearch Cluster Consuming 15 GB Heap? A Deep Dive into Memory, Sharding, and Performance Bottlenecks
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Jul 17, 2023 · Artificial Intelligence

How MindSpore’s Auto Parallel Tech Simplifies Large-Model Training

During a livestream titled “Solving the ‘Development Difficulty’ of Large Models with MindSpore Auto Parallel”, Huawei’s MindSpore experts explained how the framework’s distributed training techniques—including data, model, and pipeline parallelism as well as memory‑saving strategies—enable efficient pre‑training of trillion‑parameter models across diverse AI domains.

Data ParallelMindSporeModel Parallel
0 likes · 6 min read
How MindSpore’s Auto Parallel Tech Simplifies Large-Model Training
Programmer DD
Programmer DD
Jul 15, 2023 · Operations

Why Is My Elasticsearch Cluster Using 99% Memory? Sharding, Translog & JVM Insights

This article analyzes a 7‑node Elasticsearch cluster with 500 million documents, revealing excessive shard count, high heap and OS memory usage, large translog, low query‑cache hit rate, and heavy I/O, and offers concrete recommendations on mapping, sharding, JVM tuning, and resource management to restore performance.

Cluster MonitoringElasticsearchJVM
0 likes · 17 min read
Why Is My Elasticsearch Cluster Using 99% Memory? Sharding, Translog & JVM Insights
Python Programming Learning Circle
Python Programming Learning Circle
Jun 27, 2023 · Fundamentals

Useful Python Tricks: String Cleaning, Iterator Slicing, Keyword‑Only Arguments, Context Managers, __slots__, Resource Limits, __all__, and Total Ordering

This article presents a collection of lesser‑known Python tricks—including string normalization, iterator slicing, keyword‑only functions, custom context managers, memory‑saving __slots__, CPU/memory limits, import control with __all__, and simplified ordering with total_ordering—to help developers write cleaner and more efficient code.

Pythoncontext manageriterator
0 likes · 10 min read
Useful Python Tricks: String Cleaning, Iterator Slicing, Keyword‑Only Arguments, Context Managers, __slots__, Resource Limits, __all__, and Total Ordering
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jun 16, 2023 · Fundamentals

The Semantics of nil in Swift

The article explains that Swift’s nil differs from Objective‑C’s null pointer by representing ‘no value’ for any type through optionals, details how various optionals (Bool?, String?, class?, enum?) are encoded in memory, shows the extra byte cost for Int?, and advises minimizing optional Int fields in structs, using 0 when appropriate.

EnumSWIFTStruct
0 likes · 6 min read
The Semantics of nil in Swift
Tencent Cloud Developer
Tencent Cloud Developer
May 31, 2023 · Cloud Computing

TencentOS "Wujing": Server Memory Multi-Level Offloading Solution for Cloud Data Centers

TencentOS “Wujing” provides a server‑memory multi‑level offloading framework that uses kernel‑side reclamation, heat‑aware page classification, SWAP balancing, and CXL promotion to shift cold pages to cheaper storage, cutting data‑center memory use by up to 50 % while preserving performance.

DAMONLinux kernelMemory Tiering
0 likes · 14 min read
TencentOS "Wujing": Server Memory Multi-Level Offloading Solution for Cloud Data Centers
DataFunSummit
DataFunSummit
Apr 11, 2023 · Artificial Intelligence

OneFlow Coop: Joint Optimization of Dynamic‑Graph Recomputation and Memory Allocation

This article introduces OneFlow Coop, a memory‑optimization technique that jointly optimizes dynamic‑graph recomputation strategies and GPU memory allocation by analyzing existing DTR limitations, proposing recomputable in‑place, op‑guided tensor allocation, and layout‑aware eviction modules, and demonstrating superior experimental results.

Deep LearningDynamic GraphGPU memory
0 likes · 18 min read
OneFlow Coop: Joint Optimization of Dynamic‑Graph Recomputation and Memory Allocation
Python Programming Learning Circle
Python Programming Learning Circle
Apr 7, 2023 · Fundamentals

Lesser‑Known Python Tricks and Techniques

This article introduces a collection of lesser‑known Python tricks—including string cleaning with translate, iterator slicing via itertools, skipping header lines, keyword‑only functions, custom context managers, memory‑saving __slots__, resource limits, import control with __all__, and total_ordering—to help developers write cleaner, more efficient code.

code snippetscontext manageritertools
0 likes · 10 min read
Lesser‑Known Python Tricks and Techniques
21CTO
21CTO
Mar 31, 2023 · Backend Development

Boost Go Performance: 6 Proven Techniques for Faster, Leaner Apps

This article presents six practical Go performance optimizations—including GOMAXPROCS tuning for Kubernetes, struct field ordering, garbage‑collection limits, zero‑copy unsafe conversions, jsoniter usage, and sync.Pool pooling—that together can dramatically lower CPU, memory, and latency in production services.

Garbage CollectionGoKubernetes
0 likes · 9 min read
Boost Go Performance: 6 Proven Techniques for Faster, Leaner Apps
Tencent Cloud Developer
Tencent Cloud Developer
Mar 22, 2023 · Artificial Intelligence

How AngelPTM Cuts Large Model Training Costs with ZeRO-Cache Optimizations

This article analyzes Tencent's AngelPTM framework, detailing its ZeRO-Cache strategy, unified storage management, multi‑stream async execution, SSD tiered storage, and performance benchmarks that show up to 95% larger model capacity and over 44% speedup compared to community solutions.

AI infrastructureGPU accelerationZeRO-Cache
0 likes · 12 min read
How AngelPTM Cuts Large Model Training Costs with ZeRO-Cache Optimizations
Tencent Advertising Technology
Tencent Advertising Technology
Mar 10, 2023 · Artificial Intelligence

Optimizing Large-Scale Model Training with Tencent's AngelPTM and ZeRO-Cache

This article presents Tencent's latest advancements in large‑scale model training, detailing the AngelPTM framework and its ZeRO‑Cache optimization techniques that reduce memory and storage costs, improve hardware utilization, and achieve high‑performance training for trillion‑parameter AI models across various applications.

AI modelsAngelPTMZeRO-Cache
0 likes · 14 min read
Optimizing Large-Scale Model Training with Tencent's AngelPTM and ZeRO-Cache
Ctrip Technology
Ctrip Technology
Mar 9, 2023 · Backend Development

Optimizing Hotel Query Service Memory Usage: GC Tuning, Native Memory Management, and Migration to jemalloc

This article details the systematic reduction of memory consumption for Ctrip's hotel query service by halving container memory, evaluating and tuning modern garbage collectors, diagnosing off‑heap leaks, and ultimately replacing the default ptmalloc allocator with jemalloc to achieve stable performance and lower resource costs.

Backend PerformanceContainerizationGarbage Collection
0 likes · 22 min read
Optimizing Hotel Query Service Memory Usage: GC Tuning, Native Memory Management, and Migration to jemalloc
NiuNiu MaTe
NiuNiu MaTe
Mar 9, 2023 · Databases

Understanding Redis Ziplist and Listpack: Memory‑Efficient List Implementations

This article explains Redis's compressed list structures—ZIPLIST and its successor LISTPACK—detailing their layouts, encoding schemes, query and update complexities, and how LISTPACK resolves ZIPLIST's chain‑update performance issues to provide a more memory‑efficient list implementation.

Data StructuresListpackRedis
0 likes · 10 min read
Understanding Redis Ziplist and Listpack: Memory‑Efficient List Implementations
Tencent Database Technology
Tencent Database Technology
Jan 31, 2023 · Databases

Common MySQL OOM Scenarios and TDSQL‑C Memory Optimization Strategies

This article examines typical MySQL out‑of‑memory (OOM) situations in production, explains how to diagnose memory usage with Performance Schema and other tools, and presents a series of TDSQL‑C‑specific optimization techniques—including server‑parameter tuning, process‑list monitoring, cold‑page detection, buffer‑pool limits, and dynamic resizing—to mitigate OOM risks.

Database PerformanceOOMTDSQL-C
0 likes · 12 min read
Common MySQL OOM Scenarios and TDSQL‑C Memory Optimization Strategies
ByteDance SYS Tech
ByteDance SYS Tech
Jan 13, 2023 · Fundamentals

How HVO Cuts HugeTLB Memory Overhead by Up to 99% in Linux Kernels

This article, based on ByteDance STE’s 2022 Linux Kernel Developer Conference talk, explains the HVO (HugeTLB vmemmap Optimization) feature that dramatically reduces struct page memory for huge pages, details its latest enhancements, cross‑architecture support, usage steps, performance trade‑offs, and future plans.

HVOHugeTLBLinux kernel
0 likes · 13 min read
How HVO Cuts HugeTLB Memory Overhead by Up to 99% in Linux Kernels
Meituan Technology Team
Meituan Technology Team
Nov 10, 2022 · Big Data

Optimizing Spark mapPartitions: Memory Management and Best Practices

The article details how Meituan’s Turing machine‑learning platform cut offline resource use by 80% and task time by 63% through memory‑level techniques such as column pruning, adaptive caching, and a deep dive into Spark’s mapPartitions operator, including source‑code analysis, GC behavior, and a low‑memory batch‑iterator best practice.

Performance TuningSparkbig data
0 likes · 19 min read
Optimizing Spark mapPartitions: Memory Management and Best Practices
Java Architect Essentials
Java Architect Essentials
Oct 31, 2022 · Big Data

How to Process 10 GB of Age Data on a 4 GB Machine Using Java

This article walks through generating a 10 GB file of age values, reading it line‑by‑line on a 4 GB RAM, 2‑core machine, measuring single‑thread performance, then redesigning the pipeline with a producer‑consumer model, blocking queues and multithreaded string splitting to dramatically boost CPU utilization and cut processing time while managing memory consumption.

File ProcessingJavaMultithreading
0 likes · 12 min read
How to Process 10 GB of Age Data on a 4 GB Machine Using Java
Bilibili Tech
Bilibili Tech
Oct 4, 2022 · Operations

How to Optimize AMD Milan Server Performance: BIOS, Memory, and Power Tuning

This article provides a detailed, data‑driven guide to evaluating and tuning AMD Milan‑based servers, covering SPEC CPU benchmarking, BIOS options such as SMT and Boost, memory channel and NUMA configurations, interleaving, IOMMU, and power‑state settings to achieve up to 30% performance gains.

AMD MilanBIOS tuningSPEC CPU
0 likes · 27 min read
How to Optimize AMD Milan Server Performance: BIOS, Memory, and Power Tuning
NetEase LeiHuo Testing Center
NetEase LeiHuo Testing Center
Sep 23, 2022 · Game Development

Memory Optimization Techniques for Mobile Games

This article explains mobile game memory optimization, covering RAM vs ROM, resource memory reduction for textures, models, animations, streaming load, unused resource unloading, and detecting memory leaks, while providing practical QA testing methods to ensure performance without compromising visual quality.

Mobile GamesQA TestingUnity
0 likes · 20 min read
Memory Optimization Techniques for Mobile Games
ITPUB
ITPUB
Sep 18, 2022 · Databases

Master Redis Memory: 7 Proven Techniques to Store More Data with Less RAM

This article explains how Redis stores key‑value pairs, details the internal data structures such as dict, dictEntry and redisObject, and provides practical memory‑saving tricks—including key shortening, encoding choices, object sharing, bitmap usage, hash consolidation, fragmentation handling, and 32‑bit deployment—to dramatically reduce RAM consumption while maintaining performance.

CacheData StructuresPerformance Tuning
0 likes · 19 min read
Master Redis Memory: 7 Proven Techniques to Store More Data with Less RAM
Java Captain
Java Captain
Sep 10, 2022 · Backend Development

Designing a Scalable Backend for One Billion Users with Minimal Resources

The article outlines how a modest cluster of 20 virtual machines with 16 GB RAM each can handle 1 billion user records and 20 million hourly queries by using simple in‑memory arrays, basic indexing, modest bandwidth, and straightforward failover mechanisms, without requiring advanced technologies.

Distributed Systemsmemory optimization
0 likes · 7 min read
Designing a Scalable Backend for One Billion Users with Minimal Resources
Shepherd Advanced Notes
Shepherd Advanced Notes
Aug 18, 2022 · Databases

Is Redis Really Single‑Threaded? Exploring Redis 6.0 Multithreading and Bottlenecks

The article explains why Redis has traditionally been single‑threaded, details the new IO‑thread multithreading model introduced in Redis 6.0, walks through its four processing stages, lists essential INFO monitoring commands, examines memory overhead of strings versus hashes, compares List and Sorted Set ordering, and identifies five key performance‑blocking points.

Blocking operationsINFO commandIO threads
0 likes · 17 min read
Is Redis Really Single‑Threaded? Exploring Redis 6.0 Multithreading and Bottlenecks
ITPUB
ITPUB
Jul 20, 2022 · Databases

Master Redis Memory: 7 Proven Techniques to Store More Data with Less RAM

This article explains how Redis stores key‑value pairs, dives into the underlying dict, dictEntry and redisObject structures, and presents seven practical memory‑saving tricks—including key shortening, encoding tweaks, object sharing, bitmap usage, hash consolidation, fragmentation cleanup, and 32‑bit deployment—to dramatically reduce RAM consumption while preserving performance.

BitmapData StructuresHash
0 likes · 19 min read
Master Redis Memory: 7 Proven Techniques to Store More Data with Less RAM
ITPUB
ITPUB
Jul 12, 2022 · Databases

Inside Redis: Ziplist, Skiplist, Quicklist & Stream – Memory & Performance Secrets

This article explains Redis's low‑level data structures—including ziplist, skiplist, intset, quicklist, zipmap and stream—detailing their memory layouts, implementation code, use‑case selection criteria, performance trade‑offs, and configurable parameters that balance speed and space.

Data StructuresRedismemory optimization
0 likes · 26 min read
Inside Redis: Ziplist, Skiplist, Quicklist & Stream – Memory & Performance Secrets
HelloTech
HelloTech
Jul 11, 2022 · Databases

Redis Internal Data Structures: Ziplist, Skiplist, Intset, Quicklist, Zipmap, and Stream

The article explains Redis’s internal low‑level structures—ziplist, skiplist, intset, quicklist, zipmap, and stream—detailing their memory‑efficient layouts, operations, use cases, and how they combine (e.g., quicklist merging linked lists with ziplists) to deliver high performance in the in‑memory database.

Data StructuresQuicklistRedis
0 likes · 27 min read
Redis Internal Data Structures: Ziplist, Skiplist, Intset, Quicklist, Zipmap, and Stream
Su San Talks Tech
Su San Talks Tech
Jul 6, 2022 · Databases

Master Redis Memory: 7 Proven Techniques to Store More Data with Less RAM

This article explains Redis's internal storage mechanisms and presents seven practical optimization techniques—including key‑value compression, small‑collection encoding, object sharing, bitmap usage, hash structuring, memory‑fragment defragmentation, and 32‑bit deployment—to dramatically reduce memory consumption while increasing data capacity.

CacheData StructuresPerformance Tuning
0 likes · 21 min read
Master Redis Memory: 7 Proven Techniques to Store More Data with Less RAM
Selected Java Interview Questions
Selected Java Interview Questions
Jul 2, 2022 · Backend Development

Understanding Java String Constant Pool and the Behavior of String.intern() Across JDK Versions

This article explains the Java constant pool concept, details how the String constant pool works in different JDK versions, demonstrates the effects of String.intern() with code examples, and discusses practical applications and pitfalls of using intern for memory optimization and synchronization.

Constant PoolJVMString.intern
0 likes · 16 min read
Understanding Java String Constant Pool and the Behavior of String.intern() Across JDK Versions
ITPUB
ITPUB
Jun 3, 2022 · Backend Development

Unlocking Redis Speed: A Deep Dive into Its Core Data Structures

This article explains why Redis is ultra‑fast by exploring its in‑memory design and the nine fundamental data structures—SDS, linked lists, ziplist, hash tables, skiplist, intset, quicklist, and listpack—that power keys, values, and internal objects, complete with code examples and version‑specific changes.

Data StructuresHash TableRedis
0 likes · 45 min read
Unlocking Redis Speed: A Deep Dive into Its Core Data Structures
Ctrip Technology
Ctrip Technology
May 26, 2022 · Backend Development

Memory Structure Selection and Optimization for Hotel Query Service

This article examines how Ctrip's hotel query service selects and optimizes in‑memory cache structures—covering Java object layout, HashMap overhead, alternative collections, and various encoding techniques—to achieve high‑performance reads and updates while drastically reducing memory consumption.

CacheHashMapJava
0 likes · 23 min read
Memory Structure Selection and Optimization for Hotel Query Service
Programmer DD
Programmer DD
Apr 19, 2022 · Backend Development

Why Java 8 Switched String Storage to byte[] and How It Saves Memory

The article explains how Java 8 changed the internal representation of String from a char[] to a byte[] to reduce memory consumption, the role of Latin‑1 encoding, the impact on garbage collection, and why UTF‑16 remains the practical choice for Java strings.

JavaStringUTF-16
0 likes · 8 min read
Why Java 8 Switched String Storage to byte[] and How It Saves Memory
vivo Internet Technology
vivo Internet Technology
Apr 13, 2022 · Databases

Redis Integer Set Optimization for Game Recommendation Deduplication: RoaringBitMap vs intset vs Bloom Filter

For deduplicating game recommendations in Redis, RoaringBitMap outperforms intset and Bloom filters by storing 300 auto‑incrementing game IDs in roughly 0.5 KB—over twice the compression of intset and far smaller than the 29 KB Bloom filter—thereby cutting memory use, latency, and hardware costs.

Bloom filterData Structure OptimizationRedis
0 likes · 9 min read
Redis Integer Set Optimization for Game Recommendation Deduplication: RoaringBitMap vs intset vs Bloom Filter
IT Services Circle
IT Services Circle
Apr 12, 2022 · Big Data

Finding Missing Unsigned Integers in a 4‑Billion‑Element File Using Interval Counting and Bitmap Technique

The article explains how to locate all missing 32‑bit unsigned integers in a 4 billion‑entry file by first partitioning the range into intervals, counting entries per interval with a tiny int[64] array, and then applying a bitmap method only to under‑filled intervals, achieving a memory footprint of just a few hundred bytes.

AlgorithmBitmapbig data
0 likes · 5 min read
Finding Missing Unsigned Integers in a 4‑Billion‑Element File Using Interval Counting and Bitmap Technique
Java Captain
Java Captain
Mar 1, 2022 · Fundamentals

Understanding Java Integer Caching and the == Operator

This article explains why comparing Integer objects with == yields false for large values but true for small values due to Java's internal IntegerCache, demonstrates the caching mechanism with code examples, and shows how reflection can manipulate the cache, highlighting memory optimization considerations.

Integer cachingJavaReference Equality
0 likes · 4 min read
Understanding Java Integer Caching and the == Operator
macrozheng
macrozheng
Jan 28, 2022 · Backend Development

What’s Coming in Java 2022? Inside the Valhalla Project’s Value Classes

The article explains the upcoming Java Valhalla project, detailing how value objects, primitive classes, and specialized generics will reshape the JVM’s type system, reduce memory overhead, and introduce new value‑class semantics for more efficient Java programming.

JVMJavaValhalla
0 likes · 8 min read
What’s Coming in Java 2022? Inside the Valhalla Project’s Value Classes
Kuaishou Tech
Kuaishou Tech
Jan 11, 2022 · Mobile Development

Texture Compression Technique for Mobile Effects: Removing Hollow Areas to Reduce Memory Usage

This article presents a texture compression method that eliminates hollow (alpha‑zero) regions by reorganizing textures into macro‑blocks, storing index maps for reconstruction, and demonstrates significant memory savings and unchanged visual quality on mobile devices, even after video encoding.

Texture CompressionVideo Effectsmemory optimization
0 likes · 8 min read
Texture Compression Technique for Mobile Effects: Removing Hollow Areas to Reduce Memory Usage
Python Crawling & Data Mining
Python Crawling & Data Mining
Dec 13, 2021 · Big Data

How to De‑duplicate 4 Billion QQ Numbers with Only 1 GB RAM

This article explains several algorithmic strategies—including sorting, hash maps, file splitting, and bitmap techniques—to remove duplicates from a file containing 4 billion QQ numbers while staying within a 1 GB memory limit, and it provides extension exercises for sorting, median, top‑K, and duplicate detection.

AlgorithmBitmapbig data
0 likes · 8 min read
How to De‑duplicate 4 Billion QQ Numbers with Only 1 GB RAM
Sohu Tech Products
Sohu Tech Products
Oct 6, 2021 · Mobile Development

Android Memory Optimization: Causes, Tools, Image Strategies, and Online OOM Monitoring with KOOM

This article explains why Android memory optimization is needed, introduces background concepts such as garbage collection and memory leaks, reviews common tools like Memory Profiler, MAT and LeakCanary, details image‑related memory reduction techniques, and presents the open‑source KOOM framework for online OOM detection and analysis.

AndroidKOOMLeakCanary
0 likes · 23 min read
Android Memory Optimization: Causes, Tools, Image Strategies, and Online OOM Monitoring with KOOM
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Sep 27, 2021 · Databases

Redis Usage Best Practices and Guidelines

This article presents comprehensive Redis usage standards—including key naming conventions, avoiding big keys, efficient serialization, safe command usage, data persistence strategies, and operational recommendations—to ensure high performance, memory efficiency, and reliable service under heavy traffic.

Best PracticesCache ManagementCommand Guidelines
0 likes · 11 min read
Redis Usage Best Practices and Guidelines
Java Interview Crash Guide
Java Interview Crash Guide
Sep 8, 2021 · Backend Development

How to Scale Redis for Billions of Keys: Memory‑Efficient Strategies

This article explores the challenges of storing billions of mapping records for a DMP in Redis and presents practical solutions such as eviction policies, key bucketing, hash‑map optimization, fragmentation reduction, and specialized memory allocators to achieve millisecond‑level real‑time queries.

HashMapJavaKey Bucketing
0 likes · 11 min read
How to Scale Redis for Billions of Keys: Memory‑Efficient Strategies
Tencent Music Tech Team
Tencent Music Tech Team
Aug 20, 2021 · Mobile Development

How to Slash Flutter App Memory Usage: Practical Image Optimization Strategies

This article details concrete techniques for reducing Flutter app memory consumption, focusing on image cache sizing, resource cropping, local caching, asset compression, cache thresholds, and page‑stack management, while providing step‑by‑step experiments, code snippets, and visual illustrations to guide developers.

FlutterMobile Developmentimage caching
0 likes · 9 min read
How to Slash Flutter App Memory Usage: Practical Image Optimization Strategies
MaGe Linux Operations
MaGe Linux Operations
Aug 15, 2021 · Fundamentals

Cut Pandas DataFrame Memory Usage by 90% with Simple Type Conversions

This tutorial shows how to dramatically reduce pandas DataFrame memory consumption—by up to 90%—by inspecting internal storage, downcasting numeric columns, converting object columns to categoricals, and specifying optimal dtypes while reading CSV data, all demonstrated on a large MLB game logs dataset.

PandasType Conversioncategorical
0 likes · 18 min read
Cut Pandas DataFrame Memory Usage by 90% with Simple Type Conversions
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 12, 2021 · Backend Development

How to Compress Large Java int/long Arrays for Massive Memory Savings

This article explains how to reduce memory usage of massive Java int/long arrays by applying real‑time compression, eliminating redundancy, using indexed buckets, offset storage, and a series of low‑level optimizations that boost TPS from dozens to over a thousand while preserving random‑access capabilities.

Data Compressionarraymemory optimization
0 likes · 14 min read
How to Compress Large Java int/long Arrays for Massive Memory Savings
Amap Tech
Amap Tech
Jun 4, 2021 · Artificial Intelligence

Deploying Multiple CNN Models on Low‑End Devices with MNN: Memory Tricks and Error Debugging

This article explains how a high‑traffic map service captures road features using client‑side computer‑vision models, details the deployment of many CNNs with the lightweight MNN engine on memory‑constrained devices, and shares practical memory‑saving techniques, inference scheduling, and error‑analysis methods.

AndroidComputer VisionMNN
0 likes · 12 min read
Deploying Multiple CNN Models on Low‑End Devices with MNN: Memory Tricks and Error Debugging
Tencent IMWeb Frontend Team
Tencent IMWeb Frontend Team
May 27, 2021 · Frontend Development

How to Generate Excel‑Based Posters in the Browser Without Crashing

This article walks through building a front‑end‑only tool that reads student data from Excel, creates customized poster images using SheetJS, html2canvas, and JSZip, and solves out‑of‑memory crashes by analyzing JavaScript heap usage, refactoring recursive code, and optimizing DOM cloning with ignoreElements.

ExcelJSZipfrontend
0 likes · 8 min read
How to Generate Excel‑Based Posters in the Browser Without Crashing
ITFLY8 Architecture Home
ITFLY8 Architecture Home
May 26, 2021 · Databases

How to Store Billions of IDs in Redis Without Running Out of Memory

This article examines the challenges of storing massive DMP ID mappings in Redis—including memory fragmentation, expansion, and latency constraints—and presents eviction, bucket‑hashing, and fragmentation‑reduction techniques to achieve efficient, real‑time, large‑scale key‑value storage.

Data EngineeringKey-value hashingRedis
0 likes · 11 min read
How to Store Billions of IDs in Redis Without Running Out of Memory
Didi Tech
Didi Tech
May 17, 2021 · Backend Development

Implementation of JSValue in JavaScript Engines: Tagged, Boxing, and Pointer Techniques

The article surveys how major JavaScript engines represent the dynamic JSValue type—using QuickJS’s tagged unions, JavaScriptCore’s NaN‑boxing, SpiderMonkey’s nun‑/pun‑boxing, V8’s tagged pointers with compression, and iOS’s Objective‑C pointer tags—explaining each scheme’s memory layout, performance trade‑offs, and design rationale.

JSValueJavaScript engineTagged Pointer
0 likes · 11 min read
Implementation of JSValue in JavaScript Engines: Tagged, Boxing, and Pointer Techniques
Efficient Ops
Efficient Ops
May 11, 2021 · Big Data

How to Store Billions of Keys in Redis: Cut Memory, Reduce Fragmentation, and Scale Real‑Time DMP

This article examines the challenges of storing massive DMP data in Redis, analyzes memory fragmentation, key‑size issues, and latency constraints, and presents practical strategies such as TTL eviction, bucket‑hashing, custom key compression, and fragmentation‑reduction techniques to enable scalable, real‑time querying.

BucketIdDMPRedis
0 likes · 11 min read
How to Store Billions of Keys in Redis: Cut Memory, Reduce Fragmentation, and Scale Real‑Time DMP
Architect
Architect
Apr 30, 2021 · Backend Development

Designing a Scalable Real‑Time Data Warehouse with Redis: Challenges and Solutions

The article analyzes the massive storage and performance challenges of a real‑time DMP cache built on Redis, outlines data characteristics and technical obstacles, and proposes eviction policies, bucket‑based hashing, and fragmentation‑reduction techniques with Java code examples to achieve billion‑scale in‑memory key‑value storage.

JavaRediskey-value store
0 likes · 10 min read
Designing a Scalable Real‑Time Data Warehouse with Redis: Challenges and Solutions
Programmer DD
Programmer DD
Apr 25, 2021 · Fundamentals

How Bitmaps and Bloom Filters Supercharge Massive Data Lookups

This article explains the bitmap concept, demonstrates how to store and query billions of integers using bit-level operations, introduces BitSet for dynamic bit vectors, and describes Bloom filters as probabilistic structures for fast, memory‑efficient membership testing in large‑scale data scenarios.

AlgorithmBitmapBloom filter
0 likes · 12 min read
How Bitmaps and Bloom Filters Supercharge Massive Data Lookups
ITPUB
ITPUB
Mar 23, 2021 · Databases

13 Redis Best Practices to Save Memory, Boost Performance, Ensure Reliability

This guide presents thirteen practical Redis best‑practice recommendations covering memory optimization, performance tuning, high reliability, routine operations, resource planning, monitoring, and security, offering concrete steps such as key length control, maxmemory configuration, lazy‑free, command selection, connection pooling, replication settings, and safe deployment to help developers and DBA operators run Redis efficiently and safely.

memory optimizationperformancereliability
0 likes · 24 min read
13 Redis Best Practices to Save Memory, Boost Performance, Ensure Reliability
Tencent Cloud Developer
Tencent Cloud Developer
Mar 23, 2021 · Mobile Development

TRouter: A Hybrid Stack Routing Framework for Flutter with Memory Optimization and Visible Native Layer Modifications

TRouter is a hybrid stack routing framework for Flutter that reuses a single engine through native Activity/ViewController containers, offloading page transitions and URL parsing to the native layer, clearing iOS view bitmaps and applying bytecode‑hooked Android fixes to dramatically reduce memory usage while keeping native modifications visible, low‑risk, and compatible with multiple Flutter SDK versions.

FlutterHybrid RoutingNative integration
0 likes · 10 min read
TRouter: A Hybrid Stack Routing Framework for Flutter with Memory Optimization and Visible Native Layer Modifications
Practical DevOps Architecture
Practical DevOps Architecture
Feb 4, 2021 · Databases

Redis Interview Questions: Caching Pitfalls, Persistence Options, Memory Optimization, and Eviction Policies

This article presents common Redis interview questions covering cache penetration, breakdown, and avalanche, explains RDB and AOF persistence mechanisms with configuration commands, and details memory‑size tuning, LRU/LFU/RANDOM eviction policies, plus a practical flushAll scenario.

Eviction PoliciesInterviewPersistence
0 likes · 9 min read
Redis Interview Questions: Caching Pitfalls, Persistence Options, Memory Optimization, and Eviction Policies