Tagged articles

Memory Optimization

236 articles · Page 3 of 3
Big Data Technology Architecture
Big Data Technology Architecture
Apr 16, 2020 · Databases

Memory Management Optimizations in HBase MemStore: SkipList, MemStoreLAB, ChunkPool, Off‑heap and CCSMap

The article systematically explains how HBase's MemStore uses a SkipList‑based model and introduces successive memory‑management optimizations—MemStoreLAB, ChunkPool, off‑heap chunks, CompactingMemStore and the CCSMap data structure—to reduce object overhead, GC pressure and improve throughput.

GCHBaseJava
0 likes · 20 min read
Memory Management Optimizations in HBase MemStore: SkipList, MemStoreLAB, ChunkPool, Off‑heap and CCSMap
JD Retail Technology
JD Retail Technology
Dec 9, 2019 · Databases

Memory Optimization in Redis Using zipList and Hash Bucketing

This article explains how to dramatically reduce Redis memory consumption—by up to 90%—through converting long string keys to integers, leveraging zipList‑encoded hashes, and distributing millions of key‑value pairs across many hash buckets while maintaining query performance.

Data StructuresMemory OptimizationRedis
0 likes · 11 min read
Memory Optimization in Redis Using zipList and Hash Bucketing
Test Development Learning Exchange
Test Development Learning Exchange
Dec 9, 2019 · Fundamentals

Understanding Python's yield Keyword and Generators

This article explains the purpose and behavior of Python's yield keyword, how generators work, their difference from regular functions, and demonstrates practical examples including iterator concepts, itertools utilities, and memory‑efficient looping techniques.

IteratorMemory OptimizationPython
0 likes · 10 min read
Understanding Python's yield Keyword and Generators
JD Retail Technology
JD Retail Technology
Nov 20, 2019 · Mobile Development

iOS Memory Optimization and Jetsam Mechanism: Reducing OOM Crashes

This article explains how iOS manages low‑memory conditions through the Jetsam mechanism, analyzes the kernel code that decides which processes to kill, and provides practical image‑handling and autorelease‑pool techniques to lower the probability of Out‑Of‑Memory crashes in iOS apps.

JetsamMemory OptimizationOOM
0 likes · 12 min read
iOS Memory Optimization and Jetsam Mechanism: Reducing OOM Crashes
Big Data Technology & Architecture
Big Data Technology & Architecture
Nov 6, 2019 · Databases

Understanding Hash Functions, Hash Tables, and Their Implementation in Redis

This article explains the concept of hash functions and hash tables, illustrates how they map data to array indices, discusses collision resolution methods, and details Redis's internal dictionary implementation, including zipmap optimization, operation complexities, and practical usage differences between hashes and sets.

Data StructuresMemory OptimizationRedis
0 likes · 8 min read
Understanding Hash Functions, Hash Tables, and Their Implementation in Redis
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
Oct 30, 2019 · Operations

Master CPU & Memory Subsystem Tuning on Kunpeng Processors: Tools & Strategies

This article introduces practical CPU and memory subsystem performance tuning for Kunpeng processors, covering optimization concepts, key parameters, common monitoring tools such as top, perf and numactl, and detailed methods like NUMA binding, prefetch control, timer tuning, TLB page size adjustment, and thread concurrency optimization.

CPU tuningKunpengMemory Optimization
0 likes · 15 min read
Master CPU & Memory Subsystem Tuning on Kunpeng Processors: Tools & Strategies
Python Programming Learning Circle
Python Programming Learning Circle
Oct 11, 2019 · Fundamentals

How to Drastically Reduce Python Object Memory Usage

This article explains why large numbers of active Python objects can cause memory problems and presents several techniques—including using dicts, class __slots__, namedtuple, recordclass, Cython, and NumPy—to shrink object size and dramatically lower memory consumption.

Data StructuresMemory OptimizationPerformance
0 likes · 11 min read
How to Drastically Reduce Python Object Memory Usage
Node Underground
Node Underground
Sep 22, 2019 · Fundamentals

How V8 Lite Cuts Memory Usage by Up to 22% with Smart Optimizations

V8 Lite, introduced by the V8 team in late 2018, implements a series of memory‑saving techniques—such as lazy feedback allocation, delayed source positions, and bytecode flushing—that together can reduce heap usage by roughly 22% in memory‑constrained scenarios while maintaining acceptable execution performance.

JavaScript engineLite modeMemory Optimization
0 likes · 3 min read
How V8 Lite Cuts Memory Usage by Up to 22% with Smart Optimizations
21CTO
21CTO
Sep 3, 2019 · Databases

Redis Deep Dive: Protocols, ACID Myths, Persistence, and Optimization

This article explores Redis's text-based RESP protocol, examines whether Redis truly supports ACID transactions, explains its optimistic lock implementation, details persistence mechanisms like RDB and AOF, discusses memory‑saving data structures, outlines replication processes, and reviews expiration deletion strategies, providing a comprehensive technical overview.

ACIDMemory OptimizationPersistence
0 likes · 22 min read
Redis Deep Dive: Protocols, ACID Myths, Persistence, and Optimization
Meitu Technology
Meitu Technology
Aug 29, 2019 · Backend Development

Memory Optimization in Long Connection Services: A Three-Year Journey

Over three years, Meitu’s long‑connection service “bifrost,” built in Go with MQTT, cut memory use from 22.3 GB to 5.1 GB for 210 k connections—and about 10 GB for a million—by tuning buffers, reducing allocations, employing memory pools, and replacing a goroutine‑per‑connection model with an epoll‑driven event architecture.

Garbage CollectionGoLong Connection
0 likes · 13 min read
Memory Optimization in Long Connection Services: A Three-Year Journey
MXPlayer Technical Team
MXPlayer Technical Team
Aug 22, 2019 · Backend Development

How MX Player Cut Memory Use by 96% with Bloom Filters

This article explains how MX Player replaced a Redis‑based user‑history list with per‑user Bloom Filters, dramatically reducing memory consumption and improving filtering efficiency for its recommendation system.

Bloom FilterMemory OptimizationRedis
0 likes · 9 min read
How MX Player Cut Memory Use by 96% with Bloom Filters
DataFunTalk
DataFunTalk
Aug 9, 2019 · Big Data

Performance Optimization Techniques for Spark and Spark Streaming Applications

This article explains how to improve Spark and Spark Streaming performance by tuning serialization, broadcast variables, parallelism, batch intervals, memory usage, garbage collection, and Kafka integration, providing practical code examples and real‑world optimization results.

Broadcast VariablesMemory OptimizationSpark
0 likes · 32 min read
Performance Optimization Techniques for Spark and Spark Streaming Applications
Java Backend Technology
Java Backend Technology
Jul 11, 2019 · Databases

Understanding Redis: Protocol, ACID Myths, Persistence, and Optimization

Redis, the in‑memory data store, uses a simple RESP text protocol, offers limited ACID‑style transactions without rollback, employs optimistic locking via WATCH, provides multiple persistence options (RDB, AOF, hybrid), optimizes memory with ziplist and quicklist structures, and implements sophisticated replication and expiration strategies to balance performance and resource usage.

In-Memory DatabaseMemory OptimizationPersistence
0 likes · 23 min read
Understanding Redis: Protocol, ACID Myths, Persistence, and Optimization
Efficient Ops
Efficient Ops
Jul 8, 2019 · Backend Development

Why Is Redis So Fast? Deep Dive into Its Data Structures and Optimizations

This article explains why Redis achieves exceptional performance by using pure in‑memory operations, a single‑threaded model, efficient data structures like SDS, skip‑list, ziplist, and various encoding and rehash optimizations that reduce memory allocation and CPU overhead.

Data StructuresKV storeMemory Optimization
0 likes · 17 min read
Why Is Redis So Fast? Deep Dive into Its Data Structures and Optimizations
Xianyu Technology
Xianyu Technology
May 30, 2019 · Mobile Development

Design and Implementation of a Custom Flutter Photo Album Component

The article describes a custom Flutter photo album component that uses a MethodChannel to bridge native modules for permission, caching, decoding, and OpenGL texture conversion, implements MVC architecture, employs lazy GridView pagination, GPU‑based resource recycling, scaled bitmap preview, and PageView preloading to achieve flexible UI, multi‑selection, and low memory usage, while remaining extensible for future features.

FlutterGPU TextureMVC
0 likes · 7 min read
Design and Implementation of a Custom Flutter Photo Album Component
High Availability Architecture
High Availability Architecture
Mar 14, 2019 · Databases

SlimTrie: A Space‑Efficient Trie‑Based Index for Large‑Scale Storage Systems

This article presents SlimTrie, a trie‑based indexing structure that dramatically reduces memory consumption while maintaining fast query speeds, detailing its design, compression techniques, implementation steps, memory analysis, and performance comparisons with map and B‑Tree structures for large‑scale storage systems.

GoIndexingMemory Optimization
0 likes · 20 min read
SlimTrie: A Space‑Efficient Trie‑Based Index for Large‑Scale Storage Systems
Tencent Music Tech Team
Tencent Music Tech Team
Dec 18, 2018 · Mobile Development

Technical Insights from QQ Music’s Android Team on Adapting to Android 9 Pie

QQ Music’s Android team modernized the app for Android 9 Pie by integrating full‑screen displays, native notifications, and enhanced memory profiling, while re‑architecting its dual‑process playback system to cut memory use up to 50%, and adopting Kotlin to shrink code by 25% and halve null‑pointer crashes, delivering a smoother listening experience.

AndroidAndroid 9 PieKotlin
0 likes · 4 min read
Technical Insights from QQ Music’s Android Team on Adapting to Android 9 Pie
Xianyu Technology
Xianyu Technology
Oct 11, 2018 · Mobile Development

Flutter Memory Optimization Techniques

The article explains how excessive memory use in a Flutter app, caused by ImageCache and related image handling, was diagnosed with Xcode Instruments and Dart Observatory, then mitigated through refined caching policies, adaptive screenshot resolution, improved FlutterViewController lifecycle management, and targeted garbage‑collection techniques, resulting in lower memory peaks and greater stability.

DartFlutterMemory Optimization
0 likes · 17 min read
Flutter Memory Optimization Techniques
Beike Product & Technology
Beike Product & Technology
Feb 7, 2018 · Backend Development

High‑Performance Challenge: Optimizing a C‑Based User Information Service for Tens of Millions of Records

This article recounts a 2017 internal high‑performance competition where a C server handling a 40 million‑row user‑info dataset was progressively optimized through data compression, custom hash tables, memory layout redesign, and a thread‑pool model, ultimately achieving a four‑fold throughput increase.

C++Memory OptimizationPerformance
0 likes · 13 min read
High‑Performance Challenge: Optimizing a C‑Based User Information Service for Tens of Millions of Records
Tencent Advertising Technology
Tencent Advertising Technology
Jun 17, 2017 · Artificial Intelligence

SkullGreymon Team’s Progress and Technical Insights in the Tencent Social Ads Algorithm Competition

The SkullGreymon team, winners of the biggest improvement award in the Tencent Social Ads university algorithm competition, share their journey from a late start in the preliminaries to significant performance gains in the finals, detailing memory‑saving feature extraction techniques, pandas and numpy usage, and their XGBoost modeling approach.

Algorithm CompetitionMemory OptimizationXGBoost
0 likes · 6 min read
SkullGreymon Team’s Progress and Technical Insights in the Tencent Social Ads Algorithm Competition
Architecture Digest
Architecture Digest
Jun 12, 2017 · Databases

Redis Ziplist (Compressed List): Principles, Memory Layout, and Applications

This article explains the internal structure and encoding of Redis's ziplist (compressed list), describes its memory layout and node format, and analyzes how Redis leverages this data structure across different types such as lists, hashes, and sorted sets to reduce memory usage and fragmentation.

Compressed ListData StructuresMemory Optimization
0 likes · 8 min read
Redis Ziplist (Compressed List): Principles, Memory Layout, and Applications
ITPUB
ITPUB
Oct 15, 2016 · Databases

Mastering Redis: Data Types, Memory Tweaks, and Persistence Strategies

This article explains Redis's five core data types, their internal representations and typical commands, details memory‑saving parameters for each type, compares the four persistence methods with their trade‑offs, and offers practical recommendations for optimal performance and stability.

Data TypesMemory OptimizationRedis
0 likes · 16 min read
Mastering Redis: Data Types, Memory Tweaks, and Persistence Strategies
Architect
Architect
Jul 21, 2016 · Databases

Redis Ziplist (Compressed List) Principles and Applications

This article explains Redis’s ziplist (compressed list) memory layout, detailing its overall encoding, node structure—including previous length, encoding, and content fields—illustrates how various Redis data types employ ziplist encoding, and analyzes the benefits and trade‑offs of using this structure.

Data StructuresMemory OptimizationRedis
0 likes · 10 min read
Redis Ziplist (Compressed List) Principles and Applications
WeChat Client Technology Team
WeChat Client Technology Team
Jul 5, 2016 · Mobile Development

Capture Android Allocation Tracker Data Programmatically for Memory Analysis

This article explains how to use Android Studio’s Allocation Tracker, automate its start/stop via code using the ddmlib library, and directly access Dalvik’s internal allocation records to retrieve object size, type, and stack information with minimal performance impact, while discussing limitations and compatibility concerns.

Allocation TrackerAndroidDalvik
0 likes · 11 min read
Capture Android Allocation Tracker Data Programmatically for Memory Analysis
21CTO
21CTO
Apr 2, 2016 · Backend Development

How to Reduce PHP Array Memory Usage with String Packing

This article explains why PHP arrays consume far more memory than their C equivalents and demonstrates a technique that stores a double array in a string using pack/unpack, which can dramatically lower memory consumption at the cost of some performance.

Memory Optimizationbackend developmentstring packing
0 likes · 3 min read
How to Reduce PHP Array Memory Usage with String Packing
Tencent TDS Service
Tencent TDS Service
Jan 14, 2016 · Mobile Development

How to Accurately Measure and Reduce Android Bitmap Memory Usage

This article explains Android's DisplayMetrics density values, shows how to calculate a Bitmap's runtime memory footprint using getByteCount, explores the impact of screen density, pixel format, and scaling, and provides practical techniques such as inSampleSize, matrix scaling, and pixel format selection to minimize memory consumption.

AndroidBitmapDisplayMetrics
0 likes · 23 min read
How to Accurately Measure and Reduce Android Bitmap Memory Usage
WeChat Client Technology Team
WeChat Client Technology Team
Dec 15, 2015 · Mobile Development

Android Memory Optimization: Detect Leaks, Cut RAM, Boost Performance

This article outlines comprehensive Android memory optimization strategies, covering leak detection with LeakCanary, system‑level hacks, bitmap handling, runtime monitoring, multi‑process usage, and GC tuning, providing practical code snippets and tools to reduce RAM usage, prevent OOM crashes, and improve app performance.

AndroidGC TuningMemory Optimization
0 likes · 17 min read
Android Memory Optimization: Detect Leaks, Cut RAM, Boost Performance