Tagged articles

Memory Optimization

227 articles · Page 3 of 3
21CTO
21CTO
Sep 3, 2019 · Databases

Redis Deep Dive: Protocols, ACID Myths, Persistence, and Optimization

This article explores Redis's text-based RESP protocol, examines whether Redis truly supports ACID transactions, explains its optimistic lock implementation, details persistence mechanisms like RDB and AOF, discusses memory‑saving data structures, outlines replication processes, and reviews expiration deletion strategies, providing a comprehensive technical overview.

ACIDMemory OptimizationPersistence
0 likes · 22 min read
Redis Deep Dive: Protocols, ACID Myths, Persistence, and Optimization
Meitu Technology
Meitu Technology
Aug 29, 2019 · Backend Development

Memory Optimization in Long Connection Services: A Three-Year Journey

Over three years, Meitu’s long‑connection service “bifrost,” built in Go with MQTT, cut memory use from 22.3 GB to 5.1 GB for 210 k connections—and about 10 GB for a million—by tuning buffers, reducing allocations, employing memory pools, and replacing a goroutine‑per‑connection model with an epoll‑driven event architecture.

Garbage CollectionGoMQTT
0 likes · 13 min read
Memory Optimization in Long Connection Services: A Three-Year Journey
MXPlayer Technical Team
MXPlayer Technical Team
Aug 22, 2019 · Backend Development

How MX Player Cut Memory Use by 96% with Bloom Filters

This article explains how MX Player replaced a Redis‑based user‑history list with per‑user Bloom Filters, dramatically reducing memory consumption and improving filtering efficiency for its recommendation system.

Bloom filterMemory OptimizationRedis
0 likes · 9 min read
How MX Player Cut Memory Use by 96% with Bloom Filters
DataFunTalk
DataFunTalk
Aug 9, 2019 · Big Data

Performance Optimization Techniques for Spark and Spark Streaming Applications

This article explains how to improve Spark and Spark Streaming performance by tuning serialization, broadcast variables, parallelism, batch intervals, memory usage, garbage collection, and Kafka integration, providing practical code examples and real‑world optimization results.

Broadcast VariablesKryoMemory Optimization
0 likes · 32 min read
Performance Optimization Techniques for Spark and Spark Streaming Applications
Java Backend Technology
Java Backend Technology
Jul 11, 2019 · Databases

Understanding Redis: Protocol, ACID Myths, Persistence, and Optimization

Redis, the in‑memory data store, uses a simple RESP text protocol, offers limited ACID‑style transactions without rollback, employs optimistic locking via WATCH, provides multiple persistence options (RDB, AOF, hybrid), optimizes memory with ziplist and quicklist structures, and implements sophisticated replication and expiration strategies to balance performance and resource usage.

In-Memory DatabaseMemory OptimizationPersistence
0 likes · 23 min read
Understanding Redis: Protocol, ACID Myths, Persistence, and Optimization
Efficient Ops
Efficient Ops
Jul 8, 2019 · Backend Development

Why Is Redis So Fast? Deep Dive into Its Data Structures and Optimizations

This article explains why Redis achieves exceptional performance by using pure in‑memory operations, a single‑threaded model, efficient data structures like SDS, skip‑list, ziplist, and various encoding and rehash optimizations that reduce memory allocation and CPU overhead.

Data StructuresKV storeMemory Optimization
0 likes · 17 min read
Why Is Redis So Fast? Deep Dive into Its Data Structures and Optimizations
Xianyu Technology
Xianyu Technology
May 30, 2019 · Mobile Development

Design and Implementation of a Custom Flutter Photo Album Component

The article describes a custom Flutter photo album component that uses a MethodChannel to bridge native modules for permission, caching, decoding, and OpenGL texture conversion, implements MVC architecture, employs lazy GridView pagination, GPU‑based resource recycling, scaled bitmap preview, and PageView preloading to achieve flexible UI, multi‑selection, and low memory usage, while remaining extensible for future features.

GPU TextureMVCMemory Optimization
0 likes · 7 min read
Design and Implementation of a Custom Flutter Photo Album Component
High Availability Architecture
High Availability Architecture
Mar 14, 2019 · Databases

SlimTrie: A Space‑Efficient Trie‑Based Index for Large‑Scale Storage Systems

This article presents SlimTrie, a trie‑based indexing structure that dramatically reduces memory consumption while maintaining fast query speeds, detailing its design, compression techniques, implementation steps, memory analysis, and performance comparisons with map and B‑Tree structures for large‑scale storage systems.

GoIndexingMemory Optimization
0 likes · 20 min read
SlimTrie: A Space‑Efficient Trie‑Based Index for Large‑Scale Storage Systems
Tencent Music Tech Team
Tencent Music Tech Team
Dec 18, 2018 · Mobile Development

Technical Insights from QQ Music’s Android Team on Adapting to Android 9 Pie

QQ Music’s Android team modernized the app for Android 9 Pie by integrating full‑screen displays, native notifications, and enhanced memory profiling, while re‑architecting its dual‑process playback system to cut memory use up to 50%, and adopting Kotlin to shrink code by 25% and halve null‑pointer crashes, delivering a smoother listening experience.

AndroidAndroid 9 PieKotlin
0 likes · 4 min read
Technical Insights from QQ Music’s Android Team on Adapting to Android 9 Pie
Xianyu Technology
Xianyu Technology
Oct 11, 2018 · Mobile Development

Flutter Memory Optimization Techniques

The article explains how excessive memory use in a Flutter app, caused by ImageCache and related image handling, was diagnosed with Xcode Instruments and Dart Observatory, then mitigated through refined caching policies, adaptive screenshot resolution, improved FlutterViewController lifecycle management, and targeted garbage‑collection techniques, resulting in lower memory peaks and greater stability.

DARTMemory Optimizationflutter
0 likes · 17 min read
Flutter Memory Optimization Techniques
Beike Product & Technology
Beike Product & Technology
Feb 7, 2018 · Backend Development

High‑Performance Challenge: Optimizing a C‑Based User Information Service for Tens of Millions of Records

This article recounts a 2017 internal high‑performance competition where a C server handling a 40 million‑row user‑info dataset was progressively optimized through data compression, custom hash tables, memory layout redesign, and a thread‑pool model, ultimately achieving a four‑fold throughput increase.

C++Hash TableMemory Optimization
0 likes · 13 min read
High‑Performance Challenge: Optimizing a C‑Based User Information Service for Tens of Millions of Records
Tencent Advertising Technology
Tencent Advertising Technology
Jun 17, 2017 · Artificial Intelligence

SkullGreymon Team’s Progress and Technical Insights in the Tencent Social Ads Algorithm Competition

The SkullGreymon team, winners of the biggest improvement award in the Tencent Social Ads university algorithm competition, share their journey from a late start in the preliminaries to significant performance gains in the finals, detailing memory‑saving feature extraction techniques, pandas and numpy usage, and their XGBoost modeling approach.

Algorithm CompetitionMemory OptimizationPandas
0 likes · 6 min read
SkullGreymon Team’s Progress and Technical Insights in the Tencent Social Ads Algorithm Competition
Architecture Digest
Architecture Digest
Jun 12, 2017 · Databases

Redis Ziplist (Compressed List): Principles, Memory Layout, and Applications

This article explains the internal structure and encoding of Redis's ziplist (compressed list), describes its memory layout and node format, and analyzes how Redis leverages this data structure across different types such as lists, hashes, and sorted sets to reduce memory usage and fragmentation.

Compressed ListData StructuresMemory Optimization
0 likes · 8 min read
Redis Ziplist (Compressed List): Principles, Memory Layout, and Applications
ITPUB
ITPUB
Oct 15, 2016 · Databases

Mastering Redis: Data Types, Memory Tweaks, and Persistence Strategies

This article explains Redis's five core data types, their internal representations and typical commands, details memory‑saving parameters for each type, compares the four persistence methods with their trade‑offs, and offers practical recommendations for optimal performance and stability.

Data TypesDatabaseMemory Optimization
0 likes · 16 min read
Mastering Redis: Data Types, Memory Tweaks, and Persistence Strategies
Architect
Architect
Jul 21, 2016 · Databases

Redis Ziplist (Compressed List) Principles and Applications

This article explains Redis’s ziplist (compressed list) memory layout, detailing its overall encoding, node structure—including previous length, encoding, and content fields—illustrates how various Redis data types employ ziplist encoding, and analyzes the benefits and trade‑offs of using this structure.

Data StructuresMemory OptimizationRedis
0 likes · 10 min read
Redis Ziplist (Compressed List) Principles and Applications
WeChat Client Technology Team
WeChat Client Technology Team
Jul 5, 2016 · Mobile Development

Capture Android Allocation Tracker Data Programmatically for Memory Analysis

This article explains how to use Android Studio’s Allocation Tracker, automate its start/stop via code using the ddmlib library, and directly access Dalvik’s internal allocation records to retrieve object size, type, and stack information with minimal performance impact, while discussing limitations and compatibility concerns.

Allocation TrackerAndroidDalvik
0 likes · 11 min read
Capture Android Allocation Tracker Data Programmatically for Memory Analysis
21CTO
21CTO
Apr 2, 2016 · Backend Development

How to Reduce PHP Array Memory Usage with String Packing

This article explains why PHP arrays consume far more memory than their C equivalents and demonstrates a technique that stores a double array in a string using pack/unpack, which can dramatically lower memory consumption at the cost of some performance.

Memory Optimizationbackend developmentstring packing
0 likes · 3 min read
How to Reduce PHP Array Memory Usage with String Packing
Tencent TDS Service
Tencent TDS Service
Jan 14, 2016 · Mobile Development

How to Accurately Measure and Reduce Android Bitmap Memory Usage

This article explains Android's DisplayMetrics density values, shows how to calculate a Bitmap's runtime memory footprint using getByteCount, explores the impact of screen density, pixel format, and scaling, and provides practical techniques such as inSampleSize, matrix scaling, and pixel format selection to minimize memory consumption.

AndroidBitmapDisplayMetrics
0 likes · 23 min read
How to Accurately Measure and Reduce Android Bitmap Memory Usage
WeChat Client Technology Team
WeChat Client Technology Team
Dec 15, 2015 · Mobile Development

Android Memory Optimization: Detect Leaks, Cut RAM, Boost Performance

This article outlines comprehensive Android memory optimization strategies, covering leak detection with LeakCanary, system‑level hacks, bitmap handling, runtime monitoring, multi‑process usage, and GC tuning, providing practical code snippets and tools to reduce RAM usage, prevent OOM crashes, and improve app performance.

AndroidGC TuningLeak Detection
0 likes · 17 min read
Android Memory Optimization: Detect Leaks, Cut RAM, Boost Performance