Tag

thread cache

0 views collected around this technical thread.

Deepin Linux
Deepin Linux
Aug 18, 2023 · Fundamentals

Design and Implementation of a High‑Concurrency Memory Pool in C++

This article presents a comprehensive design and implementation of a high‑concurrency memory pool in C++, covering concepts such as fixed‑size block allocation, thread‑local caches, central and page caches, lock‑free techniques, span management, and performance benchmarking against standard malloc.

CConcurrencyallocator
0 likes · 57 min read
Design and Implementation of a High‑Concurrency Memory Pool in C++
HelloTech
HelloTech
Aug 11, 2021 · Backend Development

Root Cause Analysis and Optimization of Long Young GC Times in gRPC/Netty Services

Long Young GC pauses in gRPC/Netty services were traced to Netty’s default thread‑local cache creating many MpscArrayQueue objects, and disabling the cache with the JVM options ‑Dio.netty.allocator.useCacheForAllThreads=false and ‑Dio.grpc.netty.shaded.io.netty.allocator.useCacheForAllThreads=false reduced GC time from up to 900 ms to about 100 ms, stabilizing the service.

JavaNettygRPC
0 likes · 6 min read
Root Cause Analysis and Optimization of Long Young GC Times in gRPC/Netty Services