Tagged articles

13 articles

Page 1 of 1

Nov 10, 2019 · Backend Development

Redesigning Twemproxy with Nginx Multi‑Process Architecture for High‑Performance Caching

This article analyzes the limitations of native Twemproxy, describes how Nginx's master‑worker multi‑process model and related Linux kernel features were integrated to create a high‑performance, highly available cache proxy, and presents extensive online and benchmark results showing significant latency and QPS improvements.

NginxTwemproxymulti-process

0 likes · 17 min read

Redesigning Twemproxy with Nginx Multi‑Process Architecture for High‑Performance Caching

Didi Tech

Jan 15, 2019 · Operations

Design and Performance Optimization of Twemproxy Using Nginx Multi‑Process Architecture

The project re‑engineers Twemproxy by adopting Nginx’s master‑worker multi‑process model, adding non‑blocking accept locks, reuseport load balancing, CPU affinity and crash isolation, which transforms the single‑threaded proxy into a scalable, low‑latency, high‑QPS solution suitable for public‑cloud high‑concurrency workloads.

Cache ProxyLinuxNginx

0 likes · 18 min read

Design and Performance Optimization of Twemproxy Using Nginx Multi‑Process Architecture

Meitu Technology

Oct 10, 2018 · Backend Development

How Meitu Scaled Twemproxy with Multi‑Process Architecture and Live Reload

This article details Meitu's engineering of a Redis/Memcached proxy platform, describing why twemproxy was chosen, the limitations of its upstream version, the multi‑process redesign with live configuration reload, added latency metrics, reuse‑port handling, Redis master‑slave support, performance testing, and remaining challenges.

MemcachedProxyTwemproxy

0 likes · 12 min read

How Meitu Scaled Twemproxy with Multi‑Process Architecture and Live Reload

High Availability Architecture

Oct 10, 2018 · Databases

Design and Implementation of a High‑Availability Twemproxy‑Based Redis/Memcached PaaS at Meitu

The article details Meitu's adaptation of Twitter's twemproxy into a multi‑process, hot‑reloading, high‑availability Redis/Memcached proxy, describing its architecture, custom features, performance testing, remaining challenges, and open‑source resources for other engineering teams.

MemcachedProxyTwemproxy

0 likes · 16 min read

Design and Implementation of a High‑Availability Twemproxy‑Based Redis/Memcached PaaS at Meitu

37 Interactive Technology Team

Jul 28, 2017 · Databases

Case Study: Scaling Redis with Twemproxy and Optimizing Connection Pools

The team rescued a crashing Redis cache handling 100K‑120K QPS by shrinking Nginx Lua timeouts, trimming connection pools, adding four Redis nodes behind Twemproxy, and splitting keys to raise cardinality, which eliminated connection spikes, balanced shard load, and restored stable performance.

Connection PoolPerformance OptimizationTwemproxy

0 likes · 10 min read

Case Study: Scaling Redis with Twemproxy and Optimizing Connection Pools

Java High-Performance Architecture

Feb 9, 2017 · Backend Development

How to Set Up Twemproxy (Nutcracker) for Scalable Redis Caching

This guide explains what Twemproxy is, its features and limitations, and provides step‑by‑step instructions for installing, configuring, and testing the proxy with two Redis instances, plus high‑availability strategies using HAProxy and Sentinel.

ConfigurationProxyTwemproxy

0 likes · 7 min read

How to Set Up Twemproxy (Nutcracker) for Scalable Redis Caching

MaGe Linux Operations

Sep 25, 2016 · Databases

Understanding Redis Clustering: Client Sharding, Proxy Sharding, and Codis Solutions

This article reviews Redis's native limitations, explains three clustering approaches—client‑side sharding, proxy sharding (e.g., Twemproxy), and the official Redis Cluster—then compares Twemproxy's drawbacks and introduces Codis as a modern, open‑source alternative with practical deployment tips.

CodisTwemproxyclustering

0 likes · 9 min read

Understanding Redis Clustering: Client Sharding, Proxy Sharding, and Codis Solutions

Art of Distributed System Architecture Design

Jun 21, 2016 · Databases

Redis Cache Cluster Solutions: Dynomite, Twemproxy, and Codis

This article reviews three open‑source Redis cache clustering approaches—Netflix's Dynomite, Twitter's Twemproxy, and Wandoujia's Codis—explaining their architectures, advantages, licensing, and suitability for production environments as alternatives to the native Redis cluster feature.

CodisDynomiteTwemproxy

0 likes · 5 min read

Redis Cache Cluster Solutions: Dynomite, Twemproxy, and Codis

Efficient Ops

Feb 2, 2016 · Databases

Why Codis Outperforms Twemproxy: A Deep Dive into Redis Cluster Solutions

This article examines Redis clustering techniques, compares client‑side sharding, proxy sharding, and Redis Cluster, critiques Twemproxy's limitations, and presents Codis's architecture, performance benchmarks, and practical tips for seamless migration and high‑availability in modern operations.

CodisTwemproxydatabase clustering

0 likes · 11 min read

Why Codis Outperforms Twemproxy: A Deep Dive into Redis Cluster Solutions

21CTO

Jan 9, 2016 · Backend Development

Building a High‑Concurrency, Scalable Proxy for Weibo Recommendation Engine

This article details the design and implementation of a high‑concurrency, easily extensible proxy built in Go for Weibo's recommendation system, covering background, challenges with twemproxy, technical research, architecture, configuration, logging, monitoring, module breakdown, business logic, performance testing, and future improvements.

CacheGolangProxy

0 likes · 20 min read

Building a High‑Concurrency, Scalable Proxy for Weibo Recommendation Engine

Architect

Dec 13, 2015 · Databases

Redis Partitioning: How to Store Data Across Multiple Redis Instances

This article explains the concept, benefits, methods, and practical considerations of partitioning data across multiple Redis instances, covering range and hash partitioning, consistent hashing, implementation options, drawbacks, and recommended tools such as Redis Cluster and Twemproxy.

PartitioningRedis ClusterTwemproxy

0 likes · 11 min read

Redis Partitioning: How to Store Data Across Multiple Redis Instances

Art of Distributed System Architecture Design

Jun 25, 2015 · Databases

Redis Cache Cluster Solutions: Dynomite, Twemproxy, and Codis

Due to the memory limits of single Redis servers, many companies adopt proxy‑based Redis clustering solutions such as Netflix’s Dynomite, Twitter’s Twemproxy, and the open‑source Codis from Wandoujia, which provide distributed caching, cross‑data‑center replication, and improved performance and availability.

Cache ClusterCodisDynomite

0 likes · 4 min read

MaGe Linux Operations

Jun 24, 2014 · Databases

Mastering Twemproxy: A Fast Redis/Memcached Proxy for Scalable Caching

This article explains how Twemproxy (nutcracker) works as a high‑performance proxy for Redis and Memcached, outlines its key features and limitations, and provides step‑by‑step installation and configuration instructions for building a reliable, scalable caching layer.

ProxyTwemproxy

0 likes · 7 min read

Mastering Twemproxy: A Fast Redis/Memcached Proxy for Scalable Caching