Conquering the Alibaba Middleware Challenge: Building a High‑Performance Dubbo Service Mesh

Alibaba Middleware Performance Challenge Overview

On April 26, 2018, Alibaba researcher Lin Hao announced the fourth Alibaba Middleware Performance Challenge at the Cloud Expo Nanjing summit. The contest uses open‑source projects Dubbo and RocketMQ to promote the open‑source spirit.

Since 2017 Alibaba has accelerated its open‑source contributions. RocketMQ graduated to Apache top‑level project in September 2017, and OpenMessaging became the first Chinese‑originated global standard for distributed messaging. Dubbo also gained rapid updates and entered Apache incubation.

Apache co‑founder Jim Jagielski praised RocketMQ as a powerful, transformative project, and noted Dubbo’s potential in the Apache Software Foundation.

The fourth challenge is the first to set its problem on an open‑source background, inviting developers to participate.

Problem Statement

Dubbo is a high‑performance RPC framework and a complete micro‑service solution, but it lacks strong cross‑language support. The contest asks participants to create a high‑performance Agent that integrates Dubbo into a Service Mesh, enabling multi‑language interoperability.

Scenario

The test environment consists of five Docker containers: etcd, a Consumer service, a Provider service, and an Agent proxy for each. etcd stores service registration; the Agent performs load balancing, service discovery, and protocol conversion between HTTP (Consumer) and Dubbo (Provider).

Scoring Process

The benchmark runs on a 4‑core 8 GB load‑generator and an 8‑core 16 GB target machine. Steps include preparing the environment, pulling images, verifying signatures, launching etcd, providers, consumer, warm‑up, stress testing at multiple levels, recording the best QPS, and cleaning up.

Optimization Tips

Use coroutines to reduce thread‑switch overhead.

Adopt asynchronous communication between Agents.

Implement caching to avoid redundant processing.

The competition aims to provide a platform for technology enthusiasts to tackle real‑world performance problems while experiencing the craftsmanship of engineers.