OCTO: Meituan's Distributed Microservice Communication Framework and Governance Platform

OCTO is Meituan's distributed microservice communication and governance platform that unifies service registration, discovery, load balancing, fault tolerance, gray releases, and call data across thousands of services, handling billions of calls with components such as OCTO‑RPC, OCTO‑NS, OCTO‑Portal, SGAgent, Oceanus, Watt, and MCC, achieving 99.999% success and moving toward API‑based naming and service‑mesh evolution.

Meituan Technology Team
Meituan Technology Team
Meituan Technology Team
OCTO: Meituan's Distributed Microservice Communication Framework and Governance Platform

OCTO is Meituan's company‑wide distributed microservice communication and governance platform, currently supporting tens of thousands of services and daily traffic at the hundred‑billion call level. It provides standardized solutions for service registration/discovery, load balancing, fault tolerance, circuit breaking, gray releases, and visualized call data.

The project started in late 2014 to address low development efficiency, high operation costs, and difficult service operation caused by rapid business expansion. By offering a unified framework, OCTO has significantly improved development quality and reduced operational overhead across the company.

Core open‑source components include:

OCTO‑RPC – a high‑performance, highly available RPC framework (Java/C++/Node.js, etc.).

OCTO‑NS – the naming service providing registration, discovery, configuration, routing, load balancing, and health checks.

OCTO‑Portal – a one‑stop management console for service registration, monitoring, diagnostics, and configuration.

SGAgent – an agent deployed on service nodes handling registration, routing, load balancing, and metric reporting.

Oceanus – a customizable HTTP routing load balancer (to be open‑sourced).

Watt – a link‑level metric collector for monitoring and alerting.

MCC – a unified configuration center.

Key features cover the full service lifecycle: naming, management, fault handling, traffic splitting, data visualization, service grouping, monitoring & alerts, unified configuration, distributed tracing, overload protection, and access control.

The architecture is modular and low‑coupled, enabling support for complex scenarios such as multi‑region active‑active deployments. OCTO has been validated by massive call volumes, achieving a 99.999% success rate and becoming the core of Meituan's SOA and service governance.

Future directions include API‑based naming services, reactive programming support in the RPC framework, and evolution toward a Service Mesh architecture.

Original Source

Signed-in readers can open the original source through BestHub's protected redirect.

Sign in to view source
Republication Notice

This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactadmin@besthub.devand we will review it promptly.

BackendDistributed SystemsMicroservicesRPCopen sourceservice governance
Meituan Technology Team
Written by

Meituan Technology Team

Over 10,000 engineers powering China’s leading lifestyle services e‑commerce platform. Supporting hundreds of millions of consumers, millions of merchants across 2,000+ industries. This is the public channel for the tech teams behind Meituan, Dianping, Meituan Waimai, Meituan Select, and related services.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.