Asynchronous Streaming

DaTaobao Tech

Mar 17, 2022 · Cloud Native

NextRPC: Multi‑Stage RPC Model for Scalable Transaction and Recommendation Services

NextRPC is a multi‑stage RPC model that delivers partial responses over multiple network channels, improving latency and conversion in Taobao’s transaction and recommendation services; it employs a hybrid asynchronous streaming and parallel execution architecture with client‑side orchestration and server‑side sub‑request handling, achieving over 5% UV lift and up to 25% recommendation uplift.