How NeuHub Scaled TTS to Billions of Calls: Gateway Architecture Evolution
This article recounts the JD.com 11.11 tech salon presentation where architect Shi Weihang explains how the NeuHub gateway was redesigned to handle over two billion TTS service calls, detailing the challenges, scaling techniques, and architectural decisions that enabled such massive traffic.
At JD.com's 11.11 promotional tech salon, architect Shi Weihang shared insights on the massive traffic behind the event, focusing on the Text‑to‑Speech (TTS) service that peaked at over two billion calls. The talk, titled “TTS Service 2 Billion Peak Calls: NeuHub Gateway Architecture Evolution,” described how the NeuHub gateway was continuously refined to meet the unprecedented load.
The presentation covered the architectural evolution, including load‑balancing strategies, micro‑service decomposition, high‑availability mechanisms, and performance optimizations that together ensured stable, low‑latency TTS delivery during the peak period.
Key takeaways included the importance of modular design, real‑time monitoring, and automated scaling to sustain billion‑level request volumes, offering valuable lessons for building resilient AI‑driven services at scale.
Signed-in readers can open the original source through BestHub's protected redirect.
This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactand we will review it promptly.
JD Cloud Developers
JD Cloud Developers (Developer of JD Technology) is a JD Technology Group platform offering technical sharing and communication for AI, cloud computing, IoT and related developers. It publishes JD product technical information, industry content, and tech event news. Embrace technology and partner with developers to envision the future.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.