BestHub
Sign in
Tagged articles

Asynchronous Design

2 articles · Page 1 of 1
Cognitive Technology Team
Cognitive Technology Team
Feb 28, 2025 · Artificial Intelligence

Design and High‑Availability Architecture of Alibaba LangEngine AI Application Framework

This article introduces Alibaba's LangEngine, a pure Java AI application framework, detailing its high‑availability gateway architecture, communication protocols, streaming and non‑streaming output, multi‑level metadata caching, asynchronous and serverless designs, and future open‑source roadmap, offering practical guidance for building robust AI services.

AI FrameworkAsynchronous DesignHigh Availability
0 likes · 11 min read
Design and High‑Availability Architecture of Alibaba LangEngine AI Application Framework
LouZai
LouZai
Dec 14, 2023 · Backend Development

How Ctrip Handles 20 Billion Daily Requests: Inside Its High‑Performance API Gateway

Facing 20 billion daily requests, Ctrip’s API gateway evolved from a Zuul‑based prototype to a fully asynchronous, single‑threaded Netty design, employing RxJava, custom flow control, multi‑protocol support, and modular governance to achieve high throughput, low latency, and scalable operations.

API GatewayAsynchronous DesignHigh Performance
0 likes · 20 min read
How Ctrip Handles 20 Billion Daily Requests: Inside Its High‑Performance API Gateway