This article details how XiaoHongShu's infrastructure team built a keyless architecture that offloads CPU‑intensive TLS private‑key signing to Intel QAT hardware, achieving massive HTTPS throughput gains, lower server costs, and valuable insights for similar high‑traffic TLS offload scenarios.
By integrating Intel QuickAssist hardware and AVX‑512 software acceleration into the VUA component of Vivo’s load‑balancing platform, the article demonstrates asynchronous OpenSSL offloading that boosts HTTPS forwarding throughput to roughly 44 000 QPS with QAT cards and 51 000 QPS with software, while preserving scalability and security.
Intel’s QuickAssist Technology (QAT) offers both Multi‑Buffer SIMD software acceleration and dedicated hardware offload to dramatically speed up TLS handshakes, with up to 5× faster RSA signing and 12× faster ECDH key exchange, while maintaining compatibility via OpenSSL’s async engine.
The article explains how Tengine 2.2.2 leverages Intel QuickAssist Technology to offload SSL/TLS operations via an async OpenSSL module, detailing its architecture, event‑driven workflow, and benchmark results that show up to 3.8× throughput improvement for HTTPS traffic.
This article explains how Alibaba’s lightweight web server Tengine leverages Intel QuickAssist Technology to offload SSL operations via an async ssl_async module, detailing its architecture, integration with OpenSSL, performance gains across various cipher suites, and the resulting multi‑fold increase in HTTPS throughput.
