Cloud Rendering: Technology and Applications in Kuaishou's Special Effects Business

This article introduces cloud rendering technology and its application in Kuaishou's special effects business. Cloud rendering utilizes cloud computing infrastructure to process rendering tasks remotely, returning results to users. Kuaishou employs this technology to enhance its special effects capabilities, which are tightly integrated with AI for features like face detection, body key points, and segmentation.

The article explains why cloud rendering is necessary for Kuaishou: browser limitations restrict full engine capabilities, and complex AI models require substantial memory and computing power that mobile devices cannot provide. Cloud rendering enables better support for H5 activities and leverages server resources for superior effects.

The implementation process involved porting Kuaishou's C++ rendering engine to servers, developing GPU-accelerated video encoding/decoding frameworks, and integrating AI capabilities. The system was extended to support multiple video inputs, transitions, text effects, and compositing of multiple effects.

Performance optimization included multi-threaded processing of decoding, rendering, and encoding modules, with further internal restructuring for multi-threaded decoding and encoding. These optimizations achieved 2.5x speedup and tripled CPU/GPU utilization.

The article concludes by discussing future possibilities with 5G networks, including expanded functionality and applications in video production, live streaming, and mini-games.