Game Quality Assurance and Testing in Taobao Mini Program Ecosystem

This article discusses the challenges and solutions for game quality assurance and testing in Taobao's mini program ecosystem. In April 2022, Taobao launched a mini program game project to introduce third-party game service providers and build a game ecosystem. The open quality team faced new challenges in game ecosystem control and game container testing.

The article outlines several key challenges: incomplete game container and FCanvas rendering engine testing tools, lack of standards for upper-layer game engine integration, difficulty in ensuring iteration quality and diverse business usage patterns, and the need to proactively identify stability risks for complex games. It also addresses the gap between game and regular mini program quality metrics, the need for accurate online quality monitoring, and establishing effective warning response strategies for new game service providers.

The solutions include building a game container testing infrastructure with manual demo verification and automated integration testing, establishing quality control standards specific to games (including performance thresholds, package size limits, memory usage monitoring, and GPU usage), implementing machine-type guidance for game distribution, and creating a comprehensive game quality assurance process with plugin verification, beta testing, performance pre-running, and scoring systems. The article also covers online quality monitoring with game-specific metrics, fault simulation and disaster recovery strategies, and future plans for enhancing game container testing capabilities.