Efficient Online Performance Testing Using a Mirror Cluster Self‑Service Platform

Performance testing plays a crucial role in software and Internet services, affecting user experience, retention, and brand perception; therefore, achieving high‑efficiency online load testing is essential.

The goal addressed here is how to conduct online application load testing efficiently, emphasizing three efficiency characteristics: convenience (anyone can quickly start a test), safety (preventing production incidents), and simplicity (clear, traceable results).

The solution leverages a Mirror cluster whose core is container traffic forwarding, as illustrated in Figure 1. Mirror replay is chosen for online testing because it offers rich scenario coverage, easy server management, simple configuration, developer‑friendly operation, integration with offline self‑service platforms, and higher project support.

The technical background outlines Ctrip’s evolution from physical machines to virtualization and finally containerization, adopting sidecar patterns and container traffic mirroring (e.g., using pcap) to forward live traffic to sandboxed instances for scalable load testing.

Implementation focuses on three aspects:

Choosing a convenient and reliable request‑generation tool. The platform must handle many‑to‑many app‑service mappings, requiring whitelist verification to ensure correct routing.

Ensuring safety during online replay. This includes whitelist approval by service owners, automatic stop on error conditions detected via CAT monitoring, and preventing impact on production metrics.

Aggregating results and simplifying troubleshooting. Performance data from CAT/HickWall are consolidated for both application and server metrics, and tools such as JProfile, .NET dump analyzers, and Pass are provided for rapid issue analysis.

Current limitations include coarse‑grained replay scenarios, limited scaling for low‑traffic services, and potential data consumption errors when mirror services run without active replay.

In conclusion, the Mirror‑based self‑service performance testing platform is a key component of Ctrip’s overall automated testing ecosystem, complementing offline load‑testing tools, ES/Kafka replay utilities, and diagnostic tools to deliver a comprehensive, efficient, and safe performance testing solution.