Test Automation Strategies, Pitfalls, and Value – Insights from Expert Yang Xiaohui

The Baidu QA expert column introduces Yang Xiaohui, a former chief testing expert at Huawei, who shares extensive experience in software testing, automation, reliability verification, and testability design.

Automation is often the first goal for testing teams because its benefits are obvious: reusable tools and scripts, faster feedback, and a sign of technical progress. However, many teams encounter numerous hidden "pitfalls" when trying to implement automation.

Two common triggers for automation are (1) recurring problems such as long test cycles or post‑release defects, and (2) availability of time during project lull periods. When automation is driven by the first trigger, a misguided approach can lead to disappointment and even increased effort.

Successful automation requires alignment with development managers on value, involving support from requirements engineers, system engineers, and development leads to ensure test coverage, feature interaction, and process compliance.

The article stresses that automation goals should focus on concrete outcomes (e.g., preventing quality regressions) rather than abstract metrics like "automation rate." It outlines a typical progression: tool and framework formation, achieving sufficient test coverage, enabling developers to use automation efficiently, reducing defects, and ultimately decreasing manual testing effort.

Key strategic points include defining the automation scope (features, test types, environments, data preparation, execution monitoring, defect analysis, code checks), selecting the right timing (early integration for quality gates versus later stages), and recognizing that early automation may face instability due to changing interfaces.

Automation should serve broader objectives such as improving quality, accelerating development, and ensuring stable product releases. The article concludes that automation is not merely a technical issue; it starts with clear goals, followed by strategy formulation, solution design, and tool selection.

For further reading, Yang Xiaohui’s book "The Path to Enhancing Software Testing Value" expands on automation value, strategies, implementation steps, and common challenges.