Why Traditional Testing Is Evolving into Real‑Time Quality: Insights from Alibaba

Alibaba senior test development expert shares his perspective on the future shape of testing, questioning why quality is often measured rather than built, and how testing roles are merging with development amid rapid internet iteration.

Historical Evolution of Test Engineers

Ten years ago, test artifacts were one‑off documents like textual test cases that were discarded after release.

Progress then focused on methodology, such as rigorous test case design and project flow management.

Some testers began writing automation scripts, which were considered hardcore skills in the early software testing era.

Post‑2010, leading enterprises transformed testing teams, moving from these primitive capabilities to CI/CD‑driven technical systems and eventually productizing testing technologies.

Real‑Time Quality Concept

Introduced at the end of 2017, “real‑time quality” is not a specific testing tool but a method for addressing quality problems in the future. Its key characteristic is “run‑with‑test, real‑time feedback.”

Architecture of Real‑Time Quality

The approach requires embedding quality mechanisms as modules or services directly into business applications, shifting from a checkpoint‑style, task‑based testing to a system‑level, automated quality assurance where machines and algorithms perform the testing work.

Case Study: Real‑Time Quality for Operation Pages

Traditional testing of thousands of promotional pages required extensive manual effort. The transformation involved two steps:

Automating existing manual test points using DOM‑based rules and algorithms (e.g., empty‑slot detection, consistency checks).

Integrating these test components with the page publishing system via messaging.

The resulting workflow reduced a multi‑day, multi‑person manual process to a three‑step, one‑stop capability, dramatically improving both operational efficiency and test effectiveness.

Data and Algorithms as the Core of Real‑Time Quality

Testing has moved from pure code logic to a combination of data and algorithms. Accurate business data and algorithmic validation are now essential for detecting quality risks, especially in large‑scale, data‑driven environments.

The “Captain” real‑time data verification platform exemplifies this shift, offering secure, real‑time access to online DB data, diverse query capabilities, and multiple comparison methods, all reusable across test, gray, and production environments.

Future Planning for Real‑Time Quality

The concept aims to bridge the two divergent development paths—platform‑centric and SRE‑centric—by combining quality with efficiency and internal consistency. The article urges testers to retain their core mission while embracing new technologies, lest testing become obsolete.