Tagged articles
Testing Framework
45 articles · Page 1 of 1
The article presents a comprehensive, experience‑driven framework for testing large‑model‑driven AI agents, detailing why traditional methods fail, outlining a four‑layer testing pyramid (intent, planning, tool interaction, end‑to‑end), and sharing three production‑validated engineering practices from banking and e‑commerce projects.
AI Agent TestingLLM EvaluationRoot Cause Diagnosis
0 likes · 10 min read

This article presents a comprehensive, fine-grained evaluation framework for AI agents that moves beyond traditional text-similarity metrics, defines architecture-aligned quality, cost, and performance indicators for each core module, describes dataset construction, LLM-as-Judge tasks, execution engine, and visual dashboards, and shares practical lessons and future directions.
AI agentLLM-as-JudgeMetrics
0 likes · 45 min read

This article outlines the challenges of AI product testing, proposes a comprehensive evaluation framework covering business goals, product effectiveness, performance, safety, and cost, and details the design of a modular, end‑to‑end testing platform that supports both reference‑based and reference‑free assessments while enabling continuous quality improvement.
AI-evaluationPlatformTesting Framework
0 likes · 19 min read

The paper presents a systematic testing framework for large‑model interaction capabilities, identifies five unique testing challenges, defines four core abilities (basic dialogue, information extraction, intent recognition, process decision), proposes a semantic‑vector automated verification method, and reports pilot results showing significant efficiency gains and defect detection improvements in a banking context.
Testing Frameworkautomated testingbanking AI
0 likes · 14 min read

Zhihu partnered with Huawei to develop and open‑source an Appium driver for HarmonyOS, enabling unified, efficient automated testing across iOS, Android, and HarmonyOS and energizing the open‑source HarmonyOS ecosystem for developers and enterprises.
AppiumHarmonyOSMobile Automation
0 likes · 4 min read

This article explains how to leverage Pytest's flexible assertion mechanisms together with Allure's rich reporting features to build a clear, efficient API automation testing framework, covering basic and custom assertions, assertion libraries, report generation, project structure, test case writing, and execution steps.
PythonTesting Frameworkpytest
0 likes · 8 min read

This article outlines a four‑layer architecture for automated testing frameworks and describes the essential layers of a DevOps automation efficiency platform, covering system under test, core architecture, script organization, user management, and resource, data, capability, pipeline, and user layers.
Automation TestingContinuous DeliveryContinuous Integration
0 likes · 5 min read

Poco2 is an open-source Python-based mobile automation testing framework that simplifies UI interaction and validation for Android/iOS apps, demonstrated through a complete e-commerce purchase flow test script covering login, browsing, cart, payment, return, refund, and logout.
AndroidMobile AutomationPoco2
0 likes · 7 min read

This article details how a rapidly expanding audio service built a lightweight, modular testing framework called FAST, defined core scenario‑based testing concepts, and implemented an automated pipeline that reduced manual effort, cut costs, and improved release quality across multiple teams.
Continuous IntegrationEfficiencyScenario Testing
0 likes · 7 min read

This article details the DPU performance benchmark testing framework, describing three test system architectures—Single-End, End-to-End, and Multi-End—along with their hardware and software components, test workflow, result reporting requirements, and the necessary tools and drivers for accurate and repeatable performance evaluation.
DPUEnd-to-EndMulti-End
0 likes · 9 min read

This article introduces the concept and benefits of automated testing frameworks, outlines popular framework types such as module‑based, data‑driven, keyword‑driven, black‑box hybrid and behavior‑driven, and explains how they are integrated with CI clusters, data platforms, and objective reporting to improve real‑time video SDK testing efficiency and reliability.
CI/CDTesting Frameworkautomated testing
0 likes · 9 min read

This article provides a comprehensive guide to JUnit runners, detailing the purpose and usage of Suite, Theories, Categories, Enclosed, Parameterized, IgnoredClassRunner and other executors, accompanied by code examples and execution results to help developers apply flexible unit testing strategies in Java projects.
JUnitJavaRunner
0 likes · 12 min read

Spock is an open‑source Java/Groovy testing framework that blends JUnit‑style structure with a concise Groovy DSL, offering data‑driven “given‑expect‑where” tests, straightforward mocking and property injection, Maven‑based setup, and seamless PowerMock integration for static‑method mocking, making it a powerful alternative to traditional unit‑test tools.
GroovyJavaMocking
0 likes · 17 min read

The 2021 year‑end summary details FunTester’s rapid growth, the expansion of its public account, major performance upgrades reaching over 100 k QPS, the design of a distributed testing framework, dynamic load models, log‑replay innovations, and the author’s deep dive into Go, Java and Groovy.
GoJavaTesting Framework
0 likes · 10 min read

This article outlines a step‑by‑step API automation workflow, compares popular frameworks, discusses design considerations, CI integration, and common technical challenges such as data‑driven testing, parameterization, and multi‑threaded execution, offering practical guidance for interview preparation and real‑world implementation.
API automationBackend testingCI/CD
0 likes · 9 min read

This article presents a detailed overview of the 4S smart student service web platform, its B/S architecture, and a systematic QA testing framework—including testing pyramids, layered testing, left‑right shift practices, and tool‑assisted efficiency measures—to ensure reliable, scalable, and user‑friendly service for thousands of tutors.
B/S ArchitectureQATesting Framework
0 likes · 13 min read

Airbnb’s new Android automation testing framework replaces flaky Espresso tests with deterministic UI rendering by simulating immutable State objects via MvRx, Epoxy, and a custom DSL, enabling fast, reliable tests, easy mock generation, and a launcher for instant screen inspection across multiple state variants.
AndroidAutomation TestingEpoxy
0 likes · 17 min read

This article details iQIYI's precise testing framework, explaining why traditional regression testing falls short, how a custom code‑coverage tool and knowledge‑base enable fine‑grained test‑case selection across client, server and micro‑service layers, and the measurable impact on test speed and reliability.
Test AutomationTesting Frameworkcode coverage
0 likes · 17 min read

This tutorial walks you through installing Groovy, configuring environment variables, cloning the FunTester repository, building with Gradle, and running a simple hello‑world test case, while also detailing the framework's project structure and essential code snippets.
FunTesterGradleGroovy
0 likes · 6 min read

This article details a comprehensive UI automation framework for the Dali Smart Homework Lamp, covering business context, product features, testing challenges, automated script generation, modular case design, multi-device coordination, error analysis, and future directions for intelligent UI validation.
PythonTesting FrameworkUI automation
0 likes · 17 min read

This article introduces the FunTester moco framework, summarizing its architecture, the three core components (RequestMatcher, ResponseHandler, HttpServer), detailed matching and response capabilities, and additional utilities such as runners and monitoring, providing a comprehensive guide for developers using the moco API.
API mockingMoCoTesting Framework
0 likes · 7 min read

Effective test automation relies on well‑designed frameworks, and this article explains why automation is essential, categorizes tool‑centric, project‑oriented, and keyword‑driven frameworks, details core components such as test libraries, data management, reporting, CI integration, and outlines a step‑by‑step implementation process.
CI/CDQATest Automation
0 likes · 14 min read

The article describes how a three‑layer, cross‑platform mobile automation framework was designed and implemented for the Youku app, integrating driver, encapsulation, and test‑case layers with utilities, logging, image‑recognition and platform reporting to streamline regression testing, cut labor costs, and guide future enhancements.
Mobile AutomationTesting FrameworkUI testing
0 likes · 9 min read

This article presents a detailed walkthrough of the FunTester testing framework architecture, covering its layered design, core modules for single‑ and multi‑project setups, multi‑protocol support, common request handling, business logic encapsulation, test flow, data construction techniques, and auxiliary tools such as moco API and JsonPath.
API testingFunTesterTesting Framework
0 likes · 5 min read

This article introduces Python’s built‑in unittest framework, explains its core concepts such as test cases, fixtures, suites and runners, demonstrates common assertion methods, and provides a step‑by‑step Selenium example for testing a webmail login flow.
PythonTest AutomationTesting Framework
0 likes · 9 min read

This article explains why Bash scripts need unit testing, outlines common testing challenges, defines what constitutes a Bash unit test, and demonstrates how to write safe, fast, and cross‑platform tests using the Bach Testing Framework with practical code examples.
Testing Frameworkbashunit testing
0 likes · 13 min read

This article extends the previous JsonPath utility guide by demonstrating how to write comprehensive Groovy‑based Spock unit tests, covering Maven/Gradle setup, basic and data‑driven demos, detailed test cases for JSON path extraction, array operations, statistical functions, and a deliberately introduced bug with its console output.
GroovyJSONJava
0 likes · 7 min read

This article explains why Bash scripts need unit testing, outlines common testing challenges, and demonstrates how the Bach Testing Framework provides safe, fast, and environment‑agnostic unit tests for Bash scripts by mocking external commands and isolating execution logic.
Testing Frameworkbachbash
0 likes · 14 min read

This article explains how to configure response handlers in the Moco API mock framework, covering response types (string, JSON, object) and various strategies such as fixed, random, cyclic, and limited responses, and provides a comprehensive Java class with static helper methods for implementing these behaviors.
API mockingBackend testingJava
0 likes · 8 min read

This article presents a detailed walkthrough of a Java base class used in the FunTester API testing framework, covering static factory methods, login handling with RSA encryption, request construction, header management, response validation, and includes the full source code for reference.
API testingBackendJava
0 likes · 10 min read

This article explains how to build a modular automated API testing project in Java by creating a base class that encapsulates request handling, header and cookie management, common validation methods, and response processing, allowing individual test modules to focus solely on specific API parameters and responses.
Code ExampleHTTPJava
0 likes · 10 min read

This article demonstrates practical API business validation using the FunTester testing framework, covering user registration and login scenarios with example Java code, and provides a series of instructional videos for HTTP request handling, response parsing, and header/cookie management.
API testingHTTPJava
0 likes · 7 min read

This article walks through implementing and testing a POST API using the FunTester framework, covering a complete Java demo, handling parameter dependencies, authentication flow, and practical tips for short‑term test projects, with a full code example and a Gitee repository link.
API testingBackendFunTester
0 likes · 5 min read

This article explains how the FanLibrary testing framework provides overloaded methods to create HttpGet and HttpPost objects, supporting JSON, form, and multipart file uploads, with detailed Java code examples and guidance on parameter handling and URL encoding.
File UploadHTTPJava
0 likes · 8 min read

This article introduces HttpRunner 2.0.1 for API automation, explains the environment setup, project structure, essential CLI commands and Python integration, and shares solutions to frequent problems such as timestamp handling, variable overriding, extraction, and execution repeats, along with useful tips for efficient test layering.
API testingDebuggingHttpRunner
0 likes · 7 min read


转转QADec 4, 2019 · Backend Development
This article discusses the motivations behind moving beyond HTTP/HTTPS API testing to RPC service testing, outlines the difficulties of manual test code development, and presents an automated workflow—including Beetle integration, JSON-to-Java conversion, and template‑based test generation—to improve efficiency and reduce manual effort.
API testingRPCTesting Framework
0 likes · 5 min read

The author shares a two‑year‑old Java/Groovy testing framework, outlines common challenges in API functional and performance testing, and provides a curated list of practical implementations—including Spring Boot + MyBatis services, HttpClient examples, AlertOver notifications, Swagger code generation, performance tools like Netdata and Timewatch, and detailed test plans for various scenarios.
API testingBackendJava HttpClient
0 likes · 4 min read

This tutorial shows how to package a Java‑based HTTP testing framework into a JAR, import it into Groovy, and write a concise Groovy script that sends an HTTP GET request, processes the JSON response, and prints the result.
API automationGroovyHTTP Testing
0 likes · 3 min read


转转QAApr 3, 2019 · Operations
This article explains how to design and extend a UI automation testing framework using Selenium 2.0 and JUnit 4, covering control identification and encapsulation, test case organization and execution, as well as custom logging and reporting to improve maintainability and efficiency.
JUnitTesting FrameworkUI automation
0 likes · 6 min read


转转QANov 22, 2018 · Operations
This article presents an automated regression testing solution called “Monitor Dog” that leverages Selenium with headless Chrome to efficiently validate page data and style correctness for numerous promotional activity pages, incorporating image diff analysis, element interaction, and detailed reporting to ensure seamless system updates without impacting user experience.
ImageDiffTesting FrameworkUI automation
0 likes · 10 min read

This article explains how Alibaba built a comprehensive Blink testing platform—including code‑quality checks, functional, performance, stability, and pre‑release testing—to ensure the reliability and scalability of its real‑time big‑data processing engine during massive workloads like Double 11.
Apache FlinkTesting Frameworkbig data
0 likes · 13 min read

This article explains what a framework is, outlines the purpose and advantages of automated testing, discusses its limitations, and describes the essential components and typical technology stacks of automation testing frameworks, providing practical insights for building effective test solutions.
Automation TestingCI/CDTest Automation
0 likes · 8 min read

This article introduces Appium, an open‑source mobile automation framework that enables cross‑platform testing of native, hybrid, and mobile web apps by abstracting device interactions through third‑party engines, WebDriver API, sessions, and desired capabilities, and includes practical code examples.
AppiumDesired CapabilitiesMobile Automation
0 likes · 5 min read

This article introduces Nightwatch.js, a Node.js‑based end‑to‑end testing framework for web and app testing, explains why the author switched from Java‑Selenium‑TestNG to Nightwatch.js, and outlines its key features such as simple syntax, built‑in runner, Selenium integration, cloud support, CI reporting, and extensibility.
E2E testingJavaScriptNightwatch.js
0 likes · 3 min read


DevOpsApr 20, 2017 · Mobile Development
The article examines the difficulties of iOS automation testing for large-scale mobile applications, such as long feedback cycles, simulator limitations, and multi‑app scenarios, and proposes solutions using private Apple APIs, xcodebuild, and curl‑driven WebDriverAgent commands to overcome Instrument singleton constraints and improve test efficiency.
AppiumSimulatorTesting Framework
0 likes · 9 min read
