Skip to content
Tagged articles

regression testing

86 articles · Page 1 of 1
Data Bricklaying Diary
Data Bricklaying Diary
Nov 16, 2026 · R&D Management

AI Says 'Done' — Why It's Not Ready: Iterating from 0.1 to 1.0 with Human Feedback

The article describes an iterative AI-assisted development workflow where the first version (0.1) is tested and refined through human feedback and regression testing to reach agreed requirements (1.0), emphasizing distinguishing missed requirements from new ones, preserving working features, and measuring effort until the product is truly usable, not just when the agent declares completion.

AI-assisted developmentAgentcost estimation
0 likes · 12 min read
AI Says 'Done' — Why It's Not Ready: Iterating from 0.1 to 1.0 with Human Feedback
DataFunTalk
DataFunTalk
Nov 4, 2026 · Artificial Intelligence

How 1688 Built a Self-Correcting Agent Evaluation System with Dual-Track Testing

Alibaba's 1683 shares its production-grade Agent evaluation framework combining offline golden sets with online log sampling, using Task×Trial×Trace×Outcome decomposition, executable Rubrics with deterministic gates, LLM Judges constrained by evidence citations and rule-based scoring, and a closed loop that routes failures to targeted fixes and regression testing.

AI AgentAgent EvaluationDual-Track Evaluation
0 likes · 20 min read
How 1688 Built a Self-Correcting Agent Evaluation System with Dual-Track Testing
Xiaolin Talks Programming
Xiaolin Talks Programming
Nov 3, 2026 · Backend Development

Building a Traffic Recording & Replay Platform with Spring Boot: Shadow Traffic, Structured Diff & Regression Validation for System Rewrites

This article details a production-grade traffic recording and replay platform built with Spring Boot, covering five-module architecture, deterministic desensitization, shadow database isolation, structured JSON diff with ignore rules, and CI/CD gate integration to validate system rewrites against real traffic.

CI/CD IntegrationShadow TrafficStructured Diff
0 likes · 38 min read
Building a Traffic Recording & Replay Platform with Spring Boot: Shadow Traffic, Structured Diff & Regression Validation for System Rewrites
Data Bricklaying Diary
Data Bricklaying Diary
Oct 20, 2026 · Backend Development

Before AI Refactors Legacy Code: Lock Down These Behaviors First

The article outlines a safe approach for AI-assisted legacy refactoring: define behavioral baselines with stakeholders, capture repeatable test samples covering normal and edge cases, compare old and new outputs in isolation, refactor incrementally with continuous regression, and verify rollback compatibility for data and interfaces.

AI refactoringDanilo SatoMartin Fowler
0 likes · 10 min read
Before AI Refactors Legacy Code: Lock Down These Behaviors First
Data Bricklaying Diary
Data Bricklaying Diary
Oct 17, 2026 · Artificial Intelligence

Agent Calls Succeed But Answers Fail: Tracing Observability to Quality Evaluation

The article explains how successful Agent execution traces can still produce wrong answers, using a procurement case where an Agent cited an outdated contract attachment. It details a systematic approach: trace errors through observability across indexing, retrieval, context assembly, and generation; convert feedback into reproducible test samples with versioned inputs and expected behaviors; evaluate using rule-based checks, model-assisted judging, and human review; separate critical error categories instead of relying on a single score; maintain regression suites with both failure and success cases; and rerun tests in isolated environments while recording versions to distinguish new results from original incidents.

Agent EvaluationObservabilityRetrieval-Augmented Generation
0 likes · 15 min read
Agent Calls Succeed But Answers Fail: Tracing Observability to Quality Evaluation
Test Development Learning Exchange
Test Development Learning Exchange
Oct 14, 2026 · Artificial Intelligence

Agent Testing Guide: From Correct Answers to Correct Actions

This guide presents a comprehensive quality assurance framework for AI agent systems, covering tool call correctness, boundary behavior control, trajectory-level assertions, regression testing, chaos engineering, and CI/CD integration using tools like AgentVal, dryfire, tooltangle, and probe-ai.

AI agentsAI safetyAgent Testing
0 likes · 29 min read
Agent Testing Guide: From Correct Answers to Correct Actions
IT Architects Alliance
IT Architects Alliance
Oct 14, 2026 · Artificial Intelligence

Why Claude Code Still Runs npm After You Switched to pnpm: The Memory Invalidation Problem

This article analyzes why AI coding agents like Claude Code persistently execute outdated build commands despite updated rules, tracing how manual rules and automatic memory enter context, and proposes a governance framework with invalidation conditions, execution guards, and cross-session regression tests to keep memory aligned with current code.

AI agent memoryClaude CodePreToolUse
0 likes · 15 min read
Why Claude Code Still Runs npm After You Switched to pnpm: The Memory Invalidation Problem
Data Bricklaying Diary
Data Bricklaying Diary
Oct 12, 2026 · Artificial Intelligence

Agent Observability: Correlating Model, Tools, and Business Receipts to Verify Task Completion

This article argues that Agent observability must go beyond traditional microservice tracing by correlating model calls, retrieval, tool invocations, and control-plane events to task-level identifiers, tracking phases, waits, costs, evidence, and versions, and verifying outcomes with reliable business receipts rather than relying solely on API success metrics.

AI EngineeringAgent ObservabilityOpenTelemetry
0 likes · 14 min read
Agent Observability: Correlating Model, Tools, and Business Receipts to Verify Task Completion
ThinkingAgent
ThinkingAgent
Oct 8, 2026 · Artificial Intelligence

No Evals, No Production Agents: The 4-Layer Evaluation Framework

This article presents a comprehensive four-layer evaluation framework for production-grade AI agents—Model, Component, Trajectory, and Outcome Eval—along with three dataset types (Golden, Edge Case, Adversarial), three evaluation methods (Rule-based, LLM-as-Judge, Human), seven key metrics, regression automation, and a production-to-eval flywheel, illustrated with a customer-service refund agent case study.

AI agent evaluationAgent ObservabilityAgent Security
0 likes · 36 min read
No Evals, No Production Agents: The 4-Layer Evaluation Framework
Data Bricklaying Diary
Data Bricklaying Diary
Oct 8, 2026 · Databases

Master Data Aligned but Reports Wrong? The Three-Layer Fix: Identity, History, Query Logic

The article explains why unified equipment codes still cause report errors due to missing temporal equipment-workstation relationships, and outlines a three-layer diagnostic (identity alignment, historical relationships, query semantics) advocating reuse of existing master data and history tables, complemented by ontology for shared semantics, with regression testing to verify fixes.

Master DataSCD Type 2data governance
0 likes · 14 min read
Master Data Aligned but Reports Wrong? The Three-Layer Fix: Identity, History, Query Logic
Tencent Technical Engineering
Tencent Technical Engineering
Sep 23, 2026 · Operations

How an AI Agent Cuts Error Code Triage from Hours to Minutes: Three Practices

This article details how an AI Agent on an orchestration platform automates error code root cause analysis by integrating knowledge bases, code graphs, observability data, and code hosting platforms, achieving 88% consistency with human annotations and zero hard conflicts across 50 test cases through a five-step investigation workflow, dual-path JSON parsing, and regression-tested prompt optimization.

AI AgentAgent orchestrationError Code Troubleshooting
0 likes · 26 min read
How an AI Agent Cuts Error Code Triage from Hours to Minutes: Three Practices
Tech Musings
Tech Musings
Sep 16, 2026 · Backend Development

FileMagic IOException on Excel Upload: The FileInputStream mark/reset Pitfall

FileMagic validation throws IOException on real Excel uploads because Tomcat's default FileInputStream lacks mark/reset support, unlike test ByteArrayInputStream; wrapping with BufferedInputStream fixes it, and regression tests must simulate real stream types to catch this.

Apache POIBufferedInputStreamEasyExcel
0 likes · 8 min read
FileMagic IOException on Excel Upload: The FileInputStream mark/reset Pitfall
macrozheng
macrozheng
Sep 16, 2026 · Artificial Intelligence

Alibaba's skill-up: Automated Agent Skill Evaluation & Regression Testing

Alibaba's open-source skill-up tool automates evaluation and regression testing for AI agent skills using declarative YAML, multi-engine replay, and a built-in skill-upper agent that generates test cases, runs them, diagnoses failures, and suggests regression tests — demonstrated by uncovering a hardcoded token limit and logging noise in a vision skill.

AlibabaClaude CodeGo
0 likes · 8 min read
Alibaba's skill-up: Automated Agent Skill Evaluation & Regression Testing
Woodpecker Software Testing
Woodpecker Software Testing
Sep 16, 2026 · R&D Management

How Intelligent Regression Testing Teams Transform from Gatekeepers to Quality Accelerators

This article analyzes why traditional regression testing fails, outlines four core capabilities of intelligent regression testing — smart test generation, adaptive execution, AI-powered root cause analysis, and closed-loop quality insights — and details an organizational transformation from test execution to quality engineering, achieving 11-minute feedback cycles and 2.8x release frequency.

AI in testingDevOpsRoot Cause Analysis
0 likes · 9 min read
How Intelligent Regression Testing Teams Transform from Gatekeepers to Quality Accelerators
Data Bricklaying Diary
Data Bricklaying Diary
Sep 10, 2026 · Backend Development

Terminology Normalization Beyond Similarity: Coverage, Routing, Drift & Regression Testing

This article explains why terminology normalization requires a continuous governance framework covering candidate recall, risk-based routing, manual review, drift attribution, and regression testing — not just similarity scores — and details metrics, routing rules, drift types, acceptance criteria, and a minimum viable loop for production systems.

candidate recalldata governancedrift detection
0 likes · 18 min read
Terminology Normalization Beyond Similarity: Coverage, Routing, Drift & Regression Testing
Woodpecker Software Testing
Woodpecker Software Testing
Sep 9, 2026 · Industry Insights

AI-Powered Regression Testing Tools Compared: Applitools, Testim, Functionize

This article compares Applitools Eyes, Testim.io, and Functionize across AI capabilities, CI/CD integration, and hidden costs using real financial and e-commerce case studies, revealing how each tool's visual AI, self-healing, and test impact analysis reduce regression testing time and maintenance overhead.

AI TestingApplitoolsCI/CD Integration
0 likes · 9 min read
AI-Powered Regression Testing Tools Compared: Applitools, Testim, Functionize
samdeepthink
samdeepthink
Sep 3, 2026 · R&D Management

AI-Generated Code Quality Control: A Spec-Driven Workflow with Automated Skills

The author shares a 15-step AI-assisted workflow for code quality control, starting with spec-driven development, automated skills for code review, regression checks, test data rehearsal, non-functional requirements validation, mandatory manual review, and optional security/extensibility checks, all orchestrated via AI-written skills and git integration.

AI-assisted developmentGit workflowautomated code review
0 likes · 6 min read
AI-Generated Code Quality Control: A Spec-Driven Workflow with Automated Skills
Woodpecker Software Testing
Woodpecker Software Testing
Sep 2, 2026 · Operations

5 Common Pitfalls in Performance Regression Testing

In today’s fast‑paced agile and micro‑service environments, performance regression testing is often treated as optional, leading to severe TPS drops and hidden degradations; this article details five typical misconceptions, backs them with real‑world examples, and offers concrete practices to make performance regression a continuous, cross‑team responsibility.

CI/CDKubernetesObservability
0 likes · 8 min read
5 Common Pitfalls in Performance Regression Testing
Chengwu Tech Stack
Chengwu Tech Stack
Sep 2, 2026 · Artificial Intelligence

Beyond Accuracy: A Four-Layer Framework for Production-Ready AI Evaluation

The article argues that model accuracy alone is insufficient for AI production deployment and proposes a four-layer evaluation framework covering model capability, task contract, system engineering, and business results, along with five balanced metric groups, risk-based test datasets, staged deployment gates, and continuous regression testing.

AI EngineeringAI-evaluationEvaluation Framework
0 likes · 27 min read
Beyond Accuracy: A Four-Layer Framework for Production-Ready AI Evaluation
Wu Shixiong's Large Model Academy
Wu Shixiong's Large Model Academy
Aug 27, 2026 · Artificial Intelligence

Why Agents Refund When Policy Says No: The Retrieval-Enforcement Gap

An AI agent correctly retrieves a 'no refund' policy but still executes a $50 refund, exposing the critical gap between policy retrieval and runtime enforcement; the article argues authorization must be enforced at the tool gateway with bound decisions, not just in model context, and outlines regression tests for deny paths.

AI agentsAgent ArchitectureLLM security
0 likes · 13 min read
Why Agents Refund When Policy Says No: The Retrieval-Enforcement Gap
Data Bricklaying Diary
Data Bricklaying Diary
Aug 26, 2026 · Artificial Intelligence

AI Evaluation Sets ≠ Training Holdouts: Golden Data, Hard Cases, Contamination & Regression

This article explains why enterprise AI evaluation requires purpose-built datasets — golden baselines, challenge cases, red-team tests, regression suites, and online replays — designed from capability questions, risk lists, and real failures, with structured answers, contamination governance, tiered LLM judging, and version-locked regression pipelines gated by risk-based release thresholds.

AI-evaluationLLM-as-a-Judgechallenge set
0 likes · 24 min read
AI Evaluation Sets ≠ Training Holdouts: Golden Data, Hard Cases, Contamination & Regression
FunTester
FunTester
Aug 10, 2026 · Operations

How Automated Testing Can Safeguard AI-Generated Code Quality

As AI accelerates code production, the article argues that relying solely on manual code reviews is insufficient and outlines how layered automated regression testing, integrated into CI, provides repeatable evidence to verify real‑world behavior, reduce risk, and build sustainable quality confidence.

AI codeCI/CDautomated testing
0 likes · 11 min read
How Automated Testing Can Safeguard AI-Generated Code Quality
Chengwu Tech Stack
Chengwu Tech Stack
Aug 7, 2026 · R&D Management

Beyond 'Tests Passed': A Four-Layer Acceptance Framework for AI-Generated Code

This article argues that AI-generated code passing tests is insufficient for delivery, proposing a four-layer acceptance framework—functional, regression, risk, and business verification—backed by a six-part evidence chain and risk-based quality gates to ensure reliable, auditable software releases.

AI-assisted developmentAcceptance Testingdelivery checklist
0 likes · 19 min read
Beyond 'Tests Passed': A Four-Layer Acceptance Framework for AI-Generated Code
Wu Shixiong's Large Model Academy
Wu Shixiong's Large Model Academy
Aug 5, 2026 · Artificial Intelligence

Detecting False Promises in Customer Service Agents: Can a Large Model Score Their Claims?

The article analyzes a deterministic rule called false_promise that flags agent replies claiming completed actions without corresponding tool calls, explains how tense affects verification, proposes a four‑step “claim‑check” process, and shows how scoring caps and regression samples expose both true violations and false‑positive edge cases.

Agent VerificationCustomer ServiceReinforcement Learning
0 likes · 10 min read
Detecting False Promises in Customer Service Agents: Can a Large Model Score Their Claims?
Qunhe Technology Quality Tech
Qunhe Technology Quality Tech
Jul 31, 2026 · Artificial Intelligence

Why 3DGS Reconstructions Fail and How a Practical QA Pipeline Fixes Them

3D Gaussian Splatting (3DGS) lacks standard benchmarks and relies on subjective visual checks, making quality assurance difficult; this article details a comprehensive, automated QA framework that evaluates input via COLMAP scores, quantifies training results with PSNR/SSIM/LPIPS, conducts subjective visual inspections, and integrates both stages into a regression pipeline to ensure reliable, scalable reconstructions.

3DGSComputer VisionNeural Rendering
0 likes · 13 min read
Why 3DGS Reconstructions Fail and How a Practical QA Pipeline Fixes Them
FunTester
FunTester
Jul 7, 2026 · Operations

When AI Accelerates Coding, How Should Regression Testing Keep Pace?

The article explains that AI‑generated code may pass isolated checks but fail in real system contexts, urging teams to strengthen regression testing with production‑driven scenarios, integration focus, continuous coverage updates, and feedback loops to prevent speed from amplifying hidden defects.

AI code generationintegration testingmock drift
0 likes · 9 min read
When AI Accelerates Coding, How Should Regression Testing Keep Pace?
Architect
Architect
Jun 16, 2026 · Artificial Intelligence

Can Agents Self‑Improve Their Harness? Designing a Self‑Harness Architecture

The article presents Self‑Harness, an engineering‑focused framework that lets AI agents analyze their execution traces, propose limited harness edits, and retain only those changes that pass regression tests, demonstrating measurable held‑out pass‑rate gains across three models while emphasizing reliable fact sources and staged adoption.

AI agentsHarness EngineeringLoop Engineering
0 likes · 17 min read
Can Agents Self‑Improve Their Harness? Designing a Self‑Harness Architecture
FunTester
FunTester
May 22, 2026 · Artificial Intelligence

Why Prompt Tuning Isn’t Enough: Building a Test‑Driven Mindset for AI Products

The article argues that while prompt engineering accelerates early AI product development, it cannot guarantee overall quality, and advocates establishing a systematic evaluation pipeline—including curated datasets, clear benchmarks, regression testing, and automated checks—to make AI product quality visible and reliably improve over time.

AI TestingEvaluation PipelinePrompt engineering
0 likes · 16 min read
Why Prompt Tuning Isn’t Enough: Building a Test‑Driven Mindset for AI Products
Woodpecker Software Testing
Woodpecker Software Testing
Apr 30, 2026 · Operations

Intelligent Regression Testing: Practical Strategies Every Test Engineer Should Know

The article shows how data‑driven, AI‑enhanced regression testing—using impact graphs, adaptive scheduling, and root‑cause inference—can cut execution time, reduce failure analysis from minutes to seconds, and boost test ROI, illustrated with real‑world cases from e‑commerce, finance, IoT and SaaS platforms.

AI TestingTest Automationadaptive scheduling
0 likes · 8 min read
Intelligent Regression Testing: Practical Strategies Every Test Engineer Should Know
AI Tech Publishing
AI Tech Publishing
Apr 27, 2026 · Artificial Intelligence

Why Build Your Own AI Evaluation Harness? 7 OpenAI‑Inspired Recommendations

The article explains why generic AI testing platforms fall short, outlines how to design a testable AI system from day one, and presents seven practical recommendations—from using Codex or Claude Code to manage regression and iteration test sets, to leveraging entropy diagnostics and custom domain‑expert UX.

AI-evaluationEvaluation FrameworkOpenAI
0 likes · 8 min read
Why Build Your Own AI Evaluation Harness? 7 OpenAI‑Inspired Recommendations
Woodpecker Software Testing
Woodpecker Software Testing
Apr 20, 2026 · Artificial Intelligence

How AI Transforms Regression Testing: Three Real-World Cases

The article examines three concrete AI‑powered regression‑testing implementations—smart test‑case selection, self‑healing UI scripts, and defect‑propensity prediction—showing how they cut execution time, reduce script failures, and lower critical defect escape rates in fast‑paced delivery pipelines.

AI TestingCI/CDTest Automation
0 likes · 6 min read
How AI Transforms Regression Testing: Three Real-World Cases
Woodpecker Software Testing
Woodpecker Software Testing
Apr 5, 2026 · Operations

Intelligent Regression Testing: Why the Future Is Already Here

With code commits becoming a heartbeat, traditional regression testing lags behind; this article defines true intelligent regression testing as a closed‑loop system of perception, reasoning, execution and feedback, presents real‑world case studies, three practical pillars, common pitfalls, and a vision for risk‑driven, self‑healing quality assurance.

AICI/CDDevOps
0 likes · 8 min read
Intelligent Regression Testing: Why the Future Is Already Here
Woodpecker Software Testing
Woodpecker Software Testing
Apr 3, 2026 · Artificial Intelligence

How Intelligent AI‑Driven Regression Testing Overcomes Traditional Limits and Cuts Test Time by Up to 60%

The article explains why static regression strategies miss defects and waste resources, then details three AI‑powered techniques—Change Impact Graphs, dynamic test‑case weighting, and self‑healing scripts—backed by real‑world case studies and a practical adoption roadmap.

AI TestingTest Case Prioritizationchange impact analysis
0 likes · 8 min read
How Intelligent AI‑Driven Regression Testing Overcomes Traditional Limits and Cuts Test Time by Up to 60%
Woodpecker Software Testing
Woodpecker Software Testing
Apr 3, 2026 · Operations

Intelligent Regression Testing vs Traditional: How AI Turns Tests into Efficiency Accelerators

The article contrasts rule‑driven traditional regression testing with AI‑enabled semantic testing, showing how intelligent regression reduces test cycles, improves stability by up to 3.2×, cuts execution time to 22% of the original, and creates a self‑healing maintenance loop, backed by data from Tricentis, GitLab and Microsoft.

AI TestingCI/CDTest Automation
0 likes · 7 min read
Intelligent Regression Testing vs Traditional: How AI Turns Tests into Efficiency Accelerators
Lao Guo's Learning Space
Lao Guo's Learning Space
Apr 2, 2026 · Operations

Build an OpenClaw Test Bot in Four Steps: Cut Web Regression from Hours to 22 Minutes

The article walks through why manual web regression testing is painful, introduces OpenClaw as an AI‑driven automation platform, and details a four‑step process—defining tasks, configuring browsers, designing logic, and scheduling runs—that reduced a multi‑hour manual test suite to just 22 minutes while highlighting real‑world results and common pitfalls.

AI AgentOpenClawWeb Testing
0 likes · 12 min read
Build an OpenClaw Test Bot in Four Steps: Cut Web Regression from Hours to 22 Minutes
Woodpecker Software Testing
Woodpecker Software Testing
Mar 5, 2026 · Artificial Intelligence

How AI Is Transforming Regression Testing: Current Practices and Future Outlook

The article examines how AI-driven techniques are reshaping regression testing—from intelligent test case selection and self‑healing UI scripts to root‑cause analysis and risk prediction—illustrating real‑world results from fintech, automotive, and government projects and outlining the next three years of evolution.

AIRoot Cause AnalysisSelf-Healing UI
0 likes · 7 min read
How AI Is Transforming Regression Testing: Current Practices and Future Outlook
Woodpecker Software Testing
Woodpecker Software Testing
Mar 2, 2026 · Industry Insights

5 Smart Regression Testing Tools Compared: Essential Insights for Test Experts

Amid accelerating continuous delivery cycles, the article evaluates five AI‑enhanced regression testing tools—Sauce Labs, Applitools, Mabl, Testim.io, and Katalon Studio—by examining their UI change resilience, smart test‑case selection, low‑code versus deep engineering capabilities, CI/CD integration, and provides guidance on optimal tool combinations for different testing needs.

AI Testing ToolsCI/CD IntegrationTest Automation
0 likes · 7 min read
5 Smart Regression Testing Tools Compared: Essential Insights for Test Experts
Woodpecker Software Testing
Woodpecker Software Testing
Jan 23, 2026 · Fundamentals

Regression Testing: A Crucial Guard for Software Quality

The article explains why regression testing is essential for maintaining software quality amid continuous changes, outlines its various types and selection criteria, discusses common challenges with practical solutions, and presents automation practices, best‑practice guidelines, and emerging trends to help teams build an effective regression testing strategy.

CI/CDregression testingsoftware quality
0 likes · 8 min read
Regression Testing: A Crucial Guard for Software Quality
Test Development Learning Exchange
Test Development Learning Exchange
Dec 5, 2025 · Operations

Why Smart Test Automation Cuts Costs: 4 Proven Strategies & Real Case Study

Amid the push for cost reduction and efficiency, the article argues that test automation is essential, outlines four smart strategies—targeting high‑frequency stable APIs, starting with low‑cost MVPs, integrating with CI/CD, and augmenting manual testing—then presents a case where a two‑person, two‑week effort cut regression effort by 93% and saved over 1,300 person‑hours annually.

CI/CDMVPTest Automation
0 likes · 7 min read
Why Smart Test Automation Cuts Costs: 4 Proven Strategies & Real Case Study
Zhuanzhuan Tech
Zhuanzhuan Tech
Nov 10, 2025 · Artificial Intelligence

Boost Your Development Workflow: Practical Tips for Using Cursor AI

This article shares a step‑by‑step guide on how development teams can leverage the Cursor AI assistant to split project requirements, enrich prompts, generate and review code, and perform regression verification, turning AI into a collaborative partner rather than a replacement.

AI programmingCursor toolPrompt engineering
0 likes · 17 min read
Boost Your Development Workflow: Practical Tips for Using Cursor AI
Test Development Learning Exchange
Test Development Learning Exchange
Sep 2, 2025 · Operations

How to Build a High‑Quality End‑to‑End Testing Process for Reliable Releases

This guide outlines a systematic, shift‑left testing strategy—from early requirement reviews and test‑case design to layered regression automation, rigorous execution, pre‑release quality assessment, and post‑release monitoring—enabling teams to act as effective quality gatekeepers and ensure stable software deliveries.

CI/CDTest Automationquality assurance
0 likes · 7 min read
How to Build a High‑Quality End‑to‑End Testing Process for Reliable Releases
转转QA
转转QA
Jun 6, 2025 · Operations

Boosting Test Efficiency with zzRepeater: Real‑Traffic Replay in Action

The article introduces zzRepeater, a traffic‑replay platform that records and replays real request data to accelerate regression, functional, and performance testing, detailing five practical scenarios where it reduces cost, improves coverage, and streamlines bug verification for QA teams.

QA toolsTraffic Replayperformance testing
0 likes · 9 min read
Boosting Test Efficiency with zzRepeater: Real‑Traffic Replay in Action
DevOps
DevOps
Jun 5, 2025 · Frontend Development

15 Top Visual Regression Testing Tools to Perfect Your UI

This guide reviews 15 visual testing tools—detailing their core features, pros, cons, pricing, and platform support—while offering a six‑point selection framework and answering common FAQs to help teams choose the right solution for reliable UI quality.

UI automationregression testingsoftware testing
0 likes · 12 min read
15 Top Visual Regression Testing Tools to Perfect Your UI
JD Tech Talk
JD Tech Talk
Nov 22, 2024 · Mobile Development

Implementing UI Automation Testing for Auto Insurance Systems Using Playwright

This article discusses implementing UI automation testing for auto insurance systems using Playwright, addressing the challenges of testing multiple insurance providers and demonstrating how automated testing can significantly improve efficiency and reduce manual testing workload.

API TestingAuto Insurance SystemsPlaywright
0 likes · 9 min read
Implementing UI Automation Testing for Auto Insurance Systems Using Playwright
Qunhe Technology Quality Tech
Qunhe Technology Quality Tech
Nov 12, 2024 · Operations

How a Regression Platform Transforms Construction Drawing Testing and Boosts Efficiency

This article details the end‑to‑end workflow of converting 3D design models into 2D construction drawings, explains the platform’s architecture, testing baseline management, automated data collection, regression testing, and visual diff results, and highlights the massive efficiency gains and future automation roadmap.

automationconstruction drawingdata analysis
0 likes · 10 min read
How a Regression Platform Transforms Construction Drawing Testing and Boosts Efficiency
Test Development Learning Exchange
Test Development Learning Exchange
May 30, 2024 · Fundamentals

Guidelines for Determining Effective API Automation Test Coverage

The article outlines practical principles and recommended coverage percentages for functional, boundary, security, performance, regression, integration, data management, and maintainability aspects of API automation testing, explaining why each level of coverage is essential for quality and efficiency.

API Testingperformance testingregression testing
0 likes · 7 min read
Guidelines for Determining Effective API Automation Test Coverage
FunTester
FunTester
Apr 22, 2024 · Fundamentals

How to Build and Evolve an Effective Regression Test Suite

This guide outlines a structured approach to creating, maintaining, and scaling regression test suites, covering test selection criteria, step‑by‑step processes for identifying code changes, choosing relevant tests, balancing suite size, and handling execution results with automation and risk‑based prioritization.

Test Selectionautomationregression testing
0 likes · 19 min read
How to Build and Evolve an Effective Regression Test Suite
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Nov 10, 2023 · Operations

Automated Activity Regression and Configuration Validation for Social Live Streaming

The article describes an automated regression and configuration‑validation platform for social live‑streaming activities that combines task scheduling, Jenkins‑driven test scripts, visual reporting, and a standardized mind‑map configuration system, cutting manual regression time from one day to 0.2 day and alignment effort from 0.5 to 0.1 day.

Configuration ValidationJenkinslive streaming
0 likes · 8 min read
Automated Activity Regression and Configuration Validation for Social Live Streaming
FunTester
FunTester
Sep 25, 2023 · Fundamentals

Balancing Test Automation: When to Automate, What to Automate, and Common Pitfalls

The article examines why software testing inevitably consumes time and resources, explains the limits of both manual and automated testing, outlines scenarios best suited for automation such as regression and performance testing, and warns against unrealistic expectations, unnecessary tests, and security blind spots.

Continuous IntegrationTest Automationregression testing
0 likes · 9 min read
Balancing Test Automation: When to Automate, What to Automate, and Common Pitfalls
政采云技术
政采云技术
Jul 25, 2023 · Industry Insights

Quantifying Test Impact and Automating Regression with Code‑Case Mapping

The article examines common functional testing pain points—such as vague impact assessment, high regression cost, and poor test‑dev collaboration—and proposes a data‑driven solution that builds a code‑to‑test‑case mapping using dynamic call chains, static analysis, and coverage snapshots to enable precise test case recommendation and incremental coverage reporting.

CI/CDcode coveragedynamic tracing
0 likes · 17 min read
Quantifying Test Impact and Automating Regression with Code‑Case Mapping
NetEase Smart Enterprise Tech+
NetEase Smart Enterprise Tech+
May 23, 2023 · Information Security

How to Seamlessly Migrate and Validate Anti‑Cheat Services Across Environments

This article details the end‑to‑end process of migrating an anti‑cheat service to a new data center, verifying strategy effectiveness, building a real‑sample regression pipeline, and automating integration steps using GoAPI and traffic‑comparison platforms to ensure functional consistency and security.

Operationsanti-cheatenvironment migration
0 likes · 9 min read
How to Seamlessly Migrate and Validate Anti‑Cheat Services Across Environments
FunTester
FunTester
Jun 30, 2022 · Fundamentals

When to Automate Tests? Pros, Cons, and Ideal Scenarios Explained

This article explains what automated testing is, why it matters, compares manual and automated testing advantages and disadvantages, identifies modules that are suitable or unsuitable for automation, and provides concrete code examples for implementing and maintaining test scripts.

Test Automationautomated testingmanual testing
0 likes · 8 min read
When to Automate Tests? Pros, Cons, and Ideal Scenarios Explained
Dada Group Technology
Dada Group Technology
Apr 22, 2022 · Industry Insights

How Traffic Replication and Automated Regression Supercharge Test Efficiency

This article examines the challenges of high‑cost test case maintenance and low‑efficiency regression, then details how HTTP and microservice traffic replication, automatic seed case generation, and integrated CI/CD‑driven interface and process automation can dramatically improve testing speed, coverage, and quality.

API TestingCI/CDTest Automation
0 likes · 13 min read
How Traffic Replication and Automated Regression Supercharge Test Efficiency
vivo Internet Technology
vivo Internet Technology
Feb 9, 2022 · Operations

Traffic Recording and Playback: vivo's Moonlight Treasure Box Platform Practice

vivo’s “Moonlight Treasure Box” platform records and replays production traffic using a customized Jvm‑Sandbox‑Repeater Java‑Agent, handling GC limits, thread‑pool tracing, data desensitization, deduplication, timestamp alignment, noise reduction and sub‑call matching, while providing plugins, visual call‑chain analysis and coverage metrics that have integrated 200 services, executed over 10 000 sessions, and boosted testing efficiency by more than 80 %.

Java AgentJvm-SandboxTest Automation
0 likes · 18 min read
Traffic Recording and Playback: vivo's Moonlight Treasure Box Platform Practice
转转QA
转转QA
Aug 13, 2021 · Mobile Development

Implementing UI Automation Regression for Mobile Event Tracking (埋点)

This article details a UI automation regression framework for mobile event tracking, covering background challenges, Android and iOS log collection methods, H5 integration strategies, performance comparisons, and practical recommendations to improve testing efficiency by about 50%.

AndroidUI automationevent tracking
0 likes · 8 min read
Implementing UI Automation Regression for Mobile Event Tracking (埋点)
iQIYI Technical Product Team
iQIYI Technical Product Team
Aug 13, 2021 · Industry Insights

How iQIYI Built a Precise Testing System to Boost Regression Quality and Efficiency

This article details iQIYI's precise testing framework, explaining why traditional regression testing falls short, how a custom code‑coverage tool and knowledge‑base enable fine‑grained test‑case selection across client, server and micro‑service layers, and the measurable impact on test speed and reliability.

Test AutomationTesting Frameworkcode coverage
0 likes · 17 min read
How iQIYI Built a Precise Testing System to Boost Regression Quality and Efficiency
Qunhe Technology Quality Tech
Qunhe Technology Quality Tech
Apr 19, 2021 · Operations

How Mesh Regression Boosts 3D Cloud Design Testing Efficiency

This article explains why mesh regression is needed for 3D cloud design tools, defines mesh, outlines its application scenarios such as BIM plumbing, custom door windows, and hard‑floor tiles, and details a step‑by‑step design, implementation, bug detection methods, performance improvements, and future plans.

3D modelingautomationmesh
0 likes · 8 min read
How Mesh Regression Boosts 3D Cloud Design Testing Efficiency
FunTester
FunTester
Mar 1, 2021 · Fundamentals

Effective Regression Testing Strategies for Agile Development

The article outlines practical methods to optimize regression testing in fast‑paced agile releases, emphasizing test suite separation, priority ranking, automation, risk‑based case classification, smoke testing, integration testing, and long‑term automation investment to maintain both new and existing feature quality.

Test Automationregression testingsoftware quality
0 likes · 5 min read
Effective Regression Testing Strategies for Agile Development
Yanxuan Tech Team
Yanxuan Tech Team
Nov 11, 2020 · Operations

How We Built a Stable Regression Environment for Over 1,000 Services

This article details the challenges, planning, and step‑by‑step execution of creating an isolated regression environment for a large micro‑service platform, covering quantifiable goals, solution evaluation, infrastructure refactoring, data migration, deployment results, and future improvements.

Cloud Migrationenvironment governanceinfrastructure automation
0 likes · 14 min read
How We Built a Stable Regression Environment for Over 1,000 Services
NetEase Yanxuan Technology Product Team
NetEase Yanxuan Technology Product Team
Nov 11, 2020 · Operations

Design and Implementation of a Regression Environment for Yanxuan Offline Systems

To overcome inefficient, unstable offline testing, Yanxuan built an isolated regression environment by provisioning dual cloud‑inside/outside clusters, refactoring infrastructure, deploying roughly 180 core B‑side services, and constructing migration data, achieving over 90 % cloud‑native coverage and enabling stable pre‑release verification with future expansion plans.

Cloud Migrationenvironment governanceregression testing
0 likes · 16 min read
Design and Implementation of a Regression Environment for Yanxuan Offline Systems
FunTester
FunTester
Nov 6, 2020 · Fundamentals

Best Practices for Regression Testing to Reduce Bugs

This article outlines essential regression testing best practices—including ensuring work quality, thorough pre‑testing, effective time management, test case prioritization and classification, team reviews, admission criteria, exploratory testing, and detailed reporting—to help QA teams reduce recurring bugs and maintain high software quality.

QATest Case Prioritizationbug management
0 likes · 9 min read
Best Practices for Regression Testing to Reduce Bugs
FunTester
FunTester
Nov 4, 2020 · Fundamentals

Understanding Regression Bugs and Effective Strategies for Handling Them

The article explains what regression bugs are, why regular regression testing is essential, the challenges they pose such as increased cost and time pressure, and outlines effective handling methods including code reviews, metric monitoring, left‑shift and continuous testing, and automation.

QATest Automationcode review
0 likes · 10 min read
Understanding Regression Bugs and Effective Strategies for Handling Them
FunTester
FunTester
Aug 1, 2020 · Operations

Regression Testing Strategies in Agile and DevOps Environments

This article explains what regression testing is, why it is critical in fast‑paced agile and DevOps workflows, and provides practical strategies, best‑practice recommendations, and checklist items for building and maintaining effective regression test suites.

AgileContinuous IntegrationDevOps
0 likes · 7 min read
Regression Testing Strategies in Agile and DevOps Environments
JD Retail Technology
JD Retail Technology
Jul 9, 2020 · Operations

Moonlight Box: Enabling Fully Automated High‑Coverage Regression Testing with Traffic Recording and Replay

This article introduces the Moonlight Box traffic‑recording and replay platform, explains its core functions and design principles, and presents multiple practical regression‑testing scenarios—including simple forward and reverse read replay, bidirectional replay, write replay, and compatibility adaptation—for both read‑only and write‑heavy interfaces.

Traffic Replayregression testingsoftware testing
0 likes · 10 min read
Moonlight Box: Enabling Fully Automated High‑Coverage Regression Testing with Traffic Recording and Replay
FunTester
FunTester
May 26, 2020 · Fundamentals

The Growing Demand for Test Automation Professionals and How to Prepare

The demand for skilled test automation engineers continues to rise, as companies still rely on manual and exploratory testing while increasingly automating regression, performance, and load tests, making continuous learning essential for a rewarding career in software testing.

Test Automationcareer developmentcontinuous learning
0 likes · 3 min read
The Growing Demand for Test Automation Professionals and How to Prepare
JD Retail Technology
JD Retail Technology
Apr 3, 2020 · Backend Development

Moonlight Box: A Traffic Recording and Replay Platform for Automated Regression Testing

The Moonlight Box (JCASE) platform records production traffic and replays it in test environments to achieve fully automated, high‑coverage regression testing, reducing test data preparation effort and supporting online, offline, stress, and pre‑heat scenarios across large‑scale service architectures.

Test AutomationTraffic Recordingmicroservices
0 likes · 13 min read
Moonlight Box: A Traffic Recording and Replay Platform for Automated Regression Testing
FunTester
FunTester
Feb 9, 2020 · Fundamentals

How to Build an Effective Regression Testing Strategy for Agile Development

The article explains the challenges of balancing sprint development with regression testing in agile projects and provides a step‑by‑step strategy—including information gathering, test scope definition, automation, and prioritization—to create a sustainable regression testing process that maintains quality and speed.

Test Automationagile developmentregression testing
0 likes · 6 min read
How to Build an Effective Regression Testing Strategy for Agile Development
Yanxuan Tech Team
Yanxuan Tech Team
Dec 30, 2019 · Operations

How Diffy Revolutionizes Regression Testing and Cuts Debugging Effort

Diffy, an open‑source regression testing tool from Twitter, compares outputs of candidate, stable, and stable‑copy versions to filter noise, dramatically reducing manual test effort; the article explains its principles, deployment steps, real‑world case studies, optimization tips, and practical considerations for reliable automated testing.

Diffynoise reductionregression testing
0 likes · 14 min read
How Diffy Revolutionizes Regression Testing and Cuts Debugging Effort
FunTester
FunTester
Dec 20, 2019 · Industry Insights

What Keeps Testers Stuck? 10 Common Excuses and How to Overcome Them

The article examines ten frequent excuses testers use to avoid responsibility, explains why each is flawed, and offers practical guidance on adopting a proactive testing mindset, thorough cross‑browser checks, time management, and collaborative problem‑solving to improve software quality.

QAcross-browser testingindustry insights
0 likes · 10 min read
What Keeps Testers Stuck? 10 Common Excuses and How to Overcome Them
FunTester
FunTester
Dec 18, 2019 · Fundamentals

Benefits and Value of Automated Testing

The article outlines the advantages of automated testing—including 24/7 execution, efficient regression, reusability, time and cost savings, early defect detection, reduced manual effort, increased coverage, and monitoring—while acknowledging its limitations and the continued need for manual testing.

Continuous TestingTest Automationautomated testing
0 likes · 9 min read
Benefits and Value of Automated Testing
Youzan Coder
Youzan Coder
May 31, 2019 · Backend Development

Design and Implementation of the Replay Comparison Engine for Automated Service Regression Testing

The Replay Comparison Engine built by Youzan captures live online requests, replays them against a staging environment, automatically compares responses to spot regression errors, and provides a configurable SDK, server and console that dramatically cut testing cost while boosting coverage and efficiency across its SaaS services.

Backendautomationmicroservices
0 likes · 13 min read
Design and Implementation of the Replay Comparison Engine for Automated Service Regression Testing
Xianyu Technology
Xianyu Technology
Mar 19, 2019 · Artificial Intelligence

Page Difference Detection for Automated Regression Testing in Mobile Apps

The paper proposes a method for automated regression testing in mobile apps by detecting page differences via layout segmentation, ORB alignment of scrollable areas, SSIM similarity, and CNN filtering to ignore scroll or cursor changes while highlighting semantic UI changes, demonstrated on the Xianyu app.

CNNORBSSIM
0 likes · 10 min read
Page Difference Detection for Automated Regression Testing in Mobile Apps
转转QA
转转QA
Nov 22, 2018 · Operations

Automated Regression Testing Framework for Activity Pages Using Selenium and ImageDiff

This article presents an automated regression testing solution called “Monitor Dog” that leverages Selenium with headless Chrome to efficiently validate page data and style correctness for numerous promotional activity pages, incorporating image diff analysis, element interaction, and detailed reporting to ensure seamless system updates without impacting user experience.

ImageDiffTesting FrameworkUI automation
0 likes · 10 min read
Automated Regression Testing Framework for Activity Pages Using Selenium and ImageDiff
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 24, 2018 · Operations

Boost Your Team’s Code Velocity: From Commit to Production in Days

This article explains what Code Velocity is, why measuring and improving it matters for rapid business response, the obstacles that slow it down, and four key capabilities—frequent master merges, powerful regression, automated deployment, and breaking large projects into small pieces—that together enable teams to ship code in just a few days.

CI/CDcode velocitygated checkin
0 likes · 16 min read
Boost Your Team’s Code Velocity: From Commit to Production in Days
转转QA
转转QA
May 8, 2018 · Mobile Development

UI Automation Framework Overview and Evolution for Mobile App Testing

This document outlines the background, goals, and detailed architecture of a mobile UI automation framework built on Appium, describing case management, result storage, evolution of element locating and interaction methods, multi‑platform execution strategies, and future enhancements for data collection and CI integration.

AppiumCI integrationUI automation
0 likes · 9 min read
UI Automation Framework Overview and Evolution for Mobile App Testing