YouZan Middleware Testing Team: Quality Assurance System and Testing Efficiency Practices

This article introduces the quality assurance system and testing efficiency practices of YouZan's middleware testing team. The team is organized into six groups: Transaction, Marketing, User Empowerment, Product Big Data, Base Insurance Tools, and Stability.

Quality Assurance System:

1. Requirements Phase: Testing left-shift approach with joint reviews by development, testing, and product teams. Testers participate in technical reviews to identify design and testability issues early.

2. Development Phase: Smoke test cases are provided for developers to execute before code submission. This reduces test roundtrips and helps developers understand what to test. Static code scanning and unit test requirements are enforced for core applications.

3. Testing Phase: With over 10,000 test cases, automation is essential. The team implements multi-dimensional integration testing including business orchestration layer testing via integration tests and monitoring systems. UI automation covers core scenarios for stable business lines. Specialized testing includes exception testing, performance testing, security testing, and compatibility testing.

4. Release Phase: Multiple release processes are offered (Express, SOA Merge, Iron Bus). The bus system consolidates multiple changes for combined testing, improving quality and saving resources. Gray release is supported with traffic control by percentage or store ID. Traffic replay platform compares pre-production responses with production responses.

5. Go-live Phase: Quality protection through online business monitoring and probing systems. Scene-based online probing can detect issues even in low-traffic scenarios.

Testing Efficiency Tools:

1. Testing Platform: Includes Data Factory, Test Case Platform, Mock Factory, Cloud Testing Platform, and Test Reporting.

2. Chaos Engineering: Improves system resilience by designing and executing experiments to discover potential issues in complex distributed systems.

3. Continuous Delivery: Deep integration of quality assurance strategies throughout the pipeline.

4. Bus System: Consolidates multi-person changes for efficient release and testing, integrated with automation test results.

5. Online Probing System: Real-time quality monitoring in production.

6. Performance Testing Platform: Supports single-interface and full-link pressure testing with automatic report generation.

7. Metrics Platform: Analyzes project process, quality data, and post-launch performance metrics.

8. Coverage and Precision Testing: Uses JaCoCo for incremental code coverage calculation and precise impact analysis based on code changes.