Test Effectiveness Auditor

关于

The Test Effectiveness Auditor is a sophisticated skill designed to look beyond surface-level code coverage to assess the actual value of a test suite. It adopts a skeptical SRE mindset—assuming tests are flawed until proven otherwise—to identify tautological tests, 'line hitters' that lack assertions, and tests that mock production logic to the point of uselessness. By enforcing a strict 'read production code first' protocol, it categorizes tests into a RED/YELLOW/GREEN hierarchy and automatically generates a prioritized improvement plan integrated with 'bd' task tracking and SRE-level refinement.

主要功能

• Mandatory production code path tracing for behavior validation
• Skeptical RED/YELLOW/GREEN test categorization framework
• Automated 'bd' epic creation with SRE-refined improvement tasks
• Support for mutation testing validation (Pitest, Stryker, Mutmut)
• 24 GitHub stars
• Detection of tautological and 'mock-testing-mock' patterns

使用场景

• Onboarding to a new repository to quickly assess and prioritize test suite improvements
• Auditing a legacy codebase to find tests providing false confidence before a major refactor
• Investigating why production bugs persist despite high reported code coverage metrics