Validate Test Reality

概要

Acts as a meta-validation layer to ensure software reliability beyond basic specification compliance by bridging the gap between theoretical requirements and production reality. It systematically generates over 50 edge cases across categories like data integrity, concurrency, and system failures to stress-test existing designs. By analyzing current test coverage against these generated scenarios, the skill identifies 'reality gaps' where specifications assume ideal conditions that production environments rarely meet. The process culminates in a comprehensive deficiency report with actionable recommendations, ensuring features are hardened against security vulnerabilities and performance degradation before reaching the quality gate.

主な機能

• Analyzes existing test designs to calculate overall reality coverage percentages
• Identifies specification-reality mismatches where claims fail under production conditions
• Generates 50+ edge cases across six categories including Data, Concurrency, and Security
• Detects critical system failure scenarios like API timeouts and database connection losses
• Produces detailed test deficiency reports for quality gate review and approval
• 1 GitHub stars

ユースケース

• Validating test designs for high-risk features with unpredictable user inputs or external API dependencies
• Hardening brownfield codebases by comparing existing tests against known production failure patterns
• Ensuring production resilience for features requiring high concurrency or specific security hardening