Can this skill automatically fix my broken tests?

It identifies 'auto-fixable' issues such as selector changes or timeout adjustments and provides the specific code updates needed, which can then be applied by a developer or an orchestrator.

How does the skill distinguish between a bug and a code issue?

The skill analyzes 'Expected vs Actual' results, checks if similar tests pass, and examines error types like TimeoutError versus AssertionError to determine if the failure is a functional defect or a script maintenance issue.

Does it integrate with project management tools?

Yes, it generates structured JIRA ticket suggestions including titles, detailed descriptions, and severity levels, which can be used to report bugs directly to development teams.

What files does the analyzer need to work?

It typically processes test result JSON files, the original test Python scripts, error logs, and any available screenshots from the failure point.

Automated Test Failure Analyzer

Name: Automated Test Failure Analyzer
Author: MediSolveAIDev

byMediSolveAIDev

0•

安全与测试

Analyzes and categorizes automated test failures to identify root causes, distinguish bugs from flaky tests, and suggest remediations.

The Automated Test Failure Analyzer is a specialized diagnostic agent designed for QA and DevOps workflows. It processes test results, error logs, and screenshots to intelligently classify failures into four key categories: code issues, actual software bugs, environment instability, or outdated test cases. By providing structured JSON reports with evidence-based reasoning, it helps teams prioritize critical regressions, identify auto-fixable selector changes, and generate JIRA ticket drafts for confirmed defects, significantly reducing the manual effort involved in test triage.

主要功能

01Root cause analysis based on logs, screenshots, and test code

02Intelligent failure categorization (Bug, Code, Environment, or TC Error)

03Automated JIRA ticket generation for confirmed software defects

04Identification of auto-fixable issues like selector and timeout updates

050 GitHub stars

06Structured JSON output for seamless CI/CD orchestration integration

使用场景

01Triaging large batches of failures after nightly CI/CD pipeline runs

02Streamlining the update of test scripts following UI or selector changes

03Distinguishing between genuine regressions and flaky environmental issues

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add medisolveaidev/qa-medi-plugin analyze-fail

For use in Claude.ai and ChatGPT

主要功能

01Root cause analysis based on logs, screenshots, and test code

02Intelligent failure categorization (Bug, Code, Environment, or TC Error)

03Automated JIRA ticket generation for confirmed software defects

04Identification of auto-fixable issues like selector and timeout updates

050 GitHub stars

06Structured JSON output for seamless CI/CD orchestration integration

使用场景

01Triaging large batches of failures after nightly CI/CD pipeline runs

02Streamlining the update of test scripts following UI or selector changes

03Distinguishing between genuine regressions and flaky environmental issues

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add medisolveaidev/qa-medi-plugin analyze-fail

For use in Claude.ai and ChatGPT