Can it detect flaky tests?

Yes, it analyzes CI history and current test outputs to distinguish between genuine logic failures and intermittent environmental issues, helping to restore trust in your test suite.

How does Test Analyzer capture screenshots?

It uses native tools like xcrun simctl for iOS, adb for Android, and Playwright for Vercel web previews to capture actual rendered states across different devices and breakpoints.

Which test frameworks are supported?

The skill is optimized for Jest (unit/integration), Detox (mobile E2E), Playwright (web), and Deno test runners for Supabase Edge Functions.

Does it integrate with GitHub Actions?

Yes, it can use the GitHub CLI to pull workflow run logs and analyze the status of CI/CD pipelines to provide context for its quality analysis.

What is included in the output report?

You receive an executive summary, pass rates, coverage metrics, a visual evidence gallery, and a data-backed release recommendation (Go/No-Go).

Test Analyzer & Visual QA

Name: Test Analyzer & Visual QA
Author: coreymaypray

bycoreymaypray

0•

Security & Testing

Conducts comprehensive quality audits by combining automated test results analysis with visual evidence collection across mobile and web platforms.

Test Analyzer is a specialized quality intelligence tool that bridges the gap between raw test data and visual reality. It goes beyond simple pass/fail metrics by capturing screenshots from Expo simulators, Android emulators, and Vercel previews while simultaneously parsing Jest, Detox, and Deno test outputs. By identifying failure patterns, assessing coverage gaps, and verifying spec compliance through visual proof, it provides a brutally honest 'go/no-go' recommendation for releases, ensuring that passing tests actually reflect a working user interface.

Key Features

01Unified 'go/no-go' reports with evidence-backed quality verdicts

020 GitHub stars

03Visual spec compliance verification and regression detection

04CI failure investigation and flaky test pattern recognition

05Cross-platform screenshot capture for iOS, Android, and Web

06Automated parsing and categorization of Jest and Detox test outputs

Use Cases

01Investigating complex CI/CD pipeline failures and flaky test suites

02Pre-release quality audits for mobile and web applications

03Validating UI/UX implementation against design specifications

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add coreymaypray/sloth-skill-tree test-analyzer

For use in Claude.ai and ChatGPT

Key Features

01Unified 'go/no-go' reports with evidence-backed quality verdicts

020 GitHub stars

03Visual spec compliance verification and regression detection

04CI failure investigation and flaky test pattern recognition

05Cross-platform screenshot capture for iOS, Android, and Web

06Automated parsing and categorization of Jest and Detox test outputs

Use Cases

01Investigating complex CI/CD pipeline failures and flaky test suites

02Pre-release quality audits for mobile and web applications

03Validating UI/UX implementation against design specifications

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add coreymaypray/sloth-skill-tree test-analyzer

For use in Claude.ai and ChatGPT