How does it ensure the fix actually worked?

The skill requires a verification step where the fixed test must pass 10 consecutive times before the task is considered complete.

How does this skill handle flaky tests that pass intermittently?

It employs a 'burn-in' strategy, running specific tests up to 20 times or under parallel stress to force the intermittent failure to surface for analysis.

What categories of test failures does the skill recognize?

The skill uses a taxonomy that classifies errors into Timing/Async, Test Isolation, Environment, or Infrastructure issues to apply the most effective fix.

Does it provide code fixes or just diagnosis?

It provides both. The skill analyzes the root cause and then generates a specific code diff to apply the fix, such as replacing timeouts with web-first assertions.

Can it help with tests that only fail in CI environments?

Yes, it provides steps for comparing CI traces against local runs and suggests fixes for environment-specific issues like viewport sizes or font rendering.

Playwright Test Fixer

Name: Playwright Test Fixer
Author: oabdelmaksoud

byoabdelmaksoud

0•

Security & Testing

Diagnoses and repairs failing or flaky Playwright end-to-end tests using a systematic debugging taxonomy.

The Playwright Test Fixer skill provides a rigorous framework for Claude to identify, reproduce, and resolve issues in web automation suites. By categorizing failures into specific domains—Timing/Async, Test Isolation, Environment, or Infrastructure—it moves beyond guesswork to provide targeted architectural fixes. This skill is particularly effective for eliminating 'flaky' tests by utilizing burn-in reproduction techniques and verifying stability through repeated success runs, ensuring your CI/CD pipeline remains green and reliable.

Key Features

01Rigorous post-fix verification requiring 10/10 consecutive passing runs

02Deep trace file analysis and Playwright-specific debugging commands

030 GitHub stars

04Systematic failure categorization using a specialized testing taxonomy

05Implementation of web-first assertions to resolve asynchronous timing issues

06Automated reproduction of flaky tests via multi-run burn-in cycles

Use Cases

01Refactoring legacy Playwright tests to eliminate brittle waitForTimeout calls

02Debugging intermittent CI pipeline failures that pass locally

03Resolving test isolation issues caused by shared state or database leaks

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add oabdelmaksoud/agention fix

For use in Claude.ai and ChatGPT