Which testing frameworks does this skill support?

While many examples focus on TypeScript and Vitest/Jest, the underlying patterns for async handling and environment mocking are applicable to most modern testing frameworks.

How does Flaky-Fix identify what to repair?

It uses a combination of pattern matching and AST analysis to detect common flaky behaviors such as hardcoded sleeps, unawaited promises, or the use of real system time in assertions.

Is it safe to let the AI auto-fix my test files?

Flaky-Fix categorizes fixes into 'Safe to Auto-Fix' (high-confidence patterns like mocking Date.now) and 'Requires Review' (complex architectural changes), ensuring you maintain control over sensitive logic.

Why should I fix flaky tests instead of just using retries?

Test retries hide technical debt and increase CI costs; Flaky-Fix addresses the root cause to make your test suite deterministic, leading to faster and more trustworthy build signals.

Flaky Test Auto-Fixer

Name: Flaky Test Auto-Fixer
Author: jmagly

byjmagly

•

Seguridad y Pruebas

Automatically identifies and repairs unreliable tests by applying deterministic patterns and resolving async race conditions.

The Flaky-Fix skill enhances Claude Code's ability to stabilize CI/CD pipelines by addressing the root causes of non-deterministic tests. Leveraging research-backed patterns from Google and the FlakyFix study, it detects common issues like timing dependencies, unawaited promises, and shared state, then suggests or auto-applies code repairs. This skill is essential for developers looking to reduce false-positive build failures and improve test suite reliability without manual, trial-and-error debugging.

Características Principales

01Automated repair of timing-dependent tests using system time mocking

02Detection and fixing of async race conditions and missing await statements

03Batch processing with safety-gated auto-fix capabilities for high-confidence patterns

0467 GitHub stars

05Isolation of shared test state to prevent order-dependency failures

06Deterministic mocking of non-deterministic values like UUIDs and random numbers

Casos de Uso

01Fixing intermittent CI/CD failures that disrupt deployment pipelines

02Automating the cleanup of technical debt related to flaky unit and integration tests

03Improving test suite reliability during large-scale migrations or refactors

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jmagly/ai-writing-guide flaky-fix

For use in Claude.ai and ChatGPT

Download Skill