Which testing frameworks does this skill support?

While many examples focus on TypeScript and Vitest/Jest, the underlying patterns for async handling and environment mocking are applicable to most modern testing frameworks.

How does Flaky-Fix identify what to repair?

It uses a combination of pattern matching and AST analysis to detect common flaky behaviors such as hardcoded sleeps, unawaited promises, or the use of real system time in assertions.

Is it safe to let the AI auto-fix my test files?

Flaky-Fix categorizes fixes into 'Safe to Auto-Fix' (high-confidence patterns like mocking Date.now) and 'Requires Review' (complex architectural changes), ensuring you maintain control over sensitive logic.

Why should I fix flaky tests instead of just using retries?

Test retries hide technical debt and increase CI costs; Flaky-Fix addresses the root cause to make your test suite deterministic, leading to faster and more trustworthy build signals.

Flaky Test Auto-Fixer

Name: Flaky Test Auto-Fixer
Author: jmagly

byjmagly

•

Security & Testing

Automatically identifies and repairs unreliable tests by applying deterministic patterns and resolving async race conditions.

About

The Flaky-Fix skill enhances Claude Code's ability to stabilize CI/CD pipelines by addressing the root causes of non-deterministic tests. Leveraging research-backed patterns from Google and the FlakyFix study, it detects common issues like timing dependencies, unawaited promises, and shared state, then suggests or auto-applies code repairs. This skill is essential for developers looking to reduce false-positive build failures and improve test suite reliability without manual, trial-and-error debugging.

Key Features

Automated repair of timing-dependent tests using system time mocking
Detection and fixing of async race conditions and missing await statements
Batch processing with safety-gated auto-fix capabilities for high-confidence patterns
67 GitHub stars
Isolation of shared test state to prevent order-dependency failures
Deterministic mocking of non-deterministic values like UUIDs and random numbers

Use Cases

Fixing intermittent CI/CD failures that disrupt deployment pipelines
Automating the cleanup of technical debt related to flaky unit and integration tests
Improving test suite reliability during large-scale migrations or refactors

About

Key Features

Automated repair of timing-dependent tests using system time mocking
Detection and fixing of async race conditions and missing await statements
Batch processing with safety-gated auto-fix capabilities for high-confidence patterns
67 GitHub stars
Isolation of shared test state to prevent order-dependency failures
Deterministic mocking of non-deterministic values like UUIDs and random numbers

Use Cases

Fixing intermittent CI/CD failures that disrupt deployment pipelines
Automating the cleanup of technical debt related to flaky unit and integration tests
Improving test suite reliability during large-scale migrations or refactors