Can I use this for existing projects?

Yes, you can define evals for existing features to create a safety net of regression tests before starting new development or refactoring.

What is eval-driven development (EDD)?

EDD is a workflow where you define specific capability and regression criteria during development, using automated evaluations to measure progress and ensure software reliability.

What metrics does this skill track?

It tracks pass@n (success rate over multiple attempts) for new capabilities and pass^n (consistency requirements) for regression tests to ensure maximum stability.

Where are the evaluation definitions stored?

All eval definitions and execution logs are stored locally in your project's .claude/evals/ directory for easy version control and reference.

Eval Workflow Manager

Name: Eval Workflow Manager
Author: Eotel

byEotel

0•

Security & Testing

Manages a structured eval-driven development workflow to verify feature capabilities and prevent regressions through automated checks.

The Eval Workflow Manager implements an evaluation-driven development (EDD) framework directly within Claude Code, providing a systematic approach to software quality. It allows developers to define rigorous success criteria for new features, execute automated capability checks, and perform regression testing to ensure system stability. By tracking advanced metrics like pass@n rates and generating detailed execution reports with actionable recommendations, this skill helps developers maintain high reliability and confidence when building complex software with AI assistance.

Key Features

01Historical log management for auditing development progress

02Automated capability and regression testing workflows

03Standardized eval definition templates for feature verification

040 GitHub stars

05Metric tracking for pass@n and pass^n success criteria

06Comprehensive reporting with ship vs. needs-work recommendations

Use Cases

01Verifying new AI-generated features against specific functional criteria

02Running automated regression suites during complex code refactoring

03Generating objective quality reports for code reviews and releases

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add eotel/claude-marketplace eval

For use in Claude.ai and ChatGPT

Download Skill