Which programming languages and frameworks does it support?

While it can evaluate general testing logic, it provides specialized guidance for Go (table-driven tests), Playwright (E2E), React (component testing), and standard HTTP API handlers.

Can it help me find missing test cases?

Yes, part of the evaluation workflow involves a coverage gap analysis where it identifies public methods, error paths, and edge cases in your source code that lack corresponding tests.

How does it identify 'brittle' tests?

It looks for tests that assert on internal implementation details, such as checking if a specific internal function was called, rather than asserting on the final outcome or state change.

Why does the skill prioritize integration over mocking?

The core philosophy is that tests should exercise real behavior. Over-mocking often results in tests that pass even when the system is broken; integration tests ensure components work together as intended.

Does this skill actually run my test suite?

No, this skill performs a static analysis of your test code and source code to evaluate the logic, architecture, and efficacy of your tests without executing them.

Test Quality Evaluator

Name: Test Quality Evaluator
Author: mattermost

bymattermost

•

セキュリティとテスト

Evaluates the efficacy of existing test suites by identifying brittle mocks, poor assertions, and critical coverage gaps in source code.

The Test Quality Evaluator is a specialized skill designed to audit the actual value of your test suite rather than just measuring raw coverage percentages. It performs a deep qualitative analysis by comparing test code against production logic to identify tests that provide false confidence through over-mocking or implementation-specific assertions. By following a 'real over simulated' philosophy, this skill helps developers transition from fragile unit tests to robust integration patterns across Go, React, and E2E frameworks, providing a structured report with actionable verdicts to improve test reliability and maintenance.

主な機能

01Detection of 'mock-wiring' anti-patterns and over-simulated environments

02Structured reporting with 'Good', 'Rewrite', or 'Remove' verdicts

031 GitHub stars

04Identification of missing edge cases, error paths, and branching logic

05Framework-specific heuristics for Go, Playwright, React, and API handlers

06Qualitative audit of test efficacy vs. actual source code behavior

ユースケース

01Auditing legacy test suites to identify which tests are providing false confidence

02Refactoring mock-heavy unit tests into more valuable integration tests

03Identifying critical un-tested paths in new features or complex API logic

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add mattermost/mattermost-ai-marketplace test-evaluator

For use in Claude.ai and ChatGPT

Download Skill