Does it require a specific server setup?

The workflow typically involves starting the server in stdio mode (e.g., npm run start:stdio) to allow the test runner to interact with the app via the MCP protocol.

Can I test UI components with this skill?

Yes, it includes widget tests to verify HTML validity, JavaScript bundle loading, and React component rendering within the ChatGPT App environment.

What are golden prompt tests?

Golden prompt tests use a predefined JSON file of inputs to verify that the ChatGPT App triggers the correct tools and logic for specific user queries, ensuring consistent LLM behavior.

How are test failures handled?

For every failure, the skill provides an explanation of what failed, why it happened, and a code example to help you fix the issue immediately.

ChatGPT App Test Suite

Name: ChatGPT App Test Suite
Author: hollaugo

byhollaugo

•

セキュリティとテスト

Automates comprehensive testing for ChatGPT Apps using MCP Inspector, schema validation, and golden prompt verification.

This skill streamlines the quality assurance process for ChatGPT Apps by performing automated checks across protocol, schema, widget, and prompt layers. It allows developers to verify tool discovery, validate input constraints, ensure UI components render correctly, and confirm that LLM prompts trigger the intended tools accurately using golden prompt datasets. By integrating MCP Inspector and detailed reporting, it helps maintain high reliability and performance for custom AI integrations.

主な機能

01Automated schema testing for input constraints and required fields

02MCP Protocol validation for tool discovery and execution

03Detailed test report generation with actionable fix recommendations

041 GitHub stars

05Golden prompt validation to ensure accurate tool triggering

06Widget and UI component rendering tests for React and JavaScript

ユースケース

01Validating that UI widgets load and theme switching works as expected

02Regression testing LLM responses against golden prompts to prevent behavior drift

03Verifying tool functionality before deploying updates to a ChatGPT App

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add hollaugo/prompt-circle-marketplace test

For use in Claude.ai and ChatGPT

Download Skill