What is a Golden Prompt test?

A Golden Prompt test is a verification method that ensures specific user inputs correctly trigger the intended tools while ensuring negative prompts are correctly ignored.

How does this skill help with fixing bugs?

For every test failure, the skill provides a detailed report explaining what failed, why it failed, and a specific code example to fix the issue.

Can I run these tests in my local development environment?

Yes, the skill is designed to work with local servers using standard npm commands and the MCP Inspector tool to run tests during development.

Does this skill support React components?

Yes, it includes specific test categories for validating HTML structure, JavaScript bundle loading, and React component rendering for ChatGPT App widgets.

ChatGPT App Test Suite

Name: ChatGPT App Test Suite
Author: hollaugo

byhollaugo

•

Security & Testing

Automates comprehensive testing for ChatGPT Apps using MCP protocol verification and golden prompt validation.

The ChatGPT App Test Suite is a specialized Claude Code Skill designed to streamline the quality assurance process for custom ChatGPT applications. It automates critical checks across four major categories: MCP protocol compliance, schema validation, UI widget integrity, and golden prompt accuracy. By identifying tool discovery issues, schema mismatches, and prompt-to-tool mapping errors, this skill ensures that ChatGPT extensions function reliably and correctly respond to user intents before they are deployed to production.

Key Features

01UI widget testing for React components and JavaScript bundles

02Automated MCP protocol and tool discovery testing

03Golden prompt validation to ensure accurate tool triggering

04Schema validation for input constraints and required fields

05Detailed reporting with actionable code fixes for failures

0620 GitHub stars

Use Cases

01Verifying MCP server compliance before deploying a ChatGPT App extension

02Testing the reliability of tool-triggering prompts against a golden dataset

03Debugging failing React widgets within the ChatGPT App interface

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add hollaugo/tutorials test

For use in Claude.ai and ChatGPT

Download Skill