Do I need a Braintrust API key to use this skill?

Yes, the skill requires a valid BRAINTRUST_API_KEY environment variable and the braintrust Python SDK installed to interact with your project.

How do I automate prompt promotions?

Use the promote command with the --force (or -y) flag to enable non-interactive execution, which is ideal for automated workflows and Claude Code execution.

Can I test prompts before updating them?

Absolutely. You can use the diff command to preview changes and the test or invoke commands to run prompts with tracing before finalizing an update.

What is the Braintrust skill for Claude Code?

It is an adapter that allows you to manage Braintrust prompts, perform A/B testing, and update system messages directly through the Claude Code interface.

Braintrust Prompt Manager

Name: Braintrust Prompt Manager
Author: benigeri

bybenigeri

•

数据科学与机器学习

Manages, tests, and deploys Braintrust prompts directly from the Claude Code interface.

This skill provides a comprehensive adapter for the Braintrust prompt management CLI, allowing developers to list, retrieve, and update prompts without leaving their development environment. It facilitates advanced prompt engineering workflows by enabling direct testing with tracing, A/B testing for instruction changes, and seamless promotion of prompt versions between environments. By integrating Braintrust's versioning and evaluation capabilities into Claude Code, it ensures high-quality LLM outputs through systematic and automated management.

主要功能

01Promote prompt versions across environments with non-interactive automation support

02Test prompts with real-time tracing and dynamic input variables

03Preview system message changes using visual diffs before applying updates

04List and retrieve detailed prompt metadata and content via slugs

053 GitHub stars

06Perform A/B tests to evaluate prompt variations against baseline versions

使用场景

01Comparing different prompt versions to evaluate output quality and performance metrics

02Iterating on system prompts and instantly testing them against specific inputs with tracing

03Synchronizing prompt updates from development to production slugs in a CI/CD pipeline

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add benigeri/braintrust-claude-plugin braintrust

For use in Claude.ai and ChatGPT

Download Skill