Does this skill require an OpenEvidence API key?

Yes, you will need sandbox and/or production API credentials from OpenEvidence to run integration and clinical validation tests.

Which CI platforms are supported?

The skill provides detailed configurations for GitHub Actions, but the patterns and test scripts can be easily adapted for GitLab CI, CircleCI, or Bitbucket Pipelines.

What is 'clinical validation' in this context?

It is a specialized test suite that programmatically checks AI responses against known medical keywords, forbidden terms, and confidence thresholds to ensure accuracy in clinical contexts.

How does it handle API rate limiting during tests?

The integration test configuration (vitest.config.integration.ts) includes settings for max concurrency and retries to prevent hitting API rate limits during automated pipeline runs.

Can I run these tests locally before pushing to CI?

Yes, the skill includes package.json scripts for running unit, integration, and clinical validation tests in your local development environment using Vitest.

OpenEvidence CI Integration

Name: OpenEvidence CI Integration
Author: jeremylongshore

byjeremylongshore

•

1,243

部署与 DevOps

Automates clinical AI validation and testing by integrating OpenEvidence into CI/CD pipelines.

关于

This skill enables developers to establish robust automated testing workflows for clinical AI applications using the OpenEvidence platform. It provides pre-configured GitHub Actions workflows, Vitest configurations for unit and integration testing, and a specialized clinical validation suite to ensure AI outputs meet medical standards. By automating these checks, development teams can maintain high confidence in their clinical evidence retrieval systems while streamlining the path from development to production through secure credential management and automated reporting.

主要功能

1,243 GitHub stars
Mocking patterns for OpenEvidence SDK to facilitate fast unit testing
Advanced Vitest configurations for separate unit, integration, and clinical test suites
Pre-configured GitHub Actions workflows for automated clinical validation
Secure handling of API credentials and environment-specific configurations
Automated clinical validation reports with keyword checking and confidence scoring

使用场景

Automating clinical accuracy checks on pull requests to ensure medical safety
Setting up continuous integration for a healthcare-focused LLM application
Generating automated validation reports for regulatory compliance in health-tech

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeremylongshore/claude-code-plugins-plus-skills openevidence-ci-integration

For use in Claude.ai and ChatGPT

Download Skill

GitHub

关于