Is Docker required to use this skill?

Docker is required for 'Gap 4' testing, which involves executing AI-generated code within a secure sandbox environment. Other tiers can run with mock implementations.

What models are supported for local testing?

The skill is optimized for Ollama-hosted models, specifically Qwen3:4b for fast iteration and DeepSeek-R1:8b for complex reasoning tasks.

How do I switch between Anthropic and local models?

You can use the 'provider switch' trigger or specify the provider directly in the test command, such as './scripts/run-tests.sh e2e anthropic'.

What does the 'Sanity' test tier cover?

Sanity tests are quick (~30s) validations that check basic imports, configuration loading, and mock workflows to ensure the environment is functional.

Kosmos E2E Testing

Name: Kosmos E2E Testing
Author: jimmc414

byjimmc414

•

324

보안 및 테스팅

Automates comprehensive end-to-end testing for the Kosmos autonomous AI scientist using local models, external APIs, and Docker sandboxes.

소개

This skill provides a robust testing framework specifically designed for the Kosmos project, an implementation of the AI Scientist autonomous discovery system. It enables developers to run tiered test suites—ranging from quick sanity checks to full research workflows—across multiple environments including Ollama-powered local LLMs, Anthropic/OpenAI APIs, and secure Docker execution environments. By automating environment health checks and provider switching, it ensures the reliability of complex AI-driven research workflows and scientific discovery pipelines within the Claude Code environment.

주요 기능

Multi-tier testing support including Sanity, Smoke, E2E, and Production suites
Performance benchmarking for comparing local versus API-based model reasoning capabilities
Automatic provider detection and switching between local Ollama models and external APIs
Docker sandbox orchestration for secure execution of AI-generated code
324 GitHub stars
Integrated health checks for environment readiness across models, Docker, and databases

사용 사례

Setting up isolated Docker environments for safe code execution during autonomous AI discovery
Validating autonomous research workflows using local reasoning models like DeepSeek-R1
Running regression tests across different LLM providers to ensure cross-model stability

소개

주요 기능

Multi-tier testing support including Sanity, Smoke, E2E, and Production suites
Performance benchmarking for comparing local versus API-based model reasoning capabilities
Automatic provider detection and switching between local Ollama models and external APIs
Docker sandbox orchestration for secure execution of AI-generated code
324 GitHub stars
Integrated health checks for environment readiness across models, Docker, and databases

사용 사례

Setting up isolated Docker environments for safe code execution during autonomous AI discovery
Validating autonomous research workflows using local reasoning models like DeepSeek-R1
Running regression tests across different LLM providers to ensure cross-model stability