How does it handle version comparison?

The skill includes a dedicated benchmarking tool that saves performance results by version tag and provides a comparison script to identify speed regressions between releases.

Is coverage reporting integrated into this infrastructure?

Yes, it configures .coveragerc with specific thresholds, typically requiring 70% coverage for standard modules and 85% for critical modules like risk and signals.

Does it support non-trading software projects?

While the examples are trading-centric, the underlying benchmarking and regression infrastructure is applicable to any Python project where performance and version stability are priorities.

Can this skill test GPU-dependent code on CPU-only machines?

Yes, it includes a verified GPU mocking fixture that simulates CUDA properties, allowing GPU-dependent tests to pass in standard CI environments.

Testing & Benchmarking Infrastructure

Name: Testing & Benchmarking Infrastructure
Author: smith6jt-cop

bysmith6jt-cop

0•

보안 및 테스팅

Implements comprehensive testing suites with performance benchmarking to track regressions and ensure version-to-version consistency.

This skill provides a robust framework for managing complex software evolution, specifically designed for performance-critical applications like trading systems. It establishes a standardized directory structure, shared fixtures for GPU mocking on CPU-only machines, and automated benchmarking scripts to compare execution speed across different versions. By integrating tools like pytest-benchmark and coverage reporting, it ensures that feature updates do not introduce latency regressions, break backward compatibility, or compromise model specification consistency.

주요 기능

01GPU environment mocking for seamless testing on CPU-only CI machines

020 GitHub stars

03Configurable coverage thresholds for critical and standard modules

04Deterministic testing fixtures to ensure reproducible results

05Automated version-to-version performance comparison and reporting

06Feature regression testing for validating model specifications across versions

사용 사례

01Monitoring latency and throughput regressions during software updates

02Validating backward compatibility of ML models and feature engineering pipelines

03Standardizing testing protocols for high-performance computing in distributed teams

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add smith6jt-cop/skills_registry testing-benchmarking-infrastructure

For use in Claude.ai and ChatGPT

Download Skill