Can I track artifacts like confusion matrices or ROC curves?

Yes, the skill provides an artifact management API to save training plots, data versions, and environment files alongside your model metrics.

Does it work with my existing Weights & Biases setup?

Absolutely. The skill automatically detects W&B or MLflow in your project and configures them to log data in a way that remains tied to your development increments.

Can I use this without external tools like MLflow?

Yes, the skill includes a built-in tracking system that logs results locally to SpecWeave increment folders without any external dependencies.

How does it ensure experiment reproducibility?

It captures the git hash, data version, python environment, and exact hyperparameters for every run, ensuring anyone on the team can replicate the results.

How does this help with model documentation?

The skill integrates with SpecWeave's 'sync-docs' command to automatically update your internal documentation with experiment summaries and selection rationales.

ML Experiment Tracker

Name: ML Experiment Tracker
Author: anton-abyzov

byanton-abyzov

•

데이터 과학 및 ML

Manages machine learning experiment tracking and model comparison by automatically logging parameters, metrics, and artifacts to SpecWeave increments.

The Experiment Tracker skill streamlines the machine learning development lifecycle by converting chaotic research into structured, reproducible experiments. It automatically detects and configures tracking backends like MLflow and Weights & Biases—or uses its own zero-config local storage—to ensure every model run is versioned alongside your code. By integrating directly with SpecWeave's living documentation, it transforms experimental data into persistent team knowledge, allowing developers to objectively compare models and document the rationale behind architectural decisions.

주요 기능

01Automatic logging of hyperparameters, metrics, and training artifacts

02Comprehensive tracking of environment metadata, data versions, and git hashes

03Built-in model comparison tool with automated markdown report generation

04Synchronization of experiment results to project-wide living documentation

0513 GitHub stars

06Seamless integration with MLflow, Weights & Biases, and TensorBoard

사용 사례

01Tracking hyperparameter tuning results to identify optimal model configurations

02Maintaining a reproducible history of experiments for team-wide knowledge sharing

03Objective comparison of different ML architectures like XGBoost versus LightGBM

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add anton-abyzov/specweave experiment-tracker

For use in Claude.ai and ChatGPT

Download Skill