Which orchestration tools does this skill support?

This skill provides specialized implementation patterns for Kubeflow Pipelines, Apache Airflow, Prefect, and Ray, as well as custom DAG-based workflows.

How does this skill ensure model reproducibility?

The skill enforces strict constraints including pinned dependencies, random state seeding, data versioning via DVC, and the use of containerized training environments.

Is this suitable for both cloud and on-premise ML infrastructure?

Yes, the patterns provided are designed to work across AWS, GCP, Azure, and on-premise Kubernetes clusters using standard MLOps tooling.

Can it help me track experiments and model versions?

Yes, it implements best practices for logging metrics, parameters, and artifacts using tools like MLflow, Weights & Biases, and Neptune to ensure full traceability.

Does it include data validation and quality checks?

Absolutely. It integrates data validation frameworks like Great Expectations to perform schema checks and distribution validation before training begins.

ML Pipeline Engineering

Name: ML Pipeline Engineering
Author: Jeffallan

byJeffallan

•

数据科学与机器学习

Orchestrates production-grade machine learning workflows, including feature engineering, automated training, and MLOps lifecycle management.

The ml-pipeline skill transforms Claude into a senior MLOps engineer capable of designing and implementing scalable machine learning infrastructure. It provides expert guidance on building robust feature stores, orchestrating complex training workflows with tools like Kubeflow or Airflow, and managing the complete model lifecycle with experiment tracking and automated deployment. This skill is essential for developers and data scientists who need to move beyond manual scripts to create reproducible, versioned, and observable ML systems that bridge the gap between research and production.

主要功能

01Implementation of production-grade feature stores and transformation pipelines

0249 GitHub stars

03Orchestration of distributed training workflows using Kubeflow, Airflow, and Prefect

04Automated data validation and quality checks using Great Expectations

05Experiment tracking and model registry management with MLflow and Weights & Biases

06Standardized model versioning and deployment strategies for reproducible AI

使用场景

01Building automated retraining pipelines that trigger based on data drift or performance metrics

02Integrating hyperparameter tuning and experiment logging into existing machine learning codebases

03Designing a centralized feature engineering system to serve multiple training and inference jobs

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeffallan/claude-skills ml-pipeline

For use in Claude.ai and ChatGPT

Download Skill