Which cloud providers are supported?

The skill supports analysis for Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), IBM Cloud, and CIMPL (Venus) provider pipelines.

Is it safe to run on large projects with many pipelines?

Yes, the skill employs a progressive approach using status.py for quick checks and analyze.py with strict filters to prevent exceeding AI token limits.

Does this skill track individual test cases?

No, it tracks job-level status (pass/fail) across pipeline runs rather than specific individual test case results.

How does it help with flaky tests?

It identifies test jobs that intermittently pass and fail across multiple pipeline runs, highlighting unreliable suites that need developer attention.

OSDU Test Reliability Analysis

Name: OSDU Test Reliability Analysis
Author: danielscholl

bydanielscholl

0•

Security & Testing

Analyzes OSDU GitLab CI/CD pipeline reliability to identify flaky tests and provide quality metrics across cloud providers.

This skill empowers Claude to monitor and evaluate the health of OSDU platform projects by tracking test job performance across multiple pipeline runs. It wraps the osdu-quality CLI to analyze unit, integration, and acceptance tests, offering detailed insights into test stability and cross-provider reliability including Azure, AWS, and GCP. By identifying intermittently failing "flaky" tests and aggregating quality metrics, it helps developers maintain high standards for OSDU services and infrastructure while managing token usage through optimized query strategies.

Key Features

010 GitHub stars

02Multi-cloud provider reliability benchmarking for Azure, AWS, and GCP

03Granular test stage analysis for unit, integration, and acceptance jobs

04Automated flaky test detection across OSDU projects

05Token-optimized pipeline status reporting via specialized scripts

06Comprehensive health monitoring for 30+ core OSDU services

Use Cases

01Comparing test pass rates between different cloud provider infrastructure deployments

02Monitoring the long-term impact of code changes on project test quality and reliability

03Investigating intermittent pipeline failures in the OSDU storage service

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add danielscholl/agent-skills osdu

For use in Claude.ai and ChatGPT

Download Skill