Do I need authentication to fetch test reports?

No, this skill accesses the public Sippy API at dptools.openshift.org which currently does not require authentication for general test metadata.

What is Sippy and how does this skill use it?

Sippy is an OpenShift CI analysis tool that aggregates test results. This skill queries the Sippy API to provide pass/fail metrics and metadata for specific tests.

How does this skill help with bug tracking?

It identifies the associated Jira component for each test and searches for open bugs that mention the test by name, helping prevent duplicate bug reports.

Can I see if a test fails only on specific cloud providers?

Yes, by using the per-variant breakdown (no-collapse) feature, you can see if failures are isolated to specific platforms like AWS, GCP, or bare metal.

CI Test Report Fetcher

Name: CI Test Report Fetcher
Author: openshift-eng

byopenshift-eng

•

Deployment & DevOps

Fetches detailed OpenShift CI test metrics, pass rates, and Jira metadata from the Sippy API to analyze test stability and regressions.

The CI Test Report Fetcher skill enables Claude to retrieve comprehensive performance data for OpenShift CI tests directly from the Sippy API. It provides critical insights such as BigQuery test IDs, Jira component associations, and historical pass rates across different reporting periods. By offering both collapsed summaries and per-variant breakdowns, it helps developers quickly identify whether a test failure is a global regression or specific to certain cloud providers or architectures, while also surfacing existing Jira bugs to prevent duplicate filings and streamline the triaging process.

Key Features

01Maps tests to specific Jira components for streamlined bug triaging

02Identifies open Jira bugs associated with specific test names

0360 GitHub stars

04Supports per-variant breakdowns to isolate platform-specific failures

05Provides BigQuery/Component Readiness test IDs for deep-dive analysis

06Retrieves real-time pass, fail, and flake rates from the Sippy API

Use Cases

01Investigating intermittent test flakes in OpenShift CI pipelines

02Identifying the specific environment (e.g., AWS vs. bare metal) where a test is failing

03Checking historical pass rate trends to determine test stability before release

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add openshift-eng/ai-helpers fetch-test-report

For use in Claude.ai and ChatGPT

Download Skill