Why do golden file tests often fail in CI/CD?

They often fail due to non-deterministic data like current timestamps, random UUIDs, or machine-specific file paths that change every time the test is run.

Can I use this for performance benchmarks?

No, this skill is intended for functional regression testing. Performance benchmarks require exact measurements which normalization would specifically remove.

How does this skill prevent brittle test failures?

The skill implements normalizers that replace dynamic patterns (like dates or ports) with static placeholders (like REDACTED_DATE), ensuring comparisons focus only on logic.

What is a golden file test?

A golden file test, also known as snapshot testing, involves comparing the actual output of a program against a saved 'golden' file containing the expected output to detect regressions.

How do I update my golden files when logic actually changes?

The skill provides a standardized workflow, typically using an environment variable like UPDATE_GOLDEN=1, to overwrite existing golden files with new, normalized output.

Golden File Testing & Normalization

Name: Golden File Testing & Normalization
Author: ash1794

byash1794

•

보안 및 테스팅

Automates the creation of robust golden file tests by normalizing dynamic fields like timestamps, UUIDs, and environment-specific paths.

This skill streamlines the implementation of snapshot testing by identifying and redacting non-deterministic data such as dates, durations, and local file paths. By applying consistent normalization to both the test output and the stored golden files, it prevents tests from failing due to superficial changes, making integration and regression testing significantly more reliable across different machines and execution times. It is ideal for developers working with CLI outputs, API responses, or complex string data where traditional assertions are too granular.

주요 기능

01Regex-based pattern matching for common dynamic fields

02Automated temporal normalization for dates and timestamps

036 GitHub stars

04Standardized golden file generation and update workflows

05Environment-agnostic path and port normalization

06Redaction of non-deterministic IDs and random UUIDs

사용 사례

01Validating API responses containing dynamic timestamps or database IDs

02Testing CLI output that includes execution durations and local paths

03Regression testing complex string outputs in cross-platform CI/CD pipelines

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ash1794/vibe-engineering golden-file-testing

For use in Claude.ai and ChatGPT

주요 기능

01Regex-based pattern matching for common dynamic fields

02Automated temporal normalization for dates and timestamps

036 GitHub stars

04Standardized golden file generation and update workflows

05Environment-agnostic path and port normalization

06Redaction of non-deterministic IDs and random UUIDs

사용 사례

01Validating API responses containing dynamic timestamps or database IDs

02Testing CLI output that includes execution durations and local paths

03Regression testing complex string outputs in cross-platform CI/CD pipelines

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ash1794/vibe-engineering golden-file-testing

For use in Claude.ai and ChatGPT