Implements robust data validation pipelines using Great Expectations, dbt tests, and formalized data contracts.
This skill provides production-ready patterns for establishing trust in data pipelines through comprehensive validation frameworks. It enables developers to implement a complete data testing pyramid—spanning schema checks, unit tests, and cross-table integration tests—while utilizing industry-standard tools like Great Expectations and dbt. By defining clear data contracts and automating quality checks within CI/CD workflows, this skill ensures data completeness, accuracy, and consistency across the entire modern data stack, helping teams catch regressions before they reach production.
主な機能
01Multi-framework support for Great Expectations and dbt
02Real-time monitoring and Slack alerting for pipeline failures
030 GitHub stars
04Customizable validation suites for schema and statistical checks
05Automated data contract definition and enforcement
06Implementation of the Data Quality Testing Pyramid
ユースケース
01Monitoring production data for drift, freshness, and business logic violations
02Establishing formal data contracts between data producers and consumers
03Automating data validation within CI/CD pipelines to prevent breaking changes
