Implements robust data validation and quality assurance using Great Expectations, dbt tests, and data contracts.
This skill provides production-ready patterns for ensuring data reliability throughout the engineering lifecycle. It facilitates the implementation of the data testing pyramid—from schema validation to complex business logic checks—using industry-standard tools like Great Expectations and dbt. By integrating these frameworks, users can automate data quality monitoring, establish clear data contracts between producers and consumers, and prevent downstream pipeline failures through proactive validation in CI/CD workflows.
主な機能
01Implementation of Great Expectations (GX) validation suites and checkpoints
02Automated data quality monitoring and Slack notification integration
030 GitHub stars
04Standardized Data Contract definitions for multi-team data governance
05Advanced dbt testing patterns including generic, singular, and custom tests
06Validation across core DQ dimensions like completeness, uniqueness, and freshness
ユースケース
01Building automated data validation pipelines within CI/CD environments
02Establishing formal data contracts between engineering teams and stakeholders
03Monitoring and alerting on data drifts or anomalies in production warehouses
