Implements robust data validation and quality assurance using Great Expectations, dbt tests, and data contracts.
This skill provides standardized patterns for building reliable data pipelines by integrating industry-leading quality frameworks. It enables developers to implement comprehensive validation rules, establish formal data contracts between teams, and automate quality checks within CI/CD workflows using tools like Great Expectations and dbt. By focusing on the six dimensions of data quality—completeness, uniqueness, validity, accuracy, consistency, and timeliness—this skill ensures that data remains trustworthy and production-ready throughout its lifecycle.
主要功能
010 GitHub stars
02Great Expectations integration for automated data validation suites
03Data contract specification using DataContract.com standards
04Comprehensive dbt test patterns including schema and custom generic tests
05Multi-dimensional data quality checks (Completeness, Uniqueness, Validity, etc.)
06Automated quality monitoring and Slack notification workflows
使用场景
01Building a centralized data quality monitoring dashboard with Great Expectations Data Docs
02Establishing formal data contracts between upstream producers and downstream consumers
03Automating data quality gates within CI/CD pipelines to prevent broken data from reaching production
