Architects and implements robust ETL/ELT pipelines, production data platforms, and data quality frameworks.
This skill empowers Claude to design and build production-grade data infrastructure, focusing on scalable pipeline patterns, idempotent data loading, and rigorous validation logic. It provides best practices for modern data architectures using tools like dbt, Spark, and Airflow, enabling developers to automate data workflows while ensuring data integrity and observability across the entire data lifecycle. Whether you are building cloud-native data warehouses or optimizing batch processing, this skill provides the foundational patterns needed for reliable data operations.
主要功能
01Pipeline troubleshooting and memory optimization strategies
02End-to-end ETL/ELT pipeline architecture design
032 GitHub stars
04Idempotent data loading patterns including Merge and Upsert
05Automated data quality validation and schema enforcement
06Integration patterns for dbt, Spark, and modern cloud warehouses
使用场景
01Implementing automated data quality checks for production systems
02Building resilient data ingestion pipelines for cloud data warehouses
03Migrating legacy ETL workflows to modern, idempotent ELT architectures
