Data Import and Profiling

About

Serves as a prerequisite for data analysis workflows by providing a structured five-phase approach to CSV ingestion. It handles everything from initial file discovery and encoding detection to complex schema design, standardization of inconsistent formats, and automated quality reporting. By utilizing specialized sub-agents for quality assessment and foreign key detection, this skill ensures data integrity is maintained and documented before any cleaning or analysis begins, making it ideal for robust data engineering tasks within the DataPeeker ecosystem.

Key Features

• Intelligent schema design and SQL type inference
• Automated quality reporting via delegated sub-agents
• 0 GitHub stars
• Systematic five-phase data ingestion and verification process
• Standardization rules for dates, numbers, and NULL values
• Foreign key detection and relationship mapping

Use Cases

• Ensuring data consistency through automated profiling and standardization
• Preparing raw CSV files for relational database analysis
• Detecting quality issues and relational structures in new datasets