What file formats are supported by the etl-duckdb skill?

The skill supports both CSV and XLSX (Excel) file formats for data ingestion.

Where does the skill output the processed data?

Data is written to a DuckDB database file located at data/_artifacts/ops.duckdb.

Does it provide information on data quality?

Yes, it generates an ETL report in markdown format that includes metrics on input rows, null cells, and duplicated rows.

What happens if the input files are missing?

The skill includes a fail-safe mechanism that will generate a basic report status and exit without crashing.

How is the ETL process triggered?

The process is triggered via a PowerShell script located within the .codex skill directory.

DuckDB ETL Pipeline

Name: DuckDB ETL Pipeline
Author: macho715

bymacho715

0•

データベース管理

Automates the ingestion of CSV and Excel files into DuckDB with integrated data validation and markdown reporting.

The DuckDB ETL Pipeline skill provides a robust automated workflow for importing local datasets into a high-performance DuckDB instance. By executing specialized PowerShell scripts, it seamlessly handles CSV and XLSX formats while performing critical data quality checks such as null cell detection and duplicate row identification. Every run generates a detailed markdown report, providing immediate transparency into the ingestion process and ensuring that your data is properly staged and validated for downstream analysis or development tasks.

主な機能

01Generates comprehensive ETL markdown reports

020 GitHub stars

03Fail-safe execution for missing input scenarios

04Automated data validation for nulls and duplicates

05Supports multi-format ingestion (CSV and XLSX)

06Persists data to local DuckDB artifacts

ユースケース

01Streamlining local database setup for data-driven projects

02Staging raw CSV/Excel datasets for local SQL analysis

03Automating data quality audits during ingestion

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add macho715/hvdc-codex-ops etl-duckdb

For use in Claude.ai and ChatGPT

Download Skill