What file formats can I read from S3 storage?

The skill supports reading CSV, Parquet, and JSON files directly from S3 using functions like read_csv, read_parquet, and read_json.

Can I connect to external databases like Postgres?

Yes, you can use the ATTACH command with Windmill resource paths, for example: ATTACH '$res:path/to/resource' AS db (TYPE postgres).

What is Ducklake integration?

Ducklake integration allows you to attach a data lake to your DuckDB session using the 'ATTACH 'ducklake' AS dl' command, enabling queries across your data lake architecture.

How do I define variables in my DuckDB scripts?

You can define variables using SQL comments like '-- $name (text) = default' and reference them within your query using the '$name' syntax.

How do I deploy my DuckDB scripts to Windmill?

Use the Windmill CLI by running 'wmill script generate-metadata' to create the necessary config files, followed by 'wmill sync push' to deploy.

Windmill DuckDB Script Writer

Name: Windmill DuckDB Script Writer
Author: windmill-labs

bywindmill-labs

0•

데이터베이스 관리

Generates and deploys optimized DuckDB scripts for the Windmill platform featuring external database and S3 integration.

This skill empowers developers to write high-performance DuckDB queries specifically tailored for the Windmill orchestration platform. It streamlines the creation of SQL scripts by providing standardized syntax for variable arguments, seamless integration with Ducklake for data lake operations, and native support for connecting to external databases like Postgres. Additionally, it automates the deployment workflow through CLI commands for metadata generation and synchronization, while facilitating direct data ingestion from S3 in CSV, Parquet, and JSON formats.

주요 기능

01Direct S3 file reading for Parquet, CSV, and JSON data sources

02Native Ducklake integration for advanced data lake operations

03External database connectivity using Windmill resource types

04Automated Windmill metadata generation and script deployment via CLI

050 GitHub stars

06Standardized DuckDB argument syntax for parameterization

사용 사례

01Building serverless data pipelines that process S3 files using DuckDB

02Creating automated reports by querying external Postgres databases within Windmill

03Developing data lake management scripts using Ducklake and SQL

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add windmill-labs/windmill-claude-plugin write-script-duckdb

For use in Claude.ai and ChatGPT

Download Skill