About
This skill provides domain-specific expertise for Rust developers working with Apache Parquet files, specifically targeting the arrow-rs and parquet-arrow ecosystems. It proactively identifies inefficient reading and writing patterns—such as missing compression, suboptimal row group sizing, and lack of column projection—and suggests high-performance alternatives. Whether you are building a data lake on S3 or a local analytics engine, this skill ensures your Parquet implementation utilizes best practices like ZSTD compression, dictionary encoding, and memory-efficient streaming to maximize throughput and minimize resource consumption.
