关于
The Spark Engineer skill transforms Claude into a senior big data specialist focused on the Apache Spark ecosystem. It provides expert guidance on building scalable ETL pipelines, optimizing Spark SQL and DataFrame operations, and managing complex streaming analytics. Whether you are troubleshooting memory issues, tuning shuffle partitions, or implementing data salting to handle skew, this skill ensures your distributed computing workloads are production-grade, efficient, and cost-effective.
