Can I use this for both Azure and AWS Databricks?

Yes, the skill includes configuration patterns for both Azure Spot instances and AWS Spot with fallback mechanisms.

Does it require admin access?

Yes, workspace administrator access is typically required to implement cluster policies and access system billing tables.

How does this skill help reduce Databricks costs?

It implements cluster policies that limit expensive instance types, configures spot instances with on-demand fallbacks, and sets up aggressive auto-termination for idle clusters.

Can I monitor costs by department?

Yes, the skill provides tools to enforce cost allocation tags and generate reports based on specific tags like 'cost_center' or 'team' using SQL system tables.

Databricks Cost Tuning

Name: Databricks Cost Tuning
Author: jeremylongshore

byjeremylongshore

•

1,243

•

Cloud Infrastructure

Optimizes Databricks expenditure through automated cluster policies, spot instance configuration, and usage monitoring.

The Databricks Cost Tuning skill empowers developers and FinOps teams to manage and reduce cloud spend within Databricks environments. It provides pre-defined patterns for implementing restrictive cluster policies, configuring Azure and AWS spot instances, and setting up instance pools for faster startup times without the high price tag. By integrating system billing queries and cost allocation tags, this skill ensures complete visibility into compute usage, enabling teams to identify idle resources and enforce budget-conscious infrastructure management directly through Claude.

Key Features

01Advanced cost monitoring using Databricks system tables

021,243 GitHub stars

03Spot instance configuration for Azure and AWS workloads

04Aggressive auto-termination and off-hours scheduling

05Automated creation of cost-controlled cluster policies

06Implementation of cost allocation tags for team-based billing

Use Cases

01Identifying and shutting down underutilized or idle compute resources

02Reducing monthly cloud billing for large-scale data engineering pipelines

03Enforcing budget compliance across multiple development teams

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeremylongshore/claude-code-plugins-plus-skills databricks-cost-tuning

For use in Claude.ai and ChatGPT

Download Skill

Key Features

01Advanced cost monitoring using Databricks system tables

021,243 GitHub stars

03Spot instance configuration for Azure and AWS workloads

04Aggressive auto-termination and off-hours scheduling

05Automated creation of cost-controlled cluster policies

06Implementation of cost allocation tags for team-based billing

Use Cases

01Identifying and shutting down underutilized or idle compute resources

02Reducing monthly cloud billing for large-scale data engineering pipelines

03Enforcing budget compliance across multiple development teams

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeremylongshore/claude-code-plugins-plus-skills databricks-cost-tuning

For use in Claude.ai and ChatGPT

Download Skill