Can I use this for both Azure and AWS Databricks?

Yes, the skill includes configuration patterns for both Azure Spot instances and AWS Spot with fallback mechanisms.

Does it require admin access?

Yes, workspace administrator access is typically required to implement cluster policies and access system billing tables.

How does this skill help reduce Databricks costs?

It implements cluster policies that limit expensive instance types, configures spot instances with on-demand fallbacks, and sets up aggressive auto-termination for idle clusters.

Can I monitor costs by department?

Yes, the skill provides tools to enforce cost allocation tags and generate reports based on specific tags like 'cost_center' or 'team' using SQL system tables.

Databricks Cost Tuning

Name: Databricks Cost Tuning
Author: jeremylongshore

byjeremylongshore

•

1,243

Cloud Infrastructure

Optimizes Databricks expenditure through automated cluster policies, spot instance configuration, and usage monitoring.

About

The Databricks Cost Tuning skill empowers developers and FinOps teams to manage and reduce cloud spend within Databricks environments. It provides pre-defined patterns for implementing restrictive cluster policies, configuring Azure and AWS spot instances, and setting up instance pools for faster startup times without the high price tag. By integrating system billing queries and cost allocation tags, this skill ensures complete visibility into compute usage, enabling teams to identify idle resources and enforce budget-conscious infrastructure management directly through Claude.

Key Features

Advanced cost monitoring using Databricks system tables
1,243 GitHub stars
Spot instance configuration for Azure and AWS workloads
Aggressive auto-termination and off-hours scheduling
Automated creation of cost-controlled cluster policies
Implementation of cost allocation tags for team-based billing

Use Cases

Identifying and shutting down underutilized or idle compute resources
Reducing monthly cloud billing for large-scale data engineering pipelines
Enforcing budget compliance across multiple development teams

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeremylongshore/claude-code-plugins-plus-skills databricks-cost-tuning

For use in Claude.ai and ChatGPT

Download Skill

GitHub