Is authentication handled by this skill?

This skill focuses on code patterns; it assumes you have already configured authentication via the databricks-install-auth process.

Does it support the Databricks REST API?

Yes, it provides idiomatic patterns suitable for both the official Databricks Python SDK and custom REST API integrations.

What architectural patterns does this skill implement?

It implements several production-ready patterns including Singletons for client management, Context Managers for cluster lifecycles, and Fluent Builders for job creation.

How does it handle API failures?

The skill adds robust error handling wrappers and automatic retry logic with exponential backoff to manage transient failures and rate limits.

Databricks SDK Patterns

Name: Databricks SDK Patterns
Author: jeremylongshore

byjeremylongshore

•

1,613

•

Cloud Infrastructure

Implements production-grade Python patterns and architectural best practices for the Databricks SDK and REST API.

This skill provides developers with a standardized framework for interacting with Databricks via Python. It enforces industry best practices such as the Singleton pattern for client management, robust error handling wrappers, and exponential backoff retry logic to handle transient failures. By integrating these patterns, teams can ensure their Databricks workflows are type-safe, resilient, and maintainable, making it ideal for building ETL pipelines, managing cluster lifecycles, and orchestrating complex job builders.

Key Features

01Cluster lifecycle management via context managers

02Type-safe client singleton implementation

031,613 GitHub stars

04Structured error handling and logging wrappers

05Automated retry logic with exponential backoff

06Fluent builder patterns for type-safe job creation

Use Cases

01Building resilient Delta Lake ETL workflows with automated error recovery

02Refactoring legacy Databricks integration code for improved reliability

03Establishing team-wide coding standards for Databricks SDK usage

Key Features

01Cluster lifecycle management via context managers

02Type-safe client singleton implementation

031,613 GitHub stars

04Structured error handling and logging wrappers

05Automated retry logic with exponential backoff

06Fluent builder patterns for type-safe job creation

Use Cases

01Building resilient Delta Lake ETL workflows with automated error recovery

02Refactoring legacy Databricks integration code for improved reliability

03Establishing team-wide coding standards for Databricks SDK usage