What types of errors can this skill help diagnose?

This skill covers a wide range of issues including ClusterNotReady, Spark OOM, Delta Lake ConcurrentAppendException, Permission Denied, Schema Mismatches, and API Rate Limiting.

Does this skill require specific setup or credentials?

Yes, you should have the Databricks CLI/SDK installed and your API credentials configured with access to the relevant workspace, cluster, and job logs.

How does it handle Spark Out-of-Memory (OOM) errors?

It provides specific configuration adjustments for driver/executor memory and partition sizes, as well as code patterns to replace inefficient operations like .collect() with distributed writes.

Does it provide programmatic debugging support?

Yes, it includes Python patterns using the Databricks WorkspaceClient to inspect run states, task result messages, and task output errors programmatically.

Can it help with Unity Catalog permission issues?

Yes, it provides SQL snippets for granting table/schema privileges and Databricks CLI commands to update workspace object permissions.

Databricks Error Resolver

Name: Databricks Error Resolver
Author: jeremylongshore

byjeremylongshore

•

1,243

数据科学与机器学习

Diagnoses and resolves common Databricks exceptions, Spark memory issues, and Delta Lake concurrency errors.

关于

The Databricks Error Resolver skill provides a comprehensive knowledge base and diagnostic workflow for troubleshooting Databricks environments. It covers critical failure points including ClusterNotReady exceptions, Spark Driver Out-of-Memory (OOM) errors, Delta Lake concurrent write conflicts, and Unity Catalog permission issues. By offering both programmatic solutions via the Databricks SDK and CLI-based commands, this skill enables developers to rapidly identify root causes in logs and apply verified fixes to minimize job downtime and optimize cluster configurations.

主要功能

1,243 GitHub stars
Conflict resolution patterns for Delta Lake concurrent write operations
Programmatic job state verification using the Databricks WorkspaceClient
Automated diagnosis for common Databricks exceptions and cluster states
Memory optimization strategies for Spark Driver and Executor OOM errors
Permission and Unity Catalog access troubleshooting and SQL grant templates

使用场景

Resolving schema mismatches and data integrity conflicts during ETL operations
Optimizing cluster configurations to prevent recurring memory and performance bottlenecks
Debugging failed production Spark jobs and notebook task exceptions

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeremylongshore/claude-code-plugins-plus-skills databricks-common-errors

For use in Claude.ai and ChatGPT

Download Skill

GitHub

关于