Does this skill help with Unity Catalog setup?

Yes, it provides SQL templates and configuration patterns for creating catalogs, schemas, and managing granular permissions across different environments.

How does it handle project deployment?

It utilizes Databricks Asset Bundles (DABs) to manage infrastructure as code, allowing you to define jobs, clusters, and pipelines in YAML for automated CI/CD.

What is the medallion architecture supported by this skill?

The skill follows the industry-standard Bronze (raw), Silver (cleansed), and Gold (curated/aggregated) pattern for data quality and refinement.

Can I use this for existing Databricks projects?

Absolutely. You can trigger the skill to review your current architecture, suggest improvements, or help migrate existing notebooks into a structured repository format.

Databricks Reference Architecture

Name: Databricks Reference Architecture
Author: micsapp

bymicsapp

0•

Data Science & ML

Implements production-ready Databricks Lakehouse architectures using Unity Catalog and the medallion data pattern.

This skill provides a comprehensive framework for architecting enterprise-grade Databricks environments directly within your development workflow. It automates the implementation of standardized project structures, configures Unity Catalog hierarchies, and establishes medallion (Bronze, Silver, Gold) data pipeline patterns. By leveraging Databricks Asset Bundles (DABs) and best practices for data governance, it enables data engineers and architects to build scalable, maintainable, and secure data platforms that are ready for production workloads.

Key Features

01Databricks Asset Bundle (DAB) templates for automated deployment

02Integrated CI/CD workflows for job clusters and SQL warehouses

03Unity Catalog configuration for multi-environment data governance

04Production-ready ETL pipeline patterns with metadata-driven ingestion

050 GitHub stars

06Standardized Medallion project layout for Bronze, Silver, and Gold layers

Use Cases

01Establishing automated deployment workflows using Databricks Asset Bundles

02Bootstrapping new Databricks projects with industry-standard folder structures

03Migrating legacy data pipelines to Unity Catalog and medallion architecture

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add micsapp/micstec-skills databricks-reference-architecture

For use in Claude.ai and ChatGPT

Key Features

01Databricks Asset Bundle (DAB) templates for automated deployment

02Integrated CI/CD workflows for job clusters and SQL warehouses

03Unity Catalog configuration for multi-environment data governance

04Production-ready ETL pipeline patterns with metadata-driven ingestion

050 GitHub stars

06Standardized Medallion project layout for Bronze, Silver, and Gold layers

Use Cases

01Establishing automated deployment workflows using Databricks Asset Bundles

02Bootstrapping new Databricks projects with industry-standard folder structures

03Migrating legacy data pipelines to Unity Catalog and medallion architecture

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add micsapp/micstec-skills databricks-reference-architecture

For use in Claude.ai and ChatGPT