Does it help with Databricks storage costs?

Yes, it includes automated retention policy enforcement and Delta Lake VACUUM operation scripts to remove obsolete file versions and reclaim storage space.

How does this skill handle GDPR deletion requests?

It utilizes a Python-based GDPRHandler to identify PII-tagged tables across your catalog, count matching records for a specific user ID, and perform atomic Delta Lake DELETE operations with built-in audit logging.

Can I test the data deletion before it happens?

Yes, the implementation includes a 'dry_run' mode that generates a comprehensive report of all tables and row counts that would be affected before any data is actually removed.

What kind of PII masking techniques are available?

The skill provides patterns for email and phone number masking, SHA-256 identifier hashing with salts, and name redaction to ensure data privacy for non-production environments.

Databricks Data Compliance & Lifecycle

Name: Databricks Data Compliance & Lifecycle
Author: jeremylongshore

byjeremylongshore

•

1,243

数据库管理

Automates Delta Lake data management patterns for GDPR compliance, PII masking, and retention policy enforcement.

关于

This skill enables Claude to implement sophisticated data governance and compliance patterns within Databricks and Delta Lake environments. It streamlines complex tasks such as tagging PII for Unity Catalog, executing GDPR 'Right to Erasure' requests across multiple tables, and enforcing automated data retention schedules. With built-in support for data masking, anonymization, and Delta Lake Vacuum operations, it ensures that your data lake remains compliant, secure, and performant while reducing the manual overhead of data engineering compliance tasks.

主要功能

PII tagging and data classification for Unity Catalog
1,243 GitHub stars
PII masking and anonymization for analytics and testing
GDPR Right to Erasure (RTBF) automation with audit logging
Automated data retention and purging based on table metadata
Delta Lake lifecycle management and storage optimization

使用场景

Implementing automated data purging for tables with specific legal retention requirements
Creating secure, masked views of production data for data science and internal analytics
Processing high-volume user deletion requests for GDPR or CCPA compliance

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jeremylongshore/claude-code-plugins-plus-skills databricks-data-handling

For use in Claude.ai and ChatGPT

Download Skill

GitHub

关于