How does it handle duplicate records?

The generated scripts include logic to check for existing records using frappe.db.exists and provide options to either update or skip them.

Does it use native Frappe methods?

Yes, it generates code utilizing standard Frappe API methods like frappe.get_doc, frappe.db.commit, and frappe.utils for full framework compatibility.

What types of files does this skill support?

The skill primarily generates scripts for CSV and Excel imports, but the resulting Python code can be adapted for any structured data source.

Can I add custom transformation logic?

Absolutely. The skill provides a clear template where you can easily insert custom field mapping or complex business logic during the migration process.

Is it safe for very large datasets?

Yes, it implements batching and periodic database commits (every 100 records by default) to manage memory and ensure transactional integrity.

Frappe Data Migration Generator

Name: Frappe Data Migration Generator
Author: Venkateshvenki404224

byVenkateshvenki404224

•

Database Management

Generates production-ready Python scripts for migrating, transforming, and importing large datasets into Frappe Framework applications.

About

The Frappe Data Migration Generator streamlines the complex process of moving data from legacy systems into Frappe-based applications. It automates the creation of robust scripts that include essential features like data validation, duplicate checking, error logging, and batch processing for performance. Whether you are handling one-time legacy imports or recurring large-scale CSV/Excel uploads, this skill ensures data integrity by leveraging native Frappe API methods and best practices for transactional safety.

Key Features

Duplicate detection and intelligent record updating
Progress tracking and batch commit handling
2 GitHub stars
Built-in data validation and transformation logic
Comprehensive error logging and reporting
Automated CSV and Excel import script generation

Use Cases

Migrating legacy ERP data into Frappe DocTypes
Transforming external data structures to match Frappe schema
Bulk importing large datasets with production-grade error handling

About

Key Features

Duplicate detection and intelligent record updating
Progress tracking and batch commit handling
2 GitHub stars
Built-in data validation and transformation logic
Comprehensive error logging and reporting
Automated CSV and Excel import script generation

Use Cases

Migrating legacy ERP data into Frappe DocTypes
Transforming external data structures to match Frappe schema
Bulk importing large datasets with production-grade error handling