When should I use DBAL instead of the Doctrine ORM?

Raw DBAL is recommended for simple bulk updates or inserts where you don't need entity lifecycle events or complex object mapping, as it significantly reduces CPU and memory overhead.

How does this skill prevent 'Out of Memory' errors in PHP?

It implements patterns such as 'em->clear()' and 'toIterable()' which ensure that the Doctrine Unit of Work is periodically emptied, preventing thousands of objects from being stored in memory simultaneously.

Why is ID-based pagination better than using SQL offsets?

ID-based pagination (WHERE id > lastId) is much faster on large tables because SQL databases can jump directly to an indexed ID, whereas high OFFSET values require the engine to scan through all previous rows.

Does this skill work with Symfony Console commands?

Yes, it provides specific implementation patterns for integrating batch logic with SymfonyStyle progress bars and memory monitoring tools designed for CLI environments.

Doctrine Batch Processing

Name: Doctrine Batch Processing
Author: MakFly

byMakFly

•

数据库管理

Optimizes large-scale Symfony data operations through memory-efficient Doctrine ORM patterns and bulk database strategies.

The Doctrine Batch Processing skill equips Claude with specialized knowledge to handle massive datasets within Symfony applications without triggering 'Out of Memory' errors. It provides standardized implementation patterns for memory-safe iteration, automated entity clearing, ID-based pagination for high-performance scanning, and raw DBAL bulk operations. This skill is essential for developers building data migrations, import scripts, or long-running console commands that require stable and performant interaction with large MySQL or PostgreSQL databases.

主要功能

01Memory-safe iteration using toIterable() to prevent entity bloat

02High-performance ID-based pagination for processing massive tables

03Real-time memory monitoring and Symfony progress bar integration

0421 GitHub stars

05Automated batch flushing and entity manager clearing strategies

06Bulk data operations using raw DBAL to bypass ORM overhead

使用场景

01Importing large external datasets from CSV or JSON into a relational database

02Running complex data migrations that require entity-level logic without crashing

03Updating millions of database records via Symfony Console commands

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add makfly/superpowers-symfony doctrine-batch-processing

For use in Claude.ai and ChatGPT

Download Skill