What are Celery canvas primitives?

Canvas primitives like chains, groups, and chords are the building blocks in Celery used to compose complex workflows from simple asynchronous tasks, allowing for sequential or parallel execution.

Does this skill help with error handling in workflows?

Yes, it provides specific implementation patterns for task-level error callbacks (errbacks) and chord error handling to ensure resilient workflow execution in distributed environments.

Which result backend is required for these patterns?

While Celery supports various backends, these patterns—particularly chords—work best with Redis 2.2+ or a dedicated database backend to handle task synchronization and result aggregation.

Can I use this for parallel data processing?

Absolutely. The skill includes specific implementations for Celery Groups and Chords, which are designed specifically for high-performance parallel task execution and synchronization.

Celery Workflow Canvas

Name: Celery Workflow Canvas
Author: vanman2024

byvanman2024

API 개발

Implements advanced Celery canvas patterns for designing complex, distributed task workflows and parallel processing pipelines.

소개

The Celery Workflow Canvas skill provides Claude with the specialized knowledge to architect and implement sophisticated distributed systems using Celery's canvas primitives. It enables the creation of sequential task chains, parallel groups, and synchronized chords, complete with robust error handling and result aggregation. This skill is essential for developers building data processing pipelines, complex background jobs, or any asynchronous system requiring precise execution logic, task coordination, and distributed result management.

주요 기능

Parallel task processing and synchronization using groups and chords
0 GitHub stars
Robust error callback patterns and task result aggregation strategies
Implementation of sequential task execution using Celery chains and signatures
Advanced workflow composition including nested and conditional logic
Automated validation scripts for checking canvas structure and backend requirements

사용 사례

Implementing complex notification systems with aggregate result reporting
Building multi-stage data processing pipelines with parallel execution branches
Creating resilient distributed workflows with integrated error handling and retries

소개

주요 기능

Parallel task processing and synchronization using groups and chords
0 GitHub stars
Robust error callback patterns and task result aggregation strategies
Implementation of sequential task execution using Celery chains and signatures
Advanced workflow composition including nested and conditional logic
Automated validation scripts for checking canvas structure and backend requirements

사용 사례

Implementing complex notification systems with aggregate result reporting
Building multi-stage data processing pipelines with parallel execution branches
Creating resilient distributed workflows with integrated error handling and retries