What are Celery canvas primitives?

Canvas primitives like chains, groups, and chords are the building blocks in Celery used to compose complex workflows from simple asynchronous tasks, allowing for sequential or parallel execution.

Does this skill help with error handling in workflows?

Yes, it provides specific implementation patterns for task-level error callbacks (errbacks) and chord error handling to ensure resilient workflow execution in distributed environments.

Which result backend is required for these patterns?

While Celery supports various backends, these patterns—particularly chords—work best with Redis 2.2+ or a dedicated database backend to handle task synchronization and result aggregation.

Can I use this for parallel data processing?

Absolutely. The skill includes specific implementations for Celery Groups and Chords, which are designed specifically for high-performance parallel task execution and synchronization.

Celery Workflow Canvas

Name: Celery Workflow Canvas
Author: vanman2024

byvanman2024

0•

API 开发

Implements advanced Celery canvas patterns for designing complex, distributed task workflows and parallel processing pipelines.

The Celery Workflow Canvas skill provides Claude with the specialized knowledge to architect and implement sophisticated distributed systems using Celery's canvas primitives. It enables the creation of sequential task chains, parallel groups, and synchronized chords, complete with robust error handling and result aggregation. This skill is essential for developers building data processing pipelines, complex background jobs, or any asynchronous system requiring precise execution logic, task coordination, and distributed result management.

主要功能

01Parallel task processing and synchronization using groups and chords

020 GitHub stars

03Robust error callback patterns and task result aggregation strategies

04Implementation of sequential task execution using Celery chains and signatures

05Advanced workflow composition including nested and conditional logic

06Automated validation scripts for checking canvas structure and backend requirements

使用场景

01Implementing complex notification systems with aggregate result reporting

02Building multi-stage data processing pipelines with parallel execution branches

03Creating resilient distributed workflows with integrated error handling and retries

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add vanman2024/ai-dev-marketplace workflow-canvas

For use in Claude.ai and ChatGPT

Download Skill