What types of Celery task patterns are included?

The skill provides templates for basic tasks, automatic retries with backoff, rate limiting, time limits, database-specific operations, API integrations, and Pydantic-validated tasks.

Can I use this for secure database operations?

Yes, the database templates utilize parameterized queries to prevent SQL injection and include patterns for efficient connection pooling and transaction management.

How does this skill handle transient failures?

It implements pre-configured retry mechanisms using Celery's autoretry_for, including exponential backoff and jitter to prevent thundering herd problems.

Does it support custom task behavior?

Yes, it includes templates for custom task base classes, allowing you to implement global lifecycle hooks for logging, metrics tracking, and shared resource management.

How do I generate a new task from these templates?

The skill includes a 'generate-task.sh' utility script that allows you to scaffold new Celery tasks instantly based on your chosen pattern.

Celery Task Patterns

Name: Celery Task Patterns
Author: vanman2024

byvanman2024

0•

API 개발

Provides production-ready Celery templates for robust background task processing with built-in error handling, rate limiting, and validation.

This skill streamlines the development of high-performance background workers by providing a library of battle-tested Celery task templates. It addresses common production challenges such as exponential backoff retries, strict rate limiting, Pydantic-based input validation, and secure database connection pooling. Whether you are building API integrations, batch processors, or complex data pipelines, these patterns ensure your background tasks remain resilient, observable, and easy to maintain within any distributed system.

주요 기능

01Advanced retry logic with exponential backoff and jitter configuration

02Granular rate limiting and execution time boundaries for resource protection

03Optimized database operation templates with secure connection pooling

04Type-safe task input validation using Pydantic models and schemas

05Custom task base classes for centralized metrics tracking and lifecycle hooks

060 GitHub stars

사용 사례

01Implementing resilient external API integrations that gracefully handle transient network failures

02Processing high-volume batch data updates while respecting strict database resource constraints

03Standardizing background worker architecture across microservices using type-safe task templates

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add vanman2024/ai-dev-marketplace task-patterns

For use in Claude.ai and ChatGPT

Download Skill