What types of Celery task patterns are included?

The skill provides templates for basic tasks, automatic retries with backoff, rate limiting, time limits, database-specific operations, API integrations, and Pydantic-validated tasks.

Can I use this for secure database operations?

Yes, the database templates utilize parameterized queries to prevent SQL injection and include patterns for efficient connection pooling and transaction management.

How does this skill handle transient failures?

It implements pre-configured retry mechanisms using Celery's autoretry_for, including exponential backoff and jitter to prevent thundering herd problems.

Does it support custom task behavior?

Yes, it includes templates for custom task base classes, allowing you to implement global lifecycle hooks for logging, metrics tracking, and shared resource management.

How do I generate a new task from these templates?

The skill includes a 'generate-task.sh' utility script that allows you to scaffold new Celery tasks instantly based on your chosen pattern.

Celery Task Patterns

Name: Celery Task Patterns
Author: vanman2024

byvanman2024

API 开发

Provides production-ready Celery templates for robust background task processing with built-in error handling, rate limiting, and validation.

关于

This skill streamlines the development of high-performance background workers by providing a library of battle-tested Celery task templates. It addresses common production challenges such as exponential backoff retries, strict rate limiting, Pydantic-based input validation, and secure database connection pooling. Whether you are building API integrations, batch processors, or complex data pipelines, these patterns ensure your background tasks remain resilient, observable, and easy to maintain within any distributed system.

主要功能

Advanced retry logic with exponential backoff and jitter configuration
Granular rate limiting and execution time boundaries for resource protection
Optimized database operation templates with secure connection pooling
Type-safe task input validation using Pydantic models and schemas
Custom task base classes for centralized metrics tracking and lifecycle hooks
0 GitHub stars

使用场景

Implementing resilient external API integrations that gracefully handle transient network failures
Processing high-volume batch data updates while respecting strict database resource constraints
Standardizing background worker architecture across microservices using type-safe task templates

关于

主要功能

Advanced retry logic with exponential backoff and jitter configuration
Granular rate limiting and execution time boundaries for resource protection
Optimized database operation templates with secure connection pooling
Type-safe task input validation using Pydantic models and schemas
Custom task base classes for centralized metrics tracking and lifecycle hooks
0 GitHub stars

使用场景

Implementing resilient external API integrations that gracefully handle transient network failures
Processing high-volume batch data updates while respecting strict database resource constraints
Standardizing background worker architecture across microservices using type-safe task templates