Implements robust background task scheduling and distributed execution using FastAPI, APScheduler, and Celery.
This skill provides a comprehensive framework for managing background processes and scheduled jobs within FastAPI applications. It bridges APScheduler's flexible scheduling (Cron and Interval) with Celery's distributed execution capabilities, allowing for reliable, asynchronous processing. The system includes built-in patterns for database persistence of job states, execution history tracking, and sophisticated error handling with exponential backoff. It is ideal for developers needing to offload long-running tasks, manage recurring maintenance, or ensure high availability through distributed locking and instance coordination.
主要功能
01Dual-mode execution supporting both distributed Celery workers and inline FastAPI processing
02Comprehensive job persistence and execution tracking via SQLAlchemy database models
03Fault-tolerant task patterns featuring exponential backoff, retries, and execution time limits
04Advanced scheduling engine with support for complex Cron expressions and interval-based triggers
05Infrastructure for distributed locking and instance heartbeat monitoring to prevent job duplication
060 GitHub stars
使用场景
01Scheduling recurring system maintenance such as database cleanups, audit logs, or report generation
02Offloading heavy API computations or external integrations to background workers to maintain low latency
03Managing complex notification systems that require guaranteed delivery and retry logic
