How much faster is this compared to sequential processing?

Internal benchmarks show a 3-4x speedup, reducing data fetching for 500 symbols from approximately 25 minutes down to 6-8 minutes.

Which Python libraries are required for this skill?

It utilizes Python's concurrent.futures for threading, along with standard data tools like pandas and database connectors for SQL-level filtering.

Can this be used for crypto trading?

Yes, the skill includes specialized logic for asset type detection and caching, making it highly efficient for both equity and crypto universe selection.

How does it handle existing data in the cache?

The skill implements an early-return mechanism that checks if cached data is current before initiating remote fetches, saving significant network I/O.

Does this skill help avoid API rate limits?

Yes, it includes a configurable worker cap (defaulting to 8) specifically designed to prevent triggering 429 Too Many Requests errors from financial APIs.

Parallel Universe Selection Optimizer

Name: Parallel Universe Selection Optimizer
Author: smith6jt-cop

bysmith6jt-cop

0•

데이터 과학 및 ML

Accelerates quantitative trading universe selection by 3-4x through parallel processing and optimized caching strategies.

This skill provides a high-performance framework for filtering and analyzing financial asset universes, specifically optimized for Alpaca API workflows. It addresses common bottlenecks in I/O-bound data fetching and CPU-bound statistical analysis by implementing robust ThreadPoolExecutor patterns, smart incremental caching, and SQL-level filtering. By capping parallel workers to prevent API rate limits and eliminating redundant computations like asset type detection, it significantly reduces processing time for large candidate lists, turning a 30-minute task into a sub-8-minute operation.

주요 기능

01Multi-threaded data fetching using ThreadPoolExecutor with API rate limit protection

02In-memory asset type detection (is_crypto) to minimize repeated string operations

03Smart incremental caching to eliminate false 'No data' warnings and redundant fetches

04SQL-based symbol filtering to reduce processing overhead at the database level

05Parallelized statistical analysis for high-speed candidate screening

060 GitHub stars

사용 사례

01Reducing research latency by accelerating the pre-analysis phase of trading algorithms

02Optimizing Alpaca API data ingestion workflows to maximize throughput without 429 errors

03Speeding up daily universe selection for quantitative strategies with 1000+ symbols

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add smith6jt-cop/skills_registry parallel-universe-selection

For use in Claude.ai and ChatGPT

Download Skill