Identifies and fixes common Firecrawl integration mistakes to optimize scraping performance and reduce credit consumption.
This skill acts as a specialized auditor for your Firecrawl web scraping implementations, helping you avoid frequent anti-patterns that lead to credit burn, failed crawls, or incomplete data. It provides specific guidance on handling asynchronous job polling, configuring JavaScript rendering for single-page applications, and applying URL filters to prevent runaway costs. Whether you are onboarding new developers or reviewing legacy scraping code, this skill ensures your integrations follow production-grade patterns and respect site-specific constraints like robots.txt.
主要功能
01Provides templates for credit-efficient crawling using limits and filters
02Suggests optimal 'waitFor' configurations for JavaScript-heavy sites
030 GitHub stars
04Validates compliance with rate limits and robots.txt protocols
05Identifies improper asynchronous polling logic in crawl jobs
06Detects missing output format specifications to ensure markdown delivery
使用场景
01Troubleshooting empty or partial data returns from SPA websites
02Conducting code reviews for existing Firecrawl scraping scripts
03Reducing API costs by implementing smarter URL inclusion/exclusion rules
