Web Scraping & Data Collection Agent Skills

Firecrawl Best Practices & Pitfalls

Identifies and prevents common Firecrawl integration mistakes to optimize credit usage and data extraction quality.

Perplexity Advanced Research Workflow

Facilitates multi-turn research sessions and structured report generation using the Perplexity API.

Defuddle Web Content Extractor

Extracts clean, clutter-free Markdown from web pages to optimize token usage and context relevance.

FireCrawl Rate Limit Manager

Implements robust rate limiting, exponential backoff, and idempotency patterns for resilient FireCrawl API interactions.

Exa Neural Search Core Workflow

Integrates Exa's neural search API to perform semantic web queries and retrieve contextually relevant data for RAG pipelines.

AI Twitter Radar

Monitors Twitter/X for real-time AI news, trending tools, and developer insights using the Bird CLI.

Firecrawl Best Practices & Pitfall Prevention

Identifies and resolves common Firecrawl integration mistakes, anti-patterns, and resource management issues during code reviews.

Plan-Driven Development Workflow

Executes a structured, plan-driven implementation workflow that prioritizes context discovery and systematic validation for the kurly-crawler project.

LinkedIn Intelligence

Automates LinkedIn profile discovery and data extraction using optimized search queries and structured result parsing.

LinkedIn Resume & Job Optimizer

Automates LinkedIn job searching and generates ATS-optimized resumes with integrated skill gap analysis and interview preparation.

Lightpanda Browser

Accelerates data retrieval and web automation using a high-performance, headless browser replacement for Chrome.

Korean Job Hunter & Web Scraper

Automates web scraping workflows to collect and analyze job postings from major Korean and international job boards.

FireCrawl Integration Safeguards

Identifies and prevents common FireCrawl integration mistakes, anti-patterns, and excessive credit consumption during web scraping.

Bright Data Automation

Automates web data collection and proxy management via Bright Data and Rube MCP.

Exa Search Automation

Automates AI-powered web search and data retrieval using Exa's neural search engine via the Rube MCP.

2Captcha Automation

Automates CAPTCHA solving and bypass workflows using 2Captcha via the Rube MCP integration.

Zyte API Web Scraping

Automates complex web scraping and data extraction tasks by integrating the Zyte API with Claude Code via the Rube MCP.

Countdown API Automation

Automates Countdown API operations via Composio and Rube MCP to manage e-commerce data and retail workflows.

Scrapegraph AI Automation

Automates complex web scraping and data extraction tasks using LLM-powered Scrapegraph AI tools via the Rube MCP.

Metaphor Search Automation

Automates advanced neural search and data retrieval tasks using Metaphor (Exa.ai) via the Rube MCP and Composio toolkit.

Remote Retrieval Automation

Automates complex data fetching and information retrieval tasks through the Rube MCP and Composio toolkit.

Apify Automation

Automate complex web scraping workflows and data extraction using Apify's library of Actors directly within Claude Code.

Jigsawstack Automation

Automates complex Jigsawstack operations including web scraping, AI-powered data extraction, and content processing directly within Claude Code.

Scrapfly Automation

Automates complex web scraping and data extraction tasks using Scrapfly’s high-performance proxy and anti-bot capabilities via Rube MCP.

Parseur Automation

Automates document parsing and structured data extraction from emails and PDFs using Parseur and Rube MCP.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline archival, research, and editing.

Data Scraper Agent

Builds fully automated, AI-powered data collection agents that scrape, enrich, and store public data for free.

Exa Search & Research

Conducts high-precision neural searches for web content, code examples, and company intelligence using the Exa MCP server.

Exa Neural Search

Empowers Claude with high-quality neural search capabilities to retrieve real-time web data, code context, and company intelligence.

Deep Research Agent

Conducts multi-source web investigations to produce comprehensive, cited research reports with verifiable evidence.