Web Scraping & Data Collection Agent Skills

JBK Investment Sentiment Tracker

Collects YouTube economic commentary and calculates the 'Honey Index' by comparing financial predictions with actual market performance.

Web Search

Performs structured web searches via DuckDuckGo to retrieve real-time documentation, library information, and technical solutions.

Egg Research & Fact-Checking

Performs deep web research and multi-source fact-checking with structured citations and confidence assessments.

Z.AI Intelligence CLI

Integrates advanced vision analysis, real-time web search, and GitHub exploration tools directly into the Claude Code environment.

Crypto News Aggregator

Aggregates and filters real-time cryptocurrency news from over 50 authoritative sources with automated relevance scoring.

Exa SDK Installation & Authentication

Configures Exa SDKs and handles API authentication for AI-powered search and data retrieval.

FireCrawl Cost Optimization

Optimizes FireCrawl API expenses through intelligent tier selection, usage monitoring, and request efficiency strategies.

Exa Core Secondary Workflow

Executes secondary search and data retrieval workflows using the Exa API to complement primary AI-driven discovery tasks.

FireCrawl Performance Tuning

Optimizes FireCrawl API integrations using advanced caching, request batching, and connection pooling strategies.

FireCrawl Installation and Authentication

Installs and configures the FireCrawl SDK and CLI with secure API authentication for web scraping workflows.

FireCrawl Reliability Patterns

Implements robust error handling and fault-tolerance patterns for stable FireCrawl web scraping integrations.

Exa API Troubleshooting

Diagnoses and resolves common Exa API errors and integration issues to ensure reliable AI search functionality.

FireCrawl Secondary Workflow B

Executes optimized secondary FireCrawl data extraction tasks to complement primary web scraping workflows.

FireCrawl Rate Limit Handler

Implements resilient FireCrawl API interactions using exponential backoff, jitter, and idempotency patterns.

FireCrawl Pitfall Guard

Audits and optimizes FireCrawl implementations by identifying common anti-patterns and security vulnerabilities.

FireCrawl Webhooks & Events

Secures and processes FireCrawl webhook notifications with robust signature validation and automated event routing.

FireCrawl SDK Patterns

Implements production-ready architectural patterns and best practices for FireCrawl SDK integrations in TypeScript and Python.

YouTube & Media Downloader

Downloads videos, audio, and subtitles from YouTube and other online platforms using yt-dlp.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly through the command line.

Research Free

Conducts comprehensive web research and generates detailed reports without requiring external search API keys.

Currents API Automation

Automates real-time news retrieval and media monitoring tasks using the Currents API via Rube MCP.

Google Places Integration

Queries the Google Places API to retrieve business locations, venue details, and reviews directly through the CLI.

API Scraper Architect

Provides standardized architectural patterns and Pydantic models for building robust API documentation scrapers.

TLDR Newsletter Scraper & Summarizer

Automates the extraction, fetching, and bilingual summarization of TLDR newsletters directly from Gmail into structured Markdown.

Media Downloader

Downloads high-quality video and audio from over 1,000 platforms with automated metadata extraction and QR code support.

Firecrawl Pitfalls & Best Practices

Identifies and prevents common Firecrawl integration mistakes, anti-patterns, and credit-wasting behaviors during web scraping.

Firecrawl Scraper

Automates complex web data extraction, page crawling, and document parsing using the Firecrawl API.

Firecrawl Web Scraper

Extracts clean web content, captures screenshots, and parses PDFs using the powerful Firecrawl API.

Tavily Web Search

Empowers Claude with real-time web search, content extraction, and advanced crawling capabilities using the Tavily API.

Tavily Web Search

Empowers Claude with real-time web search, automated content extraction, and deep research capabilities using the Tavily API.