Web Scraping & Data Collection Agent Skills

Google Trends ATH Detector

Detects and analyzes Google Trends search spikes and all-time highs using automated browser simulation and statistical modeling.

YouTube & Video Downloader

Downloads videos, audio, and subtitles from YouTube and other platforms using yt-dlp with optimized settings.

Scraper Code Generator

Generates high-performance, robust Python code for scraping and parsing structured API documentation from HTML.

Doc Site Analysis

Analyzes API documentation structures to identify data extraction patterns for automated scraper generation.

Valyu Search & Research Toolkit

Empowers Claude with multi-domain search, AI-driven answers, content extraction, and comprehensive deep research reporting.

Exa Semantic Search

Conducts semantic web searches and discovers similar content using the Exa AI-powered search engine.

Research Free

Conducts comprehensive web research and generates detailed reports without requiring external search API keys.

Blog & RSS Monitor

Monitors and manages updates from blogs and RSS/Atom feeds directly through the CLI.

Exa Semantic Search

Performs high-precision semantic searches and intent-based research using the Exa AI search engine.

Firecrawl Scraper

Automates deep web scraping, PDF parsing, and visual snapshots using the Firecrawl API.

Firecrawl Web Scraper

Extracts structured data, captures screenshots, and parses PDFs from complex websites using the Firecrawl API.

Firecrawl Scraper

Extracts deep web content, parses PDFs, and captures screenshots using the Firecrawl API directly within Claude Code.

GPT Researcher

Conducts autonomous deep research by exploring hundreds of web sources to generate comprehensive, citation-backed reports.

Exa Semantic Search

Performs semantic web searches and similar content discovery using the Exa API to retrieve high-quality research data.

Tavily Web Search & Extraction

Integrates real-time web search and content extraction capabilities into Claude Code using the Tavily API.

Exa Semantic Search

Performs neural, semantic web searches and content discovery using the Exa API to find highly relevant data and research.

Tavily Web Search

Empowers Claude to perform advanced web searches, crawl websites, and extract high-quality content using the Tavily AI search engine.

Playwright Web Scraper

Extracts structured data from complex websites using a robust, three-phase Playwright automation workflow.

Job Description Parser

Extracts structured requirements and metadata from job descriptions to facilitate automated candidate matching and recruitment analysis.

Tavily Web Search & Research

Integrates high-performance web search, content extraction, and site crawling capabilities using the Tavily API for real-time information retrieval.

Deep Research Agent

Conducts automated deep-dive research by searching the web, analyzing sources, and generating structured reports with citations.

Mega Research

Conducts comprehensive, multi-source deep-dives and market analysis by integrating six powerful search and AI APIs for citation-backed reporting.

Twitter Data Extraction (twscrape)

Extracts Twitter/X data using the GraphQL API with automated account rotation and session management.

Z.AI Intelligence CLI

Integrates advanced vision analysis, real-time web search, and GitHub exploration tools directly into the Claude Code environment.

Crypto News Aggregator

Aggregates and filters real-time cryptocurrency news from over 50 authoritative sources with automated relevance scoring.

Exa SDK Installation & Authentication

Configures Exa SDKs and handles API authentication for AI-powered search and data retrieval.

Firecrawl Architecture Variants

Architects scalable Firecrawl integrations using validated monolith, service layer, and microservice patterns.

FireCrawl Cost Optimization

Optimizes FireCrawl API expenses through intelligent tier selection, usage monitoring, and request efficiency strategies.

Exa Core Secondary Workflow

Executes secondary search and data retrieval workflows using the Exa API to complement primary AI-driven discovery tasks.

FireCrawl Core Workflow

Executes the primary FireCrawl workflow to transform web content into structured data for AI applications.