Web Scraping & Data Collection Agent Skills

Exa Semantic Search

Powers Claude Code with semantic search, similar content discovery, and structured research capabilities via the Exa API.

Article Extractor

Extracts clean, readable text from web articles and blog posts by removing ads, navigation, and clutter.

Wget URL Reader

Fetches and downloads content from any URL using the powerful wget command-line utility.

Web Reader

Fetches and converts web pages into clean, readable Markdown or text for Claude to process and analyze.

Web Search Prime

Executes high-speed web searches to retrieve titles, URLs, and snippets without requiring a browser environment.

China Macro News Aggregator

Aggregates and summarizes real-time China macro-economic news from premium financial sources into professional magazine-style reports.

Threads Scraper

Scrapes and extracts post data from Threads profiles using automated browser navigation and authentication.

Brave Search Integration

Performs headless web searches and extracts readable markdown content using the Brave Search API without requiring a browser.

Blockchain Data Pipeline Validation

Validates blockchain data collection pipelines using a systematic 5-step empirical workflow to ensure data integrity and storage efficiency.

Jina AI MCP Reader

Installs and configures the Jina AI MCP server to enable high-quality web scraping and URL content extraction within Claude Code.

Hot List Data Enrichment

Automates company data enrichment for investment dashboards by fetching employee counts, job postings, and news mentions.

Exa Semantic Web Search

Empowers Claude with semantic, neural search capabilities and specialized web filtering using the Exa API.

YouTube Video to Audio

Downloads and converts YouTube videos into high-quality audio files using yt-dlp and ffmpeg.

Google Places Integration

Queries the Google Places API to search for locations, retrieve place details, and resolve addresses directly within your workflow.

Grocer - Local Store Product Finder

Finds real-time product prices, stock availability, and direct links from local retailers using browser automation.

Ebook Text Extractor

Extracts clean, plain text from EPUB, MOBI, and PDF files for analysis and data processing.

Anime Official Site Researcher

Retrieves seasonal anime listings and official website URLs using the AniList GraphQL API.

Anime Streaming Research Orchestrator

Automates the bulk discovery and analysis of seasonal anime streaming availability across multiple platforms.

Scanner Excel Extraction

Extracts, transforms, and structures data from complex Excel files into JSON or CSV formats.

Anime Streaming Researcher

Researches and identifies official anime streaming availability by navigating official websites using automated browser tools.

Summarize CLI Integration

Summarizes URLs, PDFs, audio files, and YouTube videos using various AI models directly from the command line.

Firecrawl Web Operations

Replaces standard web tools with high-accuracy scraping, searching, and crawling optimized for LLM context windows.

Scanner PDF Analysis

Analyzes PDF documents to extract structured data, including tables, section headers, and metadata, while providing automated summaries.

Google Places Integration

Queries the Google Places API to retrieve business locations, venue details, and reviews directly through the CLI.

Web Connectivity and Search

Searches the internet and converts live webpage content into markdown for real-time information retrieval and analysis.

Google Places Search

Integrates Google Places API capabilities to search, resolve, and retrieve detailed information about businesses and locations.

Gopher Research & Knowledge Synthesis

Researches topics across Gopher-style content sources and saves structured, synthesized summaries to a local knowledge vault.

Deep Research Automation

Automates comprehensive multi-step investigations by leveraging Gemini's Deep Research mode directly through the Claude CLI.

Add Awesome Tool

Analyzes AI tool URLs to extract metadata and automatically categorizes and adds them to the awesome-ai-tools repository.

Regex & LLM Structured Text Parsing

Optimizes text extraction by combining high-speed regex patterns with LLM validation for complex edge cases.