Web Scraping & Data Collection Claudeスキル

GPT Researcher

Conducts autonomous deep research by exploring hundreds of web sources to generate comprehensive, citation-backed reports.

Research Free

Conducts comprehensive web research and generates detailed reports without requiring external search API keys.

Exa Semantic Search

Conducts semantic web searches and discovers similar content using the Exa AI-powered search engine.

YouTube & Video Downloader

Downloads videos, audio, and subtitles from YouTube and other platforms using yt-dlp with optimized settings.

Twitter/X Media Downloader

Downloads high-quality images and videos from Twitter/X using automated gallery-dl workflows.

Tavily Web Search

Conducts real-time, AI-optimized web searches and content extraction to provide up-to-date information beyond Claude's knowledge cutoff.

Google Places Search

Queries the Google Places API to search for locations, retrieve place details, and fetch reviews directly within the terminal.

Google Places Search

Integrates Google Places API into your workflow for searching locations, retrieving business details, and analyzing reviews.

Firecrawl Web Scraper

Converts complex websites into LLM-ready markdown or structured data with advanced anti-bot bypass and autonomous AI navigation.

RFP Data Ingestion Engine

Automates the collection, normalization, and deduplication of Request for Proposal (RFP) opportunities from government and private data sources.

Iterative Fact Verification

Ensures rigorous factual accuracy through systematic, multi-pass evidence validation and source tiering.

Webpage Summarizer & Markdown Generator

Extracts web content from static and dynamic sites and transforms it into structured, high-quality Markdown documentation.

Web Crawler & Search Indexer

Crawls entire websites and builds searchable full-text indexes of content converted into Markdown format.

Web Scraper Quality Assurance

Enforces a rigorous, test-driven development workflow for building and maintaining web scrapers and data extraction agents.

XLSForm Designer

Simplifies the creation of standardized data collection forms in Excel for mobile survey platforms like ODK and KoBoToolbox.

bioRxiv Preprint Search

Accesses and retrieves research papers from the bioRxiv preprint server for literature reviews and trend analysis.

Crawl4AI Web Scraper

Converts complex web pages into clean, LLM-friendly markdown for seamless data extraction and processing.

LinkedIn Resume & Job Optimizer

Automates LinkedIn job searching and generates ATS-optimized resumes with integrated skill gap analysis and interview preparation.

Smart Link Extractor

Extracts core resources from social media and technical blogs to generate structured Markdown archives with intelligent categorization.

Video Downloader

Downloads videos and audio from YouTube and other platforms for offline viewing, archiving, and media editing.

Scraper Code Generator

Generates high-performance, robust Python code for scraping and parsing structured API documentation from HTML.

Doc Site Analysis

Analyzes API documentation structures to identify data extraction patterns for automated scraper generation.

Valyu Search & Research Toolkit

Empowers Claude with multi-domain search, AI-driven answers, content extraction, and comprehensive deep research reporting.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline access, archival, and content repurposing.

Actress Classifier Development Guide

Streamlines the development of Python-based video classification systems with optimized scraping and incremental database management.

Blog & RSS Monitor

Monitors and manages updates from blogs and RSS/Atom feeds directly through the CLI.

Exa Semantic Search

Performs high-precision semantic searches and intent-based research using the Exa AI search engine.

Firecrawl Scraper

Automates deep web scraping, PDF parsing, and visual snapshots using the Firecrawl API.

Firecrawl Web Scraper

Extracts structured data, captures screenshots, and parses PDFs from complex websites using the Firecrawl API.

Firecrawl Scraper

Extracts deep web content, parses PDFs, and captures screenshots using the Firecrawl API directly within Claude Code.