Web Scraping & Data Collection Claude 技能

Web Research & Synthesis

Conducts structured, multi-threaded web research by spawning specialized subagents to gather and synthesize information.

Web Research Pro

Verifies technical requirements and gathers real-time information through structured web searches and documentation analysis.

Gemini Web Search

Enhances Claude with advanced web search capabilities using Gemini to retrieve and synthesize real-time information from the internet.

Persistent Sector Caching

Optimizes yfinance data retrieval by implementing a permanent SQLite caching layer to bypass API rate limits and 401 errors.

YT-DLP Video Downloader

Downloads audio and video from thousands of websites with advanced control over formats, subtitles, and metadata.

Web Search

Performs structured web searches via DuckDuckGo to retrieve real-time documentation, library information, and technical solutions.

Firecrawl Scraper

Extracts clean, structured data from any website using the powerful Firecrawl API for deep web crawling and scraping.

YouTube Transcript Extractor

Extracts high-quality subtitles and transcripts from YouTube videos in multiple formats and languages for analysis and automation.

Crawl4AI

Crawls entire websites and extracts clean, structured content into markdown files with AI-enriched metadata.

Video Downloader

Automates video and audio downloads from various web platforms with customizable quality and format settings using yt-dlp.

APOD Downloader

Downloads NASA's Astronomy Picture of the Day along with detailed metadata directly to your desktop.

Insight Extractor

Extracts valuable insights and key information from URLs or text documents to streamline information processing.

bioRxiv Database Search

Searches and retrieves life sciences preprints from the bioRxiv database using keywords, authors, and DOIs.

Website Crawler

Maps complex website structures and discovers URLs using a high-performance Go-powered engine with TypeScript integration.

Structured Evidence Collection

Standardizes research by creating traceable YAML evidence objects with semantic IDs and confidence scores to ensure data-driven decision making.

Deep Research Diffusion

Conducts exhaustive, multi-perspective research using parallel agent workers and iterative gap detection.

Structured Web Research

Conducts systematic web investigations by deploying parallel subagents to gather, verify, and synthesize information from multiple sources.

Web Research & Synthesis

Conducts multi-threaded, deep-dive web investigations by orchestrating parallel subagents to gather and synthesize complex information.

Web Research & Synthesis

Conducts structured, multi-threaded web research by delegating sub-tasks to specialized agents and synthesizing findings into comprehensive reports.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality, format, and output settings using yt-dlp.

YouTube Transcript Downloader

Extracts and cleans transcripts, subtitles, and captions from YouTube videos using yt-dlp and OpenAI Whisper for AI-powered transcription.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging and creative patterns.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging, creative patterns, and market positioning.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly within Claude Code.

Crawl4AI Web Scraper

Extracts clean markdown and structured data from any website, including JavaScript-heavy single-page applications.

Wikidata Search & Authority Control

Searches the Wikidata knowledge base to retrieve structured entity details and universal external identifiers.

Tavily Web Search

Performs real-time web searches using Tavily's LLM-optimized engine to retrieve filtered snippets, scores, and metadata.

HTML Parser Rule Writer

Generates and validates robust regex-based HTML parsing rules to extract article titles, links, and metadata from webpages.

Reddit Research

Researches Reddit communities, threads, and wikis to gather community insights and generate structured research reports.

YouTube & Media Downloader

Downloads videos, audio, and subtitles from YouTube and other online platforms using yt-dlp.