Web Scraping & Data Collection Claude 技能

Exa Websets Search

Manages automated web searches, structured data enrichment, and entity-based collection building using the Exa.ai engine.

Exa Get Contents

Extracts structured data and AI-generated summaries from any URL with high token efficiency and live crawling.

AI News Crawler & Summarizer

Crawls global AI news sources to generate deduplicated, Chinese-language summaries in a structured JSON format.

Deep Research Professional

Conducts comprehensive market intelligence, company analysis, and competitive research using structured methodologies and automated data collection.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline viewing, editing, and archival.

Article Extractor

Extracts clean, clutter-free content from web articles and blog posts for readable text storage.

YouTube Transcript Downloader

Downloads and processes YouTube video transcripts, subtitles, and captions with automatic fallback to AI-powered transcription.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from ad libraries to uncover winning messaging, pain points, and creative strategies.

Structured Output Fabric

Transforms unstructured text from any source into clean, validated JSON based on specific user-defined fields or schemas.

USPTO Database Connector

Accesses comprehensive USPTO APIs for patent and trademark searches, examination history, and intellectual property analysis.

Perplexity Search for Claude

Enables Claude to perform AI-powered web searches with real-time information and source citations using Perplexity models.

YouTube Transcript Extractor

Extracts and saves subtitles or transcripts from any YouTube video URL directly to your local workspace.

Website Content Extractor

Extracts clean, clutter-free article and blog content from URLs by stripping away ads, navigation, and unnecessary UI elements.

DOM Reader & Web Scraper

Extracts fully rendered HTML and dynamic content from JavaScript-heavy websites using headless browser automation.

RSS Feed Fetcher

Fetches and parses RSS feeds from multiple URLs to gather articles for content creation.

Firecrawl Web Scraper

Scrapes websites, searches the web, and extracts structured data from pages using the token-efficient Firecrawl API.

Playwright Web Scraper

Implements production-proven Playwright web scraping patterns with a selector-first approach and robust error handling.

Web Browser & Scraper

Enables autonomous web scraping and content extraction using shot-scraper to interact with and retrieve data from websites.

Multi-Agent Research Assistant

Orchestrates parallel research agents across Perplexity, Claude, and Gemini to deliver synthesized, multi-perspective reports with source attribution.

FireCrawl

Crawls and scrapes websites to extract structured article content using the FireCrawl API.

PDF to Markdown Converter

Converts complex PDF documents into clean, structured Markdown while preserving tables, formatting, and images for AI context.

Fetch Stores

Fetches business listings, store locations, and restaurant details from Google Maps using the Dumpling AI API.

Industry Research

Conducts comprehensive market analysis and trend forecasting across the consumer, technology, healthcare, and finance sectors.

Jina AI MCP Reader

Installs and configures the Jina AI MCP server to enable high-quality web scraping and URL content extraction within Claude Code.

VeyraX MCP Installer

Automates the installation and configuration of the VeyraX MCP server for enhanced web search and content extraction.

WebMind DOM Analyzer MCP

Integrates the WebMind MCP server into Claude Code to provide advanced DOM analysis and specialized Ragic assistant capabilities.

Gemini Web Search

Performs advanced web searches using Gemini to retrieve real-time, high-relevance information for complex technical queries.

Genome Assembly Dataset Curator

Automates the end-to-end processing and metadata curation of genome assembly datasets for VEuPathDB resources.

Competitive Research with Bright Data

Conducts enterprise-grade company research, competitive analysis, and market intelligence using professional web scraping and search tools.

Literature Sweep

Orchestrates the discovery, retrieval, and organization of academic literature to facilitate theoretical pattern extraction and qualitative research synthesis.