Web Scraping & Data Collection Claude 技能

Search Plus

Overcomes web access restrictions and rate limits by performing federated searches and intelligent content extraction from blocked or challenging URLs.

Crawl4AI

Scrapes websites, extracts structured data, and automates web data collection pipelines using the Crawl4AI library.

Extracting Form Fields

Extracts and structures metadata from PDF form fields into JSON format to facilitate automated document processing and form filling.

Advanced Gemini Web Search

Executes comprehensive web searches using the Gemini command to gather real-time data and detailed information.

Scientific PDF Data Extraction

Extracts and validates structured data from scientific literature collections to create analysis-ready datasets for systematic reviews and meta-analyses.

JSON Data Extraction

Extracts specific data from JSON files efficiently to minimize token usage and improve processing speed.

LangChain Deep Research

Conducts deep, iterative web research to generate comprehensive reports with verified citations and source tracking.

Web Search Optimizer

Performs intelligent web searches using a prioritized MCP strategy to find the most relevant documentation and live technical data.

Research Synthesis

Synthesizes real-world data from multiple search tools into structured narratives and citations for documentation and drafting.

X Content Extraction and Script Generation

Extracts Twitter posts and comments to organize viewpoints and generate professional narration scripts for content production.

YouTube Transcript

Extracts YouTube video transcripts, metadata, and chapters into formatted Markdown files for knowledge management systems.

MQL5 Article Extractor

Extracts and organizes technical trading articles and documentation from mql5.com for research and training data collection.

Exa Answer

Generates fact-based answers and structured data from the web using AI-powered search and synthesis.

Newsletter Event Source Manager

Adds and configures Instagram accounts and web aggregators to local media event tracking systems.

Newsletter Events Research

Extracts event data from Instagram, Facebook, and web aggregators to power local media newsletters.

Ark Technical Research

Conducts deep technical research by gathering multi-source evidence, analyzing GitHub repositories, and documenting implementation options.

Firecrawl Web Scraper

Converts websites into LLM-ready markdown or structured data using the Firecrawl v2 API.

Exa Webset Monitor

Automates the periodic search and refresh of Exa.ai websets to keep your data collections continuously updated.

Managing Fighter Images

Orchestrates a multi-source image pipeline to download, validate, and normalize fighter photos from Wikimedia, Sherdog, and Bing.

Exa Find Similar

Discovers related web content, articles, and research papers using AI-powered similarity matching via Exa.ai.

Exa Semantic Web Search

Empowers Claude with AI-powered semantic search to find web content, research papers, and code repositories by meaning rather than keywords.

Scraping Data Pipeline

Orchestrates the extraction, validation, and database loading of comprehensive fighter data from UFCStats.com using Scrapy spiders.

AI News Crawler & Summarizer

Crawls global AI news sources to generate deduplicated, Chinese-language summaries in a structured JSON format.

DeepSeek OCR Tool

Converts batches of images and scanned documents into structured markdown files using local DeepSeek-OCR models via Ollama.

SearXNG Local Search

Deploys a local, privacy-respecting metasearch engine to aggregate web, package repository, and code results in structured JSON.

Ethical Web Scraping & Data Extraction

Implements ethical, resilient, and legally compliant web scraping strategies to extract high-quality data while avoiding bot detection.

Exa Get Contents

Extracts structured data and AI-generated summaries from any URL with high token efficiency and live crawling.

Exa Websets Search

Manages automated web searches, structured data enrichment, and entity-based collection building using the Exa.ai engine.

Exa Deep Research

Conducts complex, multi-step asynchronous research and deep analysis using Exa's AI-driven search engine.

Article Extractor

Extracts clean, clutter-free content from web articles and blog posts for readable text storage.