Web Scraping & Data Collection Claude 스킬

Search Plus

Overcomes web access restrictions and rate limits by performing federated searches and intelligent content extraction from blocked or challenging URLs.

AI-Powered PDF Text Extractor

Converts PDF documents into LLM-friendly Markdown while preserving complex structures like tables, headers, and lists.

Crawl4AI

Scrapes websites, extracts structured data, and automates web data collection pipelines using the Crawl4AI library.

Extracting Form Fields

Extracts and structures metadata from PDF form fields into JSON format to facilitate automated document processing and form filling.

YouTube Transcript

Extracts YouTube video transcripts, metadata, and chapters into formatted Markdown files for knowledge management systems.

X Content Extraction and Script Generation

Extracts Twitter posts and comments to organize viewpoints and generate professional narration scripts for content production.

Web Search Optimizer

Performs intelligent web searches using a prioritized MCP strategy to find the most relevant documentation and live technical data.

Scientific PDF Data Extraction

Extracts and validates structured data from scientific literature collections to create analysis-ready datasets for systematic reviews and meta-analyses.

Advanced Gemini Web Search

Executes comprehensive web searches using the Gemini command to gather real-time data and detailed information.

JSON Data Extraction

Extracts specific data from JSON files efficiently to minimize token usage and improve processing speed.

LangChain Deep Research

Conducts deep, iterative web research to generate comprehensive reports with verified citations and source tracking.

Exa Webset Monitor

Automates the periodic search and refresh of Exa.ai websets to keep your data collections continuously updated.

Exa Deep Research

Conducts complex, multi-step asynchronous research and deep analysis using Exa's AI-driven search engine.

Exa Websets Search

Manages automated web searches, structured data enrichment, and entity-based collection building using the Exa.ai engine.

MQL5 Article Extractor

Extracts and organizes technical trading articles and documentation from mql5.com for research and training data collection.

Exa Get Contents

Extracts structured data and AI-generated summaries from any URL with high token efficiency and live crawling.

Newsletter Event Source Manager

Adds and configures Instagram accounts and web aggregators to local media event tracking systems.

SearXNG Local Search

Deploys a local, privacy-respecting metasearch engine to aggregate web, package repository, and code results in structured JSON.

Newsletter Events Research

Extracts event data from Instagram, Facebook, and web aggregators to power local media newsletters.

Ethical Web Scraping & Data Extraction

Implements ethical, resilient, and legally compliant web scraping strategies to extract high-quality data while avoiding bot detection.

AI News Crawler & Summarizer

Crawls global AI news sources to generate deduplicated, Chinese-language summaries in a structured JSON format.

Firecrawl Web Scraper

Converts websites into LLM-ready markdown or structured data using the Firecrawl v2 API.

Managing Fighter Images

Orchestrates a multi-source image pipeline to download, validate, and normalize fighter photos from Wikimedia, Sherdog, and Bing.

Ark Technical Research

Conducts deep technical research by gathering multi-source evidence, analyzing GitHub repositories, and documenting implementation options.

Scraping Data Pipeline

Orchestrates the extraction, validation, and database loading of comprehensive fighter data from UFCStats.com using Scrapy spiders.

DeepSeek OCR Tool

Converts batches of images and scanned documents into structured markdown files using local DeepSeek-OCR models via Ollama.

Exa Semantic Web Search

Empowers Claude with AI-powered semantic search to find web content, research papers, and code repositories by meaning rather than keywords.

PDF Smart Extractor

Extracts and analyzes large PDF documents locally with semantic chunking to minimize token usage and maximize context efficiency.

Exa Find Similar

Discovers related web content, articles, and research papers using AI-powered similarity matching via Exa.ai.

Exa Answer

Generates fact-based answers and structured data from the web using AI-powered search and synthesis.