Web Scraping & Data Collection Claude 스킬

Competitor Intelligence Analysis

Gathers comprehensive competitive intelligence across LinkedIn, social media, and the web to track market movements and hiring trends.

Anysite CLI Data Extraction & Pipelines

Automates web data extraction, multi-source dataset pipelines, and LLM-powered data analysis through a unified command-line interface.

Competitor Intelligence & Analysis

Conducts deep-dive competitive research across web, social media, and professional networks to generate actionable market intelligence.

YouTube Video Downloader

Downloads YouTube videos and extracts audio with optimized quality presets for easy sharing and local playback.

Universal Search & Data Retrieval

Executes autonomous search missions across local codebases and the web to return structured, attributed data.

Incremental API Fetcher

Builds resilient data ingestion pipelines that handle paginated API results with state tracking and historical backfills.

Incremental API Fetching

Builds resilient, state-aware data ingestion pipelines for paginated APIs using advanced watermark tracking.

YouTube Data API Wrapper

Accesses and manages YouTube data including video metadata, channel statistics, and comment threads through the official v3 API.

Intelligent Web Scraper

Automates complex web data extraction using self-learning algorithms to navigate pagination, bypass blocks, and analyze page structures autonomously.

Web Scraper & Data Extractor

Extracts web content into structured markdown files using recursive and parallel scraping techniques.

Web Search Fallback Agent

Ensures uninterrupted research capabilities by delegating web searches to autonomous agents when primary search APIs fail or hit limits.

Web Search Verifier

Standardizes multi-source web search protocols to eliminate AI hallucinations when collecting critical macroeconomic and financial data.

Data Collection Quality Guide

Establishes rigorous quality standards and verification methods for market research, patent analysis, and professional data collection tasks.

LitSearch Academic Review Agent

Automates systematic literature reviews and builds structured scholarship databases using the OpenAlex API.

Global Patents Search

Searches global patent databases using natural language queries to discover prior art and track innovation landscapes.

Stock Data Verifier

Implements a rigorous cross-verification protocol for stock and ETF data to prevent AI hallucinations through multi-source validation.

Brand Research Agent

Analyzes brand websites to extract visual identity, voice, and market positioning into a reusable JSON profile for consistent content creation.

Review Analyst Agent

Automates product review collection and sentiment analysis to identify prioritized product improvements and actionable insights.

Firecrawl Self-Hosted Manager

Manages and troubleshoots self-hosted Firecrawl instances for high-performance web-to-markdown scraping.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline viewing and content archival.

Research & Content Analysis

Conducts comprehensive multi-source research, deep content extraction, and intelligent analysis using parallel agents and specialized patterns.

Exa Semantic Search

Empowers Claude with neural web search capabilities to find high-quality information through semantic understanding rather than simple keyword matching.

Perplexity Search for Claude Code

Enhances Claude with real-time web search capabilities using Perplexity models to access current information and scientific citations.

Exa 11-Direction Research Orchestrator

Automates parallel deep-domain research across 11 technical fields to discover niche software packages and theoretical frameworks.

Firecrawl Web Scraping Patterns

Facilitates advanced web scraping, site mapping, and content extraction using optimized Firecrawl workflows.

MQL5 Article Extractor

Extracts and organizes technical trading documentation and articles from mql5.com for research and training data collection.

Mathpix OCR & ACSet Pipeline

Converts mathematical documents and images into structured LaTeX and ACSet formats using resilient balanced ternary checkpoints.

Apify SDK & Actor Development

Streamlines web scraping, data collection, and Actor development using the official Apify JavaScript SDK and platform documentation.

YouTube Transcript Fetcher

Extracts and saves YouTube video transcripts as timestamped text files for analysis, documentation, and content review.

Archive Search Expert

Optimizes searches within the Swedish National Archives by applying historical spelling variants and fuzzy matching for AI-transcribed records.