Web Scraping & Data Collection Claude 스킬

Smart Link Extractor

Extracts core resources from social media and technical blogs to generate structured Markdown archives with intelligent categorization.

bioRxiv Preprint Search

Accesses and retrieves research papers from the bioRxiv preprint server for literature reviews and trend analysis.

Video & Transcript Downloader

Downloads videos, audio, and clean paragraph-style transcripts from YouTube and other yt-dlp supported platforms.

YouTube & HLS Video Downloader

Downloads high-quality video and audio from YouTube and HLS streaming platforms like Vimeo and Mux using yt-dlp and ffmpeg.

Deep Research Orchestrator

Orchestrates multi-agent parallel workflows to perform comprehensive web research, data collection, and structured report generation.

Webpage Summarizer & Markdown Generator

Extracts web content from static and dynamic sites and transforms it into structured, high-quality Markdown documentation.

RFP Data Ingestion Engine

Automates the collection, normalization, and deduplication of Request for Proposal (RFP) opportunities from government and private data sources.

Industry Research

Conducts comprehensive market analysis and trend forecasting across the consumer, technology, healthcare, and finance sectors.

Jina AI MCP Reader

Installs and configures the Jina AI MCP server to enable high-quality web scraping and URL content extraction within Claude Code.

VeyraX MCP Installer

Automates the installation and configuration of the VeyraX MCP server for enhanced web search and content extraction.

Firecrawl Web Scraper

Converts complex websites into LLM-ready markdown or structured data with advanced anti-bot bypass and autonomous AI navigation.

Rust Web Crawler

Extracts website content and structure at high speeds to generate LLM-ready Markdown, interactive site maps, and structured data for RAG pipelines.

Google Places Search

Integrates Google Places API into your workflow for searching locations, retrieving business details, and analyzing reviews.

Google Places Search

Queries the Google Places API to search for locations, retrieve place details, and fetch reviews directly within the terminal.

Twitter/X Media Downloader

Downloads high-quality images and videos from Twitter/X using automated gallery-dl workflows.

YouTube & Video Downloader

Downloads videos, audio, and subtitles from YouTube and other platforms using yt-dlp with optimized settings.

Exa Semantic Search

Conducts semantic web searches and discovers similar content using the Exa AI-powered search engine.

Research Free

Conducts comprehensive web research and generates detailed reports without requiring external search API keys.

GPT Researcher

Conducts autonomous deep research by exploring hundreds of web sources to generate comprehensive, citation-backed reports.

Deep Research Agent

Conducts automated deep-dive research by searching the web, analyzing sources, and generating structured reports with citations.

Mega Research

Conducts comprehensive, multi-source deep-dives and market analysis by integrating six powerful search and AI APIs for citation-backed reporting.

Deep Research Explorer

Automates the discovery and collection of multi-source research data into structured, evidence-based datasets.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms directly through the Claude Code interface.

YouTube Transcript Downloader

Extracts and converts YouTube transcripts or auto-generated captions into clean, readable text files.

Advanced Video Downloader

Downloads high-quality videos and extracts audio from over 1000 platforms including YouTube, Bilibili, and TikTok using yt-dlp.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to uncover successful messaging patterns and creative strategies.

RSS Reader & Feed Parser

Parses and monitors RSS/Atom feeds to extract structured updates from news sites, blogs, and social platforms.

Gemini Web Search

Integrates Google Gemini's web search capabilities into Claude Code for comprehensive, real-time information retrieval.

AI Research Collector

Aggregates and preprocesses high-quality AI programming tips and best practices from major developer platforms.

Alpha Finder

Gathers real-time market intelligence from across the web and social media to inform prediction market trading decisions.