Web Scraping & Data Collection Claude 스킬

Alpha Finder

Gathers real-time market intelligence from across the web and social media to inform prediction market trading decisions.

Professional People Search

Conducts real-time OSINT research to retrieve verified career timelines, professional backgrounds, and biographical data for individuals and entities.

Gemini Web Search

Performs advanced web searches using Gemini to retrieve real-time, high-relevance information for complex technical queries.

bioRxiv Database Search

Searches and retrieves life sciences preprints from the bioRxiv database using keywords, authors, and DOIs.

Website Crawler

Maps complex website structures and discovers URLs using a high-performance Go-powered engine with TypeScript integration.

Structured Evidence Collection

Standardizes research by creating traceable YAML evidence objects with semantic IDs and confidence scores to ensure data-driven decision making.

Deep Research Diffusion

Conducts exhaustive, multi-perspective research using parallel agent workers and iterative gap detection.

WebMind DOM Analyzer MCP

Integrates the WebMind MCP server into Claude Code to provide advanced DOM analysis and specialized Ragic assistant capabilities.

Image Extraction

Extracts and correlates high-quality food images from delivery platforms and restaurant websites to populate digital catalogs and menus.

Gemini Google Search Tool

Integrates Gemini AI models with real-time web content through Google Search grounding to provide verified information and automatic citations.

PDF to Markdown Converter

Converts entire PDF documents into clean, structured Markdown while preserving formatting, tables, and images for seamless context loading.

Web Reference Fetcher

Fetches web documentation, extracts specific topics using AI subagents, and generates structured markdown summaries.

Jina AI MCP Reader

Installs and configures the Jina AI MCP server to enable high-quality web scraping and URL content extraction within Claude Code.

Structured Web Research

Conducts systematic web investigations by deploying parallel subagents to gather, verify, and synthesize information from multiple sources.

Web Research & Synthesis

Conducts multi-threaded, deep-dive web investigations by orchestrating parallel subagents to gather and synthesize complex information.

Web Scraper

Performs concurrent, recursive web scraping to extract clean text content while maintaining URL-based directory structures and respecting domain boundaries.

Web Research & Synthesis

Conducts structured, multi-threaded web research by delegating sub-tasks to specialized agents and synthesizing findings into comprehensive reports.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality, format, and output settings using yt-dlp.

Literature Sweep

Orchestrates the discovery, retrieval, and organization of academic literature to facilitate theoretical pattern extraction and qualitative research synthesis.

Interview Ingest

Converts interview recordings, academic PDFs, and various document formats into structured markdown for qualitative analysis.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging and creative patterns.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging, creative patterns, and market positioning.

Web Research Assistant

Orchestrates systematic web research through automated planning, parallel subagent delegation, and comprehensive report synthesis.

Structured Web Research

Conducts systematic web research by planning subtasks, delegating to research agents, and synthesizing findings into comprehensive reports.

AI Research Collector

Aggregates and preprocesses high-quality AI programming tips and best practices from major developer platforms.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly within Claude Code.

Wikidata Search & Authority Control

Searches the Wikidata knowledge base to retrieve structured entity details and universal external identifiers.

Web Scraper Data Processor

Processes raw web scraping data into clean, formatted Excel reports with automated statistical analysis and deduplication.

URL Reader Mode to Markdown

Transforms web URLs into clean, distraction-free Markdown files using reader-mode heuristics and automated filename sanitization.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline viewing and archival.