Web Scraping & Data Collection Claude 스킬

Web Research Agent

Executes multi-perspective web searches and generates structured research reports with source attribution and uncertainty analysis.

WASDE Data Ingestor

Automates the extraction and parsing of monthly USDA WASDE reports into standardized datasets for agricultural market analysis.

AI Research Collector

Aggregates and preprocesses high-quality AI programming tips and best practices from major developer platforms.

RuTracker Torrent Manager

Automates searching, filtering, and downloading torrents from RuTracker using Playwright and aria2c.

Structured Web Research

Conducts systematic web research by planning subtasks, delegating to research agents, and synthesizing findings into comprehensive reports.

Markdown URL Extractor

Converts web URLs into clean, raw markdown to minimize context window usage and eliminate HTML noise.

Web Research Assistant

Orchestrates systematic web research through automated planning, parallel subagent delegation, and comprehensive report synthesis.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly through the terminal.

Interview Ingest

Converts interview recordings, academic PDFs, and various document formats into structured markdown for qualitative analysis.

Literature Sweep

Orchestrates the discovery, retrieval, and organization of academic literature to facilitate theoretical pattern extraction and qualitative research synthesis.

Web Scraper

Performs concurrent, recursive web scraping to extract clean text content while maintaining URL-based directory structures and respecting domain boundaries.

Web Reference Fetcher

Fetches web documentation, extracts specific topics using AI subagents, and generates structured markdown summaries.

Pure.md MCP Installer

Automates the installation and configuration of the Pure.md MCP server for seamless web-to-markdown conversion within Claude Code.

Playbooks Fetch

Converts any URL into clean, structured Markdown with YAML metadata for efficient content consumption and LLM processing.

PDF to Markdown Converter

Converts entire PDF documents into clean, structured Markdown while preserving formatting, tables, and images for seamless context loading.

Gemini Google Search Tool

Integrates Gemini AI models with real-time web content through Google Search grounding to provide verified information and automatic citations.

Image Extraction

Extracts and correlates high-quality food images from delivery platforms and restaurant websites to populate digital catalogs and menus.

Web Content Fetcher

Scrapes web pages and WeChat articles to produce clean, noise-free Markdown content for processing, translation, or archival.

Market Research Setup

Configures the essential Brave Search MCP integration and environment settings required for automated market research workflows.

Web Researcher

Conducts deep, multi-source web research and synthesis without cluttering the primary conversation context.

Web Scraper Quality Assurance

Enforces a rigorous, test-driven development workflow for building and maintaining web scrapers and data extraction agents.

RSS Feed Operations

Reads and processes RSS/Atom feeds from any blog URL with intelligent automatic feed discovery.

XLSForm Designer

Simplifies the creation of standardized data collection forms in Excel for mobile survey platforms like ODK and KoBoToolbox.

LinkedIn Resume & Job Optimizer

Automates LinkedIn job searching and generates ATS-optimized resumes with integrated skill gap analysis and interview preparation.

Video Downloader

Downloads videos and audio from YouTube and other platforms for offline viewing, archiving, and media editing.

WeChat Article Fetcher & Research Analyst

Fetches and ranks WeChat articles based on research interests with seamless Obsidian integration.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline access, archival, and content repurposing.

Competition Scraper & GitHub Persister

Scrapes Australian creative writing competitions and automatically manages them as structured GitHub issues with intelligent duplicate detection.

Video Downloader

Automates video and audio downloads from YouTube and other platforms with customizable quality and format options.

Structured Web Research

Orchestrates parallel subagents to conduct systematic, well-documented web research and synthesize findings into comprehensive reports.