Web Scraping & Data Collection Claudeスキル

MCP Opportunity Pipeline

Automates the end-to-end lifecycle of discovering, validating, building, and publishing Model Context Protocol (MCP) servers and automation tools.

Market Research Intelligence

Conducts rigorous competitive analysis, market sizing, and investor due diligence with verified source attribution and decision-oriented summaries.

Flight Sweep Optimizer

Automates multi-date flight data collection and comprehensive analysis to identify the most efficient and cost-effective travel itineraries.

Web Search

Retrieves real-time information, news, images, and videos from the web using DuckDuckGo to provide up-to-date data and resources.

Video Subtitle Extractor

Extracts and cleans transcripts from global video platforms like YouTube and Bilibili into readable text files.

Weather Data Fetcher

Retrieves real-time temperature data from the wttr.in API for specific geographic locations.

Unified Research

Aggregates data from multiple search APIs like Tavily, SerpAPI, and Perplexity to provide comprehensive, fact-based research summaries.

Documentation Crawler

Automates the process of crawling, extracting, and converting documentation websites into structured Markdown or Claude Code skills.

Professional People Search

Conducts real-time OSINT research to retrieve verified career timelines, professional backgrounds, and biographical data for individuals and entities.

Alpha Finder

Gathers real-time market intelligence from across the web and social media to inform prediction market trading decisions.

Gemini Web Search

Integrates Google Gemini's web search capabilities into Claude Code for comprehensive, real-time information retrieval.

Google Places CLI Integration

Searches, resolves, and extracts detailed business information using the New Google Places API directly within the terminal.

Rust Web Crawler

Extracts website content and structure at high speeds to generate LLM-ready Markdown, interactive site maps, and structured data for RAG pipelines.

Deep Research Orchestrator

Orchestrates multi-agent parallel workflows to perform comprehensive web research, data collection, and structured report generation.

YouTube & HLS Video Downloader

Downloads high-quality video and audio from YouTube and HLS streaming platforms like Vimeo and Mux using yt-dlp and ffmpeg.

Video & Transcript Downloader

Downloads videos, audio, and clean paragraph-style transcripts from YouTube and other yt-dlp supported platforms.

Obsidian Web Clipper Template Creator

Generates structured JSON templates for the Obsidian Web Clipper by analyzing web page metadata and verifying CSS selectors.

Tavily Web Search & Extraction

Provides real-time web search, content extraction, and automated site crawling capabilities powered by the Tavily API.

Tavily Web Search

Empowers Claude with real-time web search, automated content extraction, and deep research capabilities using the Tavily API.

Tavily Web Search

Empowers Claude with real-time web search, content extraction, and advanced crawling capabilities using the Tavily API.

Firecrawl Web Scraper

Extracts clean web content, captures screenshots, and parses PDFs using the powerful Firecrawl API.

Firecrawl Scraper

Automates complex web data extraction, page crawling, and document parsing using the Firecrawl API.

Unified Web Search

Performs simultaneous multi-engine searches using Gemini, Codex, and Claude to provide a consolidated, high-precision information report.

Media Downloader

Downloads high-quality video and audio from over 1,000 platforms with automated metadata extraction and QR code support.

Deep Research & Analysis

Conducts exhaustive, multi-threaded investigations using parallel agent teams to produce high-confidence synthesized reports from 20+ sources.

Article Extractor

Extracts clean, readable text from web articles and blog posts by removing ads, navigation, and clutter.

Research Reporter

Automates information gathering from web searches and authoritative sources to generate and save structured research reports.

API Scraper Architect

Provides standardized architectural patterns and Pydantic models for building robust API documentation scrapers.

Firecrawl Real Estate Scraper

Extracts structured property data from real estate listing URLs using Firecrawl AI for market analysis and content creation.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly through the command line.