Web Scraping & Data Collection Claude 스킬

Listennotes Automation

Automates podcast discovery and data extraction using the Listennotes API via Rube MCP.

Scrapfly Automation

Automates advanced web scraping and data extraction tasks by integrating the Scrapfly toolkit via Rube MCP.

Scrapfly Automation

Automates advanced web scraping and data extraction tasks by integrating Scrapfly via the Rube MCP server.

Scrapfly Automation

Automates advanced web scraping and data extraction tasks using the Scrapfly toolkit via Rube MCP.

X to Markdown Converter

Converts X (Twitter) posts, threads, and articles into clean, formatted Markdown files for documentation and archiving.

Opengraph IO Automation

Automates website metadata extraction and Open Graph tag generation using the Opengraph IO toolkit via Rube MCP.

Parsera Web Scraping Automation

Automates intelligent web scraping and data extraction tasks using Parsera via the Rube MCP framework.

Browse AI Automation

Automates web data extraction and browser-based workflows using Browseai through the Rube MCP server.

IP2Whois Automation

Automates domain WHOIS lookups and IP intelligence gathering using the Rube MCP and Composio toolkit.

Parsehub Automation

Automates web scraping workflows and data collection tasks using Parsehub through the Rube MCP server.

Incremental API Fetching

Builds resilient, state-aware data ingestion pipelines for paginated APIs using advanced watermark tracking.

Incremental API Fetcher

Builds resilient data ingestion pipelines that handle paginated API results with state tracking and historical backfills.

Real-time Web Search

Enables Claude to search the web for real-time information using multiple search engine providers.

Parallel AI Research

Conducts deep web research, competitive intelligence, and automated data enrichment using specialized Parallel AI APIs.

Firecrawl Web Scraping

Scrapes and converts web pages into clean, LLM-ready markdown using the Firecrawl API to handle JavaScript and anti-bot protections.

YouTube Tools

Downloads YouTube videos, extracts transcripts, and retrieves comprehensive video metadata for local analysis and research.

Ontopo Restaurant Finder

Searches Israeli restaurants and manages table availability queries through the Ontopo platform directly from the terminal.

Apify Social & Web Scrapers

Extracts structured data from major social media platforms, Google Maps, and websites using optimized Apify actors and automated workflows.

Universal Search & Data Retrieval

Executes autonomous search missions across local codebases and the web to return structured, attributed data.

Prediction Market Odds

Retrieves real-time odds, prices, and trading activity from leading prediction markets like Polymarket and Kalshi.

Web Search Verifier

Standardizes multi-source web search protocols to eliminate AI hallucinations when collecting critical macroeconomic and financial data.

RSS Feed Parser Expert

Parses and validates complex podcast RSS feeds using industry standards like iTunes and Podcasting 2.0 namespaces.

Intelligent Web Scraper

Automates complex web data extraction using self-learning algorithms to navigate pagination, bypass blocks, and analyze page structures autonomously.

YouTube Data API Wrapper

Accesses and manages YouTube data including video metadata, channel statistics, and comment threads through the official v3 API.

Web Research Agent

Conducts deep technical research and documentation synthesis using Perplexity, Firecrawl, and Context7 MCP servers.

Brand Research Agent

Analyzes brand websites to extract visual identity, voice, and market positioning into a reusable JSON profile for consistent content creation.

Review Analyst Agent

Automates product review collection and sentiment analysis to identify prioritized product improvements and actionable insights.

Firecrawl Self-Hosted Manager

Manages and troubleshoots self-hosted Firecrawl instances for high-performance web-to-markdown scraping.

Global Patents Search

Searches global patent databases using natural language queries to discover prior art and track innovation landscapes.

Stock Data Verifier

Implements a rigorous cross-verification protocol for stock and ETF data to prevent AI hallucinations through multi-source validation.