Web Scraping & Data Collection Claudeスキル

Scrapfly Web Automation

Automates advanced web scraping and data extraction tasks using the Scrapfly toolkit via Rube MCP.

Ipdata Automation

Automates IP geolocation, threat intelligence, and metadata enrichment using the Ipdata.co API through Rube MCP.

Scrapfly Automation

Automates advanced web scraping and anti-bot bypass workflows using the Scrapfly toolkit via Rube MCP.

Universal Search & Data Retrieval

Executes autonomous search missions across local codebases and the web to return structured, attributed data.

Parallel AI Research

Conducts deep web research, competitive intelligence, and automated data enrichment using specialized Parallel AI APIs.

Ontopo Restaurant Finder

Searches Israeli restaurants and manages table availability queries through the Ontopo platform directly from the terminal.

Incremental API Fetcher

Builds resilient data ingestion pipelines that handle paginated API results with state tracking and historical backfills.

Incremental API Fetching

Builds resilient, state-aware data ingestion pipelines for paginated APIs using advanced watermark tracking.

YouTube Tools

Downloads YouTube videos, extracts transcripts, and retrieves comprehensive video metadata for local analysis and research.

Apify Social & Web Scrapers

Extracts structured data from major social media platforms, Google Maps, and websites using optimized Apify actors and automated workflows.

Firecrawl Web Scraping

Scrapes and converts web pages into clean, LLM-ready markdown using the Firecrawl API to handle JavaScript and anti-bot protections.

Real-time Web Search

Enables Claude to search the web for real-time information using multiple search engine providers.

LitSearch Academic Review Agent

Automates systematic literature reviews and builds structured scholarship databases using the OpenAlex API.

Firecrawl Self-Hosted Manager

Manages and troubleshoots self-hosted Firecrawl instances for high-performance web-to-markdown scraping.

Prediction Market Odds

Retrieves real-time odds and market data from leading prediction platforms like Polymarket and Kalshi.

Prediction Market Odds

Retrieves real-time odds, prices, and trading activity from leading prediction markets like Polymarket and Kalshi.

Web Search Fallback Agent

Ensures uninterrupted research capabilities by delegating web searches to autonomous agents when primary search APIs fail or hit limits.

Brand Research Agent

Analyzes brand websites to extract visual identity, voice, and market positioning into a reusable JSON profile for consistent content creation.

Stock Data Verifier

Implements a rigorous cross-verification protocol for stock and ETF data to prevent AI hallucinations through multi-source validation.

Data Collection Quality Guide

Establishes rigorous quality standards and verification methods for market research, patent analysis, and professional data collection tasks.

Global Patents Search

Searches global patent databases using natural language queries to discover prior art and track innovation landscapes.

Web Research Agent

Conducts deep technical research and documentation synthesis using Perplexity, Firecrawl, and Context7 MCP servers.

Documentation Scraper

Scrapes and extracts actionable technical documentation from any URL using Firecrawl for immediate implementation.

RSS Feed Parser Expert

Parses and validates complex podcast RSS feeds using industry standards like iTunes and Podcasting 2.0 namespaces.

Deep Research Methodology

Orchestrates multi-agent web research sessions to generate hallucination-resistant reports with verified citations.

Source Evaluation & Credibility

Validates the credibility of online sources and technical artifacts to ensure high-quality research and prevent information contamination.

Research Methodology Framework

Implements academic research strategies and decomposition techniques to scale AI-driven investigations from simple facts to complex multi-faceted queries.

Review Analyst Agent

Automates product review collection and sentiment analysis to identify prioritized product improvements and actionable insights.

Intelligent Web Scraper

Automates complex web data extraction using self-learning algorithms to navigate pagination, bypass blocks, and analyze page structures autonomously.

Web Search Verifier

Standardizes multi-source web search protocols to eliminate AI hallucinations when collecting critical macroeconomic and financial data.