Web Scraping & Data Collection Claudeスキル

Defuddle Content Extractor

Extracts clean, clutter-free markdown from web pages to optimize token usage and improve AI context readability.

URL to Markdown Converter

Converts any webpage into clean, structured Markdown using Chrome CDP for accurate rendering of complex web content and media.

Idea Analyzer

Evaluates business ideas from multiple media sources to filter hype, assess market viability, and determine strategic fit.

I1 Research Paper Retrieval Agent

Automates multi-database academic paper fetching and deduplication for systematic literature reviews.

MAiDAS Reader

Browses and extracts structured data from MAiDAS-compatible websites using the Markdown AI Data Access Standard.

Apify Automation for Claude Code

Automates web scraping and data extraction by running Apify Actors and managing datasets directly within your terminal.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to uncover winning messaging, creative patterns, and market positioning.

Kadoa Web Automation

Automates web data extraction and Kadoa tasks using the Rube MCP and Composio toolkit.

Piloterr Automation

Automates web scraping and data enrichment tasks by integrating Piloterr capabilities directly into Claude via Rube MCP.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover winning messaging, creative patterns, and market positioning.

YouSearch Automation

Automates information retrieval and complex search operations using the YouSearch toolkit via Rube MCP and Composio.

Zenrows Automation

Automates web scraping and anti-bot bypass workflows using Zenrows through the Rube MCP and Composio toolkit.

Tavily Search Automation

Automates real-time web research and data retrieval using the Tavily AI search engine via Rube MCP.

Firecrawl Web Automation

Automates complex web crawling, structured data extraction, and site mapping using AI-powered Firecrawl tools.

Zenserp Automation

Automates search engine results extraction and analysis using the Zenserp API via Rube MCP and Composio.

Scrapingant Automation

Automates advanced web scraping and data extraction tasks using the Scrapingant API through Rube MCP and Composio.

TripAdvisor API Automation

Automates interactions with the TripAdvisor Content API using Rube MCP and Composio to manage travel listings and reviews.

Linkup Automation

Automates real-time web search and information retrieval workflows using the Linkup toolkit and Rube MCP.

Wachete Automation

Automates website monitoring and change tracking tasks using the Wachete service via Rube MCP.

WebScraping AI Automation

Automates complex web scraping and data extraction tasks using AI-powered tools via the Rube MCP server.

Smartproxy Automation

Automates proxy management and rotation tasks using Smartproxy via the Rube MCP framework.

Serpdog Search Automation

Automates search engine results page (SERP) data extraction and SEO analysis via Serpdog and Rube MCP.

Semantic Scholar Automation

Automates academic research tasks and paper discovery through the Semantic Scholar API using Rube MCP.

IP2Location Automation

Automates IP-based geolocation and intelligence tasks through Composio's Rube MCP integration.

Serpapi Automation

Automates search engine data extraction and Serpapi tasks directly within the Claude Code environment.

Scrape Do Automation

Automates web scraping and proxy-managed data collection tasks using the Scrape Do API via Rube MCP.

Supadata Data Automation

Automates web data extraction and intelligence tasks using the Supadata toolkit via Rube MCP.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings using yt-dlp.

YouTube Video Downloader

Downloads YouTube videos and audio files with granular control over quality, format, and output locations.

Scrapingbee Automation

Automates complex web scraping and data extraction tasks using Scrapingbee via the Rube MCP framework.