What is the Scrape.do Automation skill for Claude Code?

It is a specialized skill that allows Claude to interface with Scrape.do's API through the Rube MCP, enabling automated web scraping and proxy management.

Does this skill require an API key?

You need an active Scrape.do account. The connection is managed via the RUBE_MANAGE_CONNECTIONS tool, which provides an authentication link for setup.

How does it handle websites that block scrapers?

The skill utilizes Scrape.do’s residential proxy network and browser-like headers to bypass CAPTCHAs and anti-bot systems automatically.

Why is tool discovery required before execution?

Tool schemas and endpoints can update frequently; calling RUBE_SEARCH_TOOLS ensures Claude uses the correct arguments and slugs for the current environment.

Can I use this for bulk data collection?

Yes, the skill supports RUBE_MULTI_EXECUTE_TOOL and RUBE_REMOTE_WORKBENCH for handling high-volume scraping tasks efficiently.

Scrape.do Web Automation

Name: Scrape.do Web Automation
Author: ComposioHQ

byComposioHQ

•

56,260

•

网络抓取与数据收集

Automates high-performance web scraping and data extraction using Scrape.do's proxy-based infrastructure via Rube MCP.

This skill empowers Claude to execute sophisticated web scraping workflows by integrating Scrape.do's powerful proxy services through the Rube MCP. It handles complex data collection tasks, bypasses anti-bot mechanisms, and manages residential proxy rotation automatically. By utilizing dynamic tool discovery and session-based execution, it ensures Claude always uses the most current schemas for reliable extraction from even the most challenging websites.

主要功能

01Dynamic tool discovery via RUBE_SEARCH_TOOLS

02Seamless Scrape.do connection management

03Multi-tool execution for complex scraping sequences

04Automated anti-bot and CAPTCHA bypassing

05Residential and mobile proxy rotation support

0656,260 GitHub stars

使用场景

01Extracting structured data from websites with aggressive bot detection

02Automating competitive price monitoring and market research

03Building resilient data pipelines for high-volume web crawling

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add composiohq/awesome-claude-skills scrape-do-automation

For use in Claude.ai and ChatGPT

主要功能

01Dynamic tool discovery via RUBE_SEARCH_TOOLS

02Seamless Scrape.do connection management

03Multi-tool execution for complex scraping sequences

04Automated anti-bot and CAPTCHA bypassing

05Residential and mobile proxy rotation support

0656,260 GitHub stars

使用场景

01Extracting structured data from websites with aggressive bot detection

02Automating competitive price monitoring and market research

03Building resilient data pipelines for high-volume web crawling

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add composiohq/awesome-claude-skills scrape-do-automation

For use in Claude.ai and ChatGPT