Why does the skill require searching for tools before execution?

Tool schemas and arguments can change; calling RUBE_SEARCH_TOOLS ensures Claude uses the most up-to-date interface for Scrapfly operations, preventing execution errors.

How does this skill handle anti-bot protections?

The skill leverages Scrapfly's native capabilities, including residential proxies and browser fingerprinting, to automatically bypass sophisticated anti-scraping measures.

Do I need an API key to use this skill?

While the Rube MCP endpoint can be added without a key, you must have an active Scrapfly account and establish a connection using the RUBE_MANAGE_CONNECTIONS tool.

What is the Scrapfly Automation skill for Claude Code?

It is a specialized capability that allows Claude to utilize Scrapfly's advanced scraping tools via the Rube MCP to automate complex web data extraction tasks.

Can I perform bulk scraping operations?

Yes, the skill supports RUBE_MULTI_EXECUTE_TOOL and RUBE_REMOTE_WORKBENCH for handling multiple scraping requests and large-scale data collection efficiently.

Scrapfly Web Scraping Automation

Name: Scrapfly Web Scraping Automation
Author: EricGrill

byEricGrill

•

Web Scraping y Recopilación de Datos

Automates advanced web scraping and data extraction tasks by connecting Claude to the Scrapfly API via Rube MCP.

This skill empowers Claude to perform sophisticated web scraping operations using the Scrapfly toolkit integrated through the Rube MCP server. It enables the automation of complex data collection workflows, allowing Claude to bypass anti-bot protections, render JavaScript-heavy pages, and manage residential proxies without manual intervention. By following a dynamic discovery pattern, the skill ensures Claude always utilizes the most current Scrapfly tool schemas and connection statuses, making it an essential tool for developers and analysts building scalable data pipelines or performing automated market research within their AI coding environment.

Características Principales

0112 GitHub stars

02Automated web scraping with built-in anti-bot and CAPTCHA bypass.

03Integrated connection management via Rube MCP and Composio.

04Dynamic tool discovery for real-time API schema synchronization.

05Support for bulk data extraction and remote workbench execution.

06Seamless handling of JavaScript rendering and proxy rotation.

Casos de Uso

01Building scalable data pipelines that require reliable access to complex web targets.

02Automating competitive price monitoring and market intelligence gathering.

03Extracting structured data from highly protected e-commerce or social media platforms.

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ericgrill/agents-skills-plugins scrapfly-automation

For use in Claude.ai and ChatGPT

Características Principales

0112 GitHub stars

02Automated web scraping with built-in anti-bot and CAPTCHA bypass.

03Integrated connection management via Rube MCP and Composio.

04Dynamic tool discovery for real-time API schema synchronization.

05Support for bulk data extraction and remote workbench execution.

06Seamless handling of JavaScript rendering and proxy rotation.

Casos de Uso

01Building scalable data pipelines that require reliable access to complex web targets.

02Automating competitive price monitoring and market intelligence gathering.

03Extracting structured data from highly protected e-commerce or social media platforms.