What is the role of Rube MCP in this workflow?

Rube MCP acts as the bridge between Claude Code and the Composio toolkit, providing the necessary infrastructure to execute tools without manual API key management in the client.

Can this skill handle JavaScript-heavy websites?

Yes, Zyte API is specifically designed to handle JavaScript rendering and bypass complex anti-bot systems that block standard scrapers.

What is the Zyte API Automation skill?

It is a specialized capability for Claude Code that allows it to automate web scraping tasks using the Zyte API via the Rube MCP (Composio).

Do I need a Zyte API key to use this skill?

Yes, you need an active Zyte account and connection, which can be managed and authorized through the RUBE_MANAGE_CONNECTIONS tool.

Why does the skill require running RUBE_SEARCH_TOOLS first?

Tool schemas and slugs can change over time; searching ensures Claude uses the most current parameters and recommended execution plans for Zyte API operations.

Zyte API Web Scraping

Name: Zyte API Web Scraping
Author: Tako3832

byTako3832

0•

Web Scraping & Data Collection

Automates complex web scraping and data extraction tasks by integrating the Zyte API with Claude Code via the Rube MCP.

This skill empowers Claude Code to perform advanced web data collection by leveraging Zyte's powerful API through the Composio Rube MCP framework. It provides a robust workflow for discovering scraping tools, managing API connections, and executing data extraction tasks with features like automatic tool discovery and dynamic schema compliance. Whether you need to bypass anti-bot measures, render JavaScript, or extract structured data from challenging websites, this skill automates the entire pipeline directly within your terminal or development environment.

Key Features

01Seamless Zyte API connection management via Rube MCP and Composio

02Dynamic schema compliance to handle evolving API endpoints and tool slugs

03Automated tool discovery using RUBE_SEARCH_TOOLS for up-to-date schemas

04Integrated session management and memory parameters for persistent scraping tasks

050 GitHub stars

06Support for complex multi-tool execution workflows and bulk operations

Use Cases

01Automating large-scale web data collection for market research and analysis

02Extracting structured data from websites with advanced anti-bot protections

03Real-time content monitoring and price tracking across multiple high-security domains

Key Features

01Seamless Zyte API connection management via Rube MCP and Composio

02Dynamic schema compliance to handle evolving API endpoints and tool slugs

03Automated tool discovery using RUBE_SEARCH_TOOLS for up-to-date schemas

04Integrated session management and memory parameters for persistent scraping tasks

050 GitHub stars

06Support for complex multi-tool execution workflows and bulk operations

Use Cases

01Automating large-scale web data collection for market research and analysis

02Extracting structured data from websites with advanced anti-bot protections

03Real-time content monitoring and price tracking across multiple high-security domains