How does the progressive fallback work?

The skill starts with fast, basic tools like WebFetch and only escalates to more resource-intensive tools like Browser Automation or Bright Data if the previous tier is blocked or fails to load the content.

What is required to use the Bright Data tier?

You must have the Bright Data MCP tool configured within your Claude Code environment to utilize the final tier for advanced scraping and proxy requirements.

Does it work on sites that block standard scrapers?

Yes, specifically Tier 2 (Custom Curl) and Tier 4 (Bright Data) are designed to bypass common user-agent blocks and advanced bot detection systems.

Can it handle JavaScript-heavy websites?

Yes, the third tier uses full browser automation to render dynamic content, ensuring that data hidden behind JavaScript is successfully captured.

What format is the scraped data returned in?

Regardless of which tier successfully fetches the data, the content is processed and returned in clean, structured Markdown format.

Advanced Progressive Web Scraper

Name: Advanced Progressive Web Scraper
Author: Microck

byMicrock

•

Web Scraping y Recopilación de Datos

Automates web content extraction using a four-tier fallback strategy to bypass bot detection and CAPTCHAs.

Acerca de

This skill provides a robust framework for retrieving web content through a progressive escalation strategy. It starts with lightweight methods like WebFetch and Curl, escalating to full Browser Automation and finally Bright Data's professional scraping infrastructure when facing advanced bot detection or CAPTCHAs. This ensures high success rates for scraping any URL while optimizing for speed and resource efficiency, ultimately delivering clean markdown content ready for analysis or processing within Claude Code.

Características Principales

Built-in support for JavaScript rendering via Playwright
Advanced bot detection and CAPTCHA bypass via Bright Data MCP
Automatic fallback logic for failed requests
Four-tier progressive escalation strategy
Standardized output in clean Markdown format
81 GitHub stars

Casos de Uso

Extracting content from Single Page Applications (SPAs) requiring JS execution
Automating high-volume web research where reliability is critical
Bypassing 403 errors and sophisticated anti-bot measures on protected domains

Acerca de

Características Principales

Built-in support for JavaScript rendering via Playwright
Advanced bot detection and CAPTCHA bypass via Bright Data MCP
Automatic fallback logic for failed requests
Four-tier progressive escalation strategy
Standardized output in clean Markdown format
81 GitHub stars

Casos de Uso

Extracting content from Single Page Applications (SPAs) requiring JS execution
Automating high-volume web research where reliability is critical
Bypassing 403 errors and sophisticated anti-bot measures on protected domains