Can this skill handle CAPTCHAs?

Yes, by escalating to Tier 4 (Bright Data MCP), the skill leverages specialized infrastructure designed to solve CAPTCHAs and navigate advanced anti-bot measures.

Is JavaScript execution supported?

Yes, Tier 3 uses full browser automation (Playwright) to render dynamic pages that require JavaScript to display their content.

How does the progressive escalation strategy work?

The skill attempts to fetch data using the most efficient method first (WebFetch). If blocked, it automatically escalates through custom Curl headers and Browser Automation, finally using Bright Data's professional proxy network if necessary.

What format is the scraped content returned in?

Regardless of the tier used for scraping, the skill processes the HTML and returns clean Markdown to Claude, ensuring the content is easy for the AI to analyze.

Bright Data Progressive Scraper

Name: Bright Data Progressive Scraper
Author: Microck

byMicrock

•

网络抓取与数据收集

Implements a four-tier progressive scraping strategy to bypass bot detection and reliably extract web content.

关于

The Bright Data skill provides a robust framework for retrieving web content within Claude Code using an automated escalation workflow. It intelligently navigates through four levels of scraping—from simple WebFetch to advanced Bright Data MCP integration—ensuring that even websites with CAPTCHAs, heavy JavaScript, or strict bot detection can be successfully converted into clean Markdown for research and analysis.

主要功能

Chrome-like header emulation to prevent 403 Access Denied errors
Bypasses advanced bot detection and CAPTCHAs via Bright Data
Converts complex HTML pages into clean, structured Markdown
Automatic four-tier fallback strategy for maximum reliability
81 GitHub stars
Full JavaScript rendering using Playwright browser automation

使用场景

Extracting data from dynamic, JavaScript-heavy single-page applications
Scraping content from protected sites that block standard AI crawlers
Automating high-volume web data collection for research or coding projects

关于

主要功能

Chrome-like header emulation to prevent 403 Access Denied errors
Bypasses advanced bot detection and CAPTCHAs via Bright Data
Converts complex HTML pages into clean, structured Markdown
Automatic four-tier fallback strategy for maximum reliability
81 GitHub stars
Full JavaScript rendering using Playwright browser automation

使用场景

Extracting data from dynamic, JavaScript-heavy single-page applications
Scraping content from protected sites that block standard AI crawlers
Automating high-volume web data collection for research or coding projects