Can this skill handle JavaScript-heavy websites?

Yes, the third tier uses Playwright-based browser automation to render dynamic content and execute JavaScript before extracting the data.

What is the 4-tier scraping strategy?

It is an escalation process that starts with simple WebFetch, moves to Curl with custom headers, then Browser Automation, and finally uses Bright Data MCP for the most difficult sites.

What format is the scraped content returned in?

The skill standardizes all output into clean Markdown format, making it easy for Claude to analyze, summarize, or transform the retrieved web data.

Does it automatically handle bot detection?

Yes, the workflow detects blocks and 403 errors, automatically switching to more sophisticated methods like residential proxy-backed scraping via Bright Data.

Bright Data Web Scraper

Name: Bright Data Web Scraper
Author: Microck

byMicrock

•

110

网络抓取与数据收集

Automates web content extraction using a progressive four-tier strategy to bypass bot detection and CAPTCHAs.

关于

The Bright Data skill provides a robust web scraping workflow for Claude Code, implementing a progressive escalation strategy to ensure reliable content retrieval. It starts with simple fetching and automatically escalates through customized curl requests and browser automation to professional Bright Data scraping when encountering blockers like CAPTCHAs or advanced bot detection. This ensures that users can extract clean, markdown-formatted content from any website, regardless of technical restrictions or JavaScript-heavy rendering requirements.

主要功能

110 GitHub stars
Progressive four-tier escalation strategy
Built-in bot detection and CAPTCHA bypass
Clean markdown output for all scraped content
Playwright-based browser automation for JavaScript sites
Automatic fallback logic for reliable data retrieval

使用场景

Extracting data from websites with aggressive anti-scraping measures
Automated content collection for research and documentation
Scraping JavaScript-heavy single-page applications (SPAs)

关于

主要功能

110 GitHub stars
Progressive four-tier escalation strategy
Built-in bot detection and CAPTCHA bypass
Clean markdown output for all scraped content
Playwright-based browser automation for JavaScript sites
Automatic fallback logic for reliable data retrieval

使用场景

Extracting data from websites with aggressive anti-scraping measures
Automated content collection for research and documentation
Scraping JavaScript-heavy single-page applications (SPAs)