Can this skill handle JavaScript-heavy websites?

Yes, the third tier uses Playwright-based browser automation to render dynamic content and execute JavaScript before extracting the data.

What is the 4-tier scraping strategy?

It is an escalation process that starts with simple WebFetch, moves to Curl with custom headers, then Browser Automation, and finally uses Bright Data MCP for the most difficult sites.

What format is the scraped content returned in?

The skill standardizes all output into clean Markdown format, making it easy for Claude to analyze, summarize, or transform the retrieved web data.

Does it automatically handle bot detection?

Yes, the workflow detects blocks and 403 errors, automatically switching to more sophisticated methods like residential proxy-backed scraping via Bright Data.

Bright Data Web Scraper

Name: Bright Data Web Scraper
Author: Microck

byMicrock

•

110

•

网络抓取与数据收集

Automates web content extraction using a progressive four-tier strategy to bypass bot detection and CAPTCHAs.

The Bright Data skill provides a robust web scraping workflow for Claude Code, implementing a progressive escalation strategy to ensure reliable content retrieval. It starts with simple fetching and automatically escalates through customized curl requests and browser automation to professional Bright Data scraping when encountering blockers like CAPTCHAs or advanced bot detection. This ensures that users can extract clean, markdown-formatted content from any website, regardless of technical restrictions or JavaScript-heavy rendering requirements.

主要功能

01110 GitHub stars

02Progressive four-tier escalation strategy

03Built-in bot detection and CAPTCHA bypass

04Clean markdown output for all scraped content

05Playwright-based browser automation for JavaScript sites

06Automatic fallback logic for reliable data retrieval

使用场景

01Extracting data from websites with aggressive anti-scraping measures

02Automated content collection for research and documentation

03Scraping JavaScript-heavy single-page applications (SPAs)

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add microck/ordinary-claude-skills brightdata

For use in Claude.ai and ChatGPT

Download Skill