What is the benefit of the Bright Data tier?

Bright Data handles the most difficult scraping tasks, including residential proxy rotation and CAPTCHA solving, which typically block standard automated tools.

Do I need to configure all tools manually?

No, the skill is designed to work with built-in Claude Code tools and the Bright Data MCP, requiring minimal setup to reach full functionality.

Can this skill handle JavaScript-heavy websites?

Yes, Tier 3 uses full browser automation to execute JavaScript, ensuring dynamic content is fully loaded before extraction.

What format is the scraped content returned in?

Regardless of which tier is used to fetch the data, the output is converted and returned as structured markdown for easy reading and AI processing.

How does the progressive escalation work?

The skill starts with a fast WebFetch. If blocked, it escalates to Curl with custom headers, then to Browser Automation for JS-rendering, and finally to Bright Data MCP for advanced bot bypass.

Bright Data Scraper

Name: Bright Data Scraper
Author: Activer007

byActiver007

•

ウェブスクレイピングとデータ収集

Automates multi-tier web scraping with an intelligent fallback strategy to bypass bot detection and capture content from any URL.

概要

This skill provides a robust four-tier escalation strategy for retrieving web content within Claude Code. It intelligently transitions from basic fetching to advanced methods like customized Curl, Playwright-based browser automation, and finally the Bright Data MCP for bypassing sophisticated bot protection and CAPTCHAs. It is the definitive solution for developers needing reliable markdown extraction from complex, JavaScript-heavy, or highly restricted websites where standard scraping methods fail.

主な機能

Automatic fallback for failed scraping attempts
Advanced bot detection and CAPTCHA bypass via Bright Data
Playwright-based browser automation for dynamic content
Four-tier progressive escalation strategy
Standardized markdown output for all retrieved content
1 GitHub stars

ユースケース

Automating content retrieval from JavaScript-heavy single-page applications
Converting complex web pages into structured markdown for AI analysis
Extracting data from websites that block standard crawlers

概要

主な機能

Automatic fallback for failed scraping attempts
Advanced bot detection and CAPTCHA bypass via Bright Data
Playwright-based browser automation for dynamic content
Four-tier progressive escalation strategy
Standardized markdown output for all retrieved content
1 GitHub stars

ユースケース

Automating content retrieval from JavaScript-heavy single-page applications
Converting complex web pages into structured markdown for AI analysis
Extracting data from websites that block standard crawlers