Bright Data Progressive Scraper

关于

This skill provides a robust web scraping framework for Claude Code, implementing a progressive escalation strategy to ensure successful data retrieval. It automatically sequences through four distinct methods—from lightweight built-in fetches to advanced browser automation and professional Bright Data scraping—to overcome access restrictions, CAPTCHAs, and dynamic rendering. It is the ideal solution for developers who need reliable, markdown-formatted web content from any URL, regardless of technical barriers.

主要功能

• Four-tier progressive escalation for maximum reliability
• Full JavaScript rendering via Browser Automation (Playwright)
• Standardized output in clean Markdown format
• 1 GitHub stars
• Automatic fallback logic between fetch methods
• Bypasses advanced bot detection and CAPTCHAs

使用场景

• Retrieving web content when standard tools encounter 403 errors or access denials
• Extracting research data from websites with strict anti-bot measures
• Scraping dynamic, JavaScript-rendered content for analysis