Scrapling Web Scraping
Extracts data from static HTML, JavaScript SPAs, and Cloudflare-protected websites using the Scrapling framework.
Scrapling Web Scraping equips Claude Code with comprehensive web harvesting capabilities using the high-performance Scrapling library. It intelligently selects between standard HTTP fetching, stealthy anti-bot bypass for Cloudflare and WAF-protected pages, and dynamic headless browser rendering for single-page applications. With built-in asynchronous spider crawling, adaptive selector resilience against site layout changes, and automatic HTML-to-Markdown conversion, this skill provides an end-to-end toolset for robust web data extraction and pipeline automation.
주요 기능
01Rich selector querying using CSS, XPath, regex search, and direct HTML-to-Markdown conversion
02Adaptive element tracking with fingerprints to auto-relocate elements across website DOM updates
03Async Spider framework with built-in concurrency control, pagination following, and JSON/CSV export
040 GitHub stars
05Multi-mode fetching including standard Fetcher, StealthyFetcher for anti-bot bypass, and DynamicFetcher for SPAs
06Automated pre-flight environment checks and managed virtual environment detection
사용 사례
01Building resilient data scrapers that automatically adapt to evolving website DOM structures
02Crawling multi-page JavaScript-rendered catalogs and converting web articles into clean Markdown
03Extracting structured data from Cloudflare-protected web pages and APIs without being blocked