Extracts structured data from dynamic websites using advanced browser automation and automated interaction scripts.
The Web Scraper skill for Claude Code provides a robust framework for professional-grade data extraction from any website, regardless of technical complexity. It leverages browser automation to handle JavaScript-heavy content that traditional scrapers miss, including support for infinite scrolling, paginated lists, and multi-step user interactions. With built-in support for CSV, JSON, and Excel outputs, it streamlines the workflow of transforming raw web pages into clean, structured datasets for e-commerce monitoring, market research, and lead generation.
主要功能
01Handles complex navigation including pagination and infinite scroll
025 GitHub stars
03Custom interaction sequences for clicks, form fills, and scrolling
04Built-in best practices for rate limiting and anti-scraping management
05Supports JavaScript-rendered and dynamic content via browser automation
06Exports data directly to CSV, JSON, or Excel (XLSX) formats
使用场景
01Automating content collection for news media and research databases
02Aggregating real estate or job board listings into structured spreadsheets
03E-commerce price monitoring and product inventory tracking
