Can I automate clicks and form interactions?

Yes, the dynamic scraping feature allows you to define a sequence of actions like clicking, scrolling, and filling inputs before extracting data.

What file formats are supported for data export?

The skill supports exporting extracted data into CSV, JSON, and Microsoft Excel (XLSX) formats.

Does it handle infinite scrolling pages?

Yes, it includes a specific script for infinite scroll that allows you to define the number of scroll actions and delays.

Does the skill include rate limiting features?

Yes, the scraping scripts include configurable delays to respect website resources and avoid anti-scraping triggers.

Can this skill scrape websites that use React or Vue?

Yes, it uses agent-browser automation to effectively handle JavaScript-rendered content and dynamic frameworks.

Professional Web Scraper

Name: Professional Web Scraper
Author: dvcrn

bydvcrn

•

Web Scraping & Data Collection

Extracts structured data from dynamic websites using advanced browser automation and automated interaction scripts.

The Web Scraper skill for Claude Code provides a robust framework for professional-grade data extraction from any website, regardless of technical complexity. It leverages browser automation to handle JavaScript-heavy content that traditional scrapers miss, including support for infinite scrolling, paginated lists, and multi-step user interactions. With built-in support for CSV, JSON, and Excel outputs, it streamlines the workflow of transforming raw web pages into clean, structured datasets for e-commerce monitoring, market research, and lead generation.

Key Features

01Handles complex navigation including pagination and infinite scroll

025 GitHub stars

03Custom interaction sequences for clicks, form fills, and scrolling

04Built-in best practices for rate limiting and anti-scraping management

05Supports JavaScript-rendered and dynamic content via browser automation

06Exports data directly to CSV, JSON, or Excel (XLSX) formats

Use Cases

01Automating content collection for news media and research databases

02Aggregating real estate or job board listings into structured spreadsheets

03E-commerce price monitoring and product inventory tracking

Key Features

01Handles complex navigation including pagination and infinite scroll

025 GitHub stars

03Custom interaction sequences for clicks, form fills, and scrolling

04Built-in best practices for rate limiting and anti-scraping management

05Supports JavaScript-rendered and dynamic content via browser automation

06Exports data directly to CSV, JSON, or Excel (XLSX) formats

Use Cases

01Automating content collection for news media and research databases

02Aggregating real estate or job board listings into structured spreadsheets

03E-commerce price monitoring and product inventory tracking