How does it handle pagination and infinite scrolling?

It automatically detects pagination markers, 'Next' buttons, and infinite scroll triggers, allowing it to navigate through multiple pages of results automatically.

Can this skill handle JavaScript-heavy websites?

Yes, the skill includes a dedicated Browser Automation strategy that renders JavaScript to extract data from Single Page Applications (SPAs) and interactive sites.

Does it support API-based data extraction?

Yes, if a website provides a public JSON or XML endpoint, the skill can use Bash-based strategies to fetch data directly, ensuring higher speed and reliability.

What file formats does the Web Scraper support?

The skill can export data in Markdown tables by default, but it also supports structured JSON and CSV formats for use in spreadsheets or databases.

What happens if a basic scrape fails?

The skill features 'Auto-escalation,' which means it will automatically switch from simple static fetching to full browser automation if it detects missing content.

Intelligent Web Scraper

Name: Intelligent Web Scraper
Author: sickn33

bysickn33

•

31,722

•

Web Scraping & Data Collection

Extracts structured data from any website using intelligent multi-strategy approaches including browser automation, static parsing, and API interaction.

This skill empowers Claude to perform advanced web scraping tasks by automatically selecting the optimal extraction strategy for any target URL. It handles complex scenarios like JavaScript-rendered content, paginated lists, and multi-column tables with high precision. By following a strict seven-phase workflow—from reconnaissance to data validation—it ensures clean, structured output in formats such as CSV, JSON, or Markdown, making it an essential tool for data analysis, market research, and lead generation.

Key Features

01Automatic fallback escalation to handle JS-rendered and interactive pages

02Structured data export to CSV, JSON, and Markdown formats

03Multi-strategy extraction including WebFetch, Browser Automation, and API calls

04Comprehensive pagination support for infinite scroll and 'load more' buttons

05Intelligent data classification for products, pricing, contacts, and FAQs

0631,722 GitHub stars

Use Cases

01Extracting contact details and team directories for business lead generation

02Automating competitive price monitoring across multiple e-commerce websites

03Aggregating news articles or research data for automated content analysis

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add sickn33/antigravity-awesome-skills web-scraper

For use in Claude.ai and ChatGPT

Key Features

01Automatic fallback escalation to handle JS-rendered and interactive pages

02Structured data export to CSV, JSON, and Markdown formats

03Multi-strategy extraction including WebFetch, Browser Automation, and API calls

04Comprehensive pagination support for infinite scroll and 'load more' buttons

05Intelligent data classification for products, pricing, contacts, and FAQs

0631,722 GitHub stars

Use Cases

01Extracting contact details and team directories for business lead generation

02Automating competitive price monitoring across multiple e-commerce websites

03Aggregating news articles or research data for automated content analysis

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add sickn33/antigravity-awesome-skills web-scraper

For use in Claude.ai and ChatGPT