Do I need a separate API key for this skill?

Yes, you must obtain an API key from either RapidAPI or APIRoad and set it as the SCRAPENINJA_API_KEY environment variable.

Does ScrapeNinja support websites protected by Cloudflare?

Yes, ScrapeNinja uses specialized Chrome TLS fingerprinting and specific endpoints designed to bypass advanced anti-bot solutions like Cloudflare and Datadome.

How do I handle proxy rotation?

ScrapeNinja handles proxy rotation automatically. You can also specify specific geographic regions, such as the US, EU, or Brazil, using the geo parameter.

Can I extract structured data directly within the request?

Yes, you can provide a Cheerio extractor function in your JSON request, and ScrapeNinja will return the specifically parsed, structured JSON data.

Can I scrape JavaScript-heavy React or Vue sites?

Absolutely. You can use the /scrape-js endpoint to render the full page in a headless Chrome browser before extracting the data.

ScrapeNinja Web Scraper

Name: ScrapeNinja Web Scraper
Author: vm0-ai

byvm0-ai

•

网络抓取与数据收集

Bypasses anti-bot protections and extracts structured data from complex websites using high-performance Chrome TLS fingerprinting and JS rendering.

关于

ScrapeNinja is a powerful web scraping skill for Claude Code that enables high-performance data extraction from even the most challenging websites. It leverages advanced features like Chrome TLS fingerprinting to bypass anti-bot solutions such as Cloudflare and Datadome, rotating proxies with geo-selection, and a full headless Chrome browser for JavaScript-heavy applications. Whether you need a fast raw HTML scrape or complex data extraction using Cheerio scripts and AJAX interception, ScrapeNinja provides a robust toolset to automate web data collection without the overhead of managing your own browser infrastructure.

主要功能

Provides global access via rotating proxies with specific geo-selection (US, EU, BR, etc.).
Captures page screenshots and intercepts AJAX/XHR requests for deep data analysis.
18 GitHub stars
Bypasses anti-bot protections like Cloudflare and Datadome using Chrome TLS fingerprinting.
Renders JavaScript-heavy sites (React, Vue, etc.) using a full headless Chrome browser.
Extracts structured JSON data directly using custom Cheerio extractor functions.

使用场景

Automating data collection from Single Page Applications (SPAs) that require JS execution.
Performing global market research by accessing localized content through regional proxies.
Scraping e-commerce prices or news aggregators protected by aggressive anti-bot measures.

关于

主要功能

Provides global access via rotating proxies with specific geo-selection (US, EU, BR, etc.).
Captures page screenshots and intercepts AJAX/XHR requests for deep data analysis.
18 GitHub stars
Bypasses anti-bot protections like Cloudflare and Datadome using Chrome TLS fingerprinting.
Renders JavaScript-heavy sites (React, Vue, etc.) using a full headless Chrome browser.
Extracts structured JSON data directly using custom Cheerio extractor functions.

使用场景

Automating data collection from Single Page Applications (SPAs) that require JS execution.
Performing global market research by accessing localized content through regional proxies.
Scraping e-commerce prices or news aggregators protected by aggressive anti-bot measures.