AI Cursor Scraping Assistant
Generates web scrapers for various websites by leveraging Cursor AI and Model Context Protocol (MCP).
About
AI Cursor Scraping Assistant empowers users to quickly create web scrapers using the power of Cursor AI and MCP. It analyzes websites, identifies their structure, and generates Scrapy or Camoufox spiders with minimal manual effort. The project provides a set of rules to guide Cursor AI, along with MCP tools to enhance its web scraping capabilities, making it easier to extract data from diverse websites.
Key Features
- Utilizes Cursor AI for website analysis and code generation
- Supports anti-bot bypass techniques using Camoufox
- Generates Scrapy and Camoufox web scrapers
- Includes pre-defined rules for various scraper types (PLP, PDP)
- Employs Model Context Protocol (MCP) for enhanced scraping capabilities
- 20 GitHub stars
Use Cases
- Creating e-commerce PDP (Product Detail Page) scrapers
- Automating web data extraction tasks for research or business intelligence
- Creating e-commerce PLP (Product Listing Page) scrapers
Sponsored