ScorchCrawl
Connects AI clients like VS Code Copilot and Claude Desktop to a powerful web scraping engine via the Model Context Protocol.
ScorchCrawl acts as an essential proxy and server, enabling seamless communication between various Model Context Protocol (MCP) clients—such as VS Code Copilot and Claude Desktop—and the core ScorchCrawl web scraping engine. It offers flexible deployment options, from a lightweight local `stdio` proxy that securely handles user secrets to a robust HTTP `SSE` endpoint, and full-stack deployment via Docker Compose. This tool is designed for developers seeking to integrate advanced AI capabilities with web data extraction, providing a streamlined interface and easy installation via npm.
主な機能
012 GitHub stars
02Provides an easy-to-install CLI client via npm
03Keeps per-user secrets (like GitHub tokens) local when running in `stdio` mode
04Bridges MCP clients (e.g., VS Code Copilot, Claude Desktop) to the ScorchCrawl web scraping engine
05Supports flexible deployment as a local `stdio` proxy or a remote HTTP `SSE` server
06Enables full-stack deployment with Docker Compose, including supporting services
ユースケース
01Deploying a local or remote server to manage the interaction between AI agents and a web scraping backend
02Integrating AI development tools directly with web scraping capabilities for data acquisition
03Setting up a comprehensive full-stack environment for AI-driven web data extraction using Docker