Webcrawl
Createdpragmar
Connects web crawler data and archives to AI language models using the Model Context Protocol.
About
Webcrawl bridges the gap between web crawl data and AI language models using Model Context Protocol (MCP). It allows AI clients to filter and analyze web content, under user direction or autonomously, and provides a full-text search interface with boolean support, resource filtering by type, and HTTP status. It is compatible with various web crawlers, including WARC, wget, InterroBot, Katana, and SiteOne.
Key Features
- Filter by type and HTTP status
- 0 GitHub stars
- Claude Desktop ready
- Multi-crawler compatible
- Full-text search support
- Quick MCP configuration
Use Cases
- Providing a search interface for web archives.
- Enabling AI clients to analyze web crawl data.
- Filtering web content based on type and status for AI analysis.
