关于
Webcrawl bridges the gap between web crawl data and AI language models using Model Context Protocol (MCP). It allows AI clients to filter and analyze web content, under user direction or autonomously, and provides a full-text search interface with boolean support, resource filtering by type, and HTTP status. It is compatible with various web crawlers, including WARC, wget, InterroBot, Katana, and SiteOne.
主要功能
- Filter by type and HTTP status
- 0 GitHub stars
- Claude Desktop ready
- Multi-crawler compatible
- Full-text search support
- Quick MCP configuration
使用案例
- Providing a search interface for web archives.
- Enabling AI clients to analyze web crawl data.
- Filtering web content based on type and status for AI analysis.