Fast-Crawl
Provides a high-performance web crawler and metasearch engine for efficient web scraping and result aggregation, compatible with MCP protocol and OpenWebUI WebSearch.
概要
Fast-crawl is a high-performance web crawler and metasearch engine designed to efficiently search and scrape web results. It leverages advanced techniques to ensure rapid crawling and effective data retrieval, aggregating search results from multiple sources into a unified interface. Built with TypeScript on the fast Bun runtime, it offers horizontal scalability through communication with Redis-compatible databases and provides both an MCP server and a RESTful API for seamless integration with other applications.
主な機能
- API Server
- Horizontal Scalability
- Typescript Native (Bun)
- 1 GitHub stars
- Metasearch Engine
- High Performance
ユースケース
- Efficiently search and scrape web results
- Aggregating search results from multiple sources
- Integrating web search and crawling capabilities into other applications via RESTful API
Advertisement