Fast-Crawl

About

Fast-crawl is a high-performance web crawler and metasearch engine designed to efficiently search and scrape web results. It leverages advanced techniques to ensure rapid crawling and effective data retrieval, aggregating search results from multiple sources into a unified interface. Built with TypeScript on the fast Bun runtime, it offers horizontal scalability through communication with Redis-compatible databases and provides both an MCP server and a RESTful API for seamless integration with other applications.

Key Features

• API Server
• Horizontal Scalability
• Typescript Native (Bun)
• 1 GitHub stars
• Metasearch Engine
• High Performance

Use Cases

• Efficiently search and scrape web results
• Aggregating search results from multiple sources
• Integrating web search and crawling capabilities into other applications via RESTful API