DocSearch
Createdalizdavoodi
Crawls websites, generates Markdown documentation, and makes that documentation searchable.
About
DocSearch provides a toolset for crawling websites and converting the content into searchable Markdown documentation. It uses a Model Context Protocol (MCP) server to expose this documentation, allowing for integration with tools like Cursor. The server intelligently caches processed content for faster startup times, and the crawler offers configurable depth, URL filtering, and HTML cleaning options to tailor the generated documentation to specific needs.
Key Features
- Generates consolidated Markdown documentation from crawled content.
- Caches processed content for faster server startup.
- Performs semantic search over document chunks using vector embeddings.
- Crawls websites using configurable depth and URL patterns.
- Implements an MCP server for integration with tools like Cursor.
- 4 GitHub stars
Use Cases
- Quickly create searchable documentation for internal tools and APIs.
- Make large documentation sets easily searchable and accessible.
- Integrate documentation search directly into code editors like Cursor.
