概要
This tool provides a lean and focused MCP server implementation designed to efficiently crawl documentation websites and index their content into Supabase for Retrieval-Augmented Generation (RAG). It leverages a hybrid approach for URL discovery (sitemap.xml first, then recursive crawling) and content extraction (Jina AI for speed, Crawl4AI as a robust fallback). The extracted content is intelligently chunked, embedded using OpenAI's vector embeddings, and stored in Supabase's pgvector for fast similarity search, supporting multi-project isolation.