Crawl4AI RAG
Provides advanced web crawling and Retrieval-Augmented Generation (RAG) capabilities for AI agents and coding assistants.
概要
Crawl4AI RAG is a powerful implementation of the Model Context Protocol (MCP) that integrates with Crawl4AI and Supabase, empowering AI agents and AI coding assistants with advanced web crawling and RAG functionalities. This server enables AI to intelligently scrape diverse web content, store it efficiently in a vector database, and leverage that knowledge for enhanced retrieval. It is designed to evolve into a comprehensive knowledge engine, offering sophisticated RAG strategies, multi-model embedding support, and improved content chunking for highly precise knowledge access and hallucination detection.
主な機能
- Advanced RAG Strategies (Contextual Embeddings, Hybrid Search, Agentic RAG, Reranking)
- Knowledge Graph Integration for Hallucination Detection & Repository Analysis
- Parallel Processing & Content Chunking
- Smart URL Detection & Recursive Crawling
- Vector Search with Optional Source Filtering
- 1 GitHub stars
ユースケース
- Equipping AI agents with real-time web knowledge for enhanced decision-making.
- Detecting AI hallucinations in generated code by validating against a knowledge graph of repository structure.
- Building comprehensive knowledge engines for AI coding assistants to improve code generation and understanding.