This tool offers a modern and scalable server implementation designed for managing AI interactions using the Modern Control Protocol. It boasts support for multiple AI providers like OpenAI, Anthropic, Google AI, and Azure, along with real-time streaming responses, robust conversation management, and advanced monitoring capabilities. Features include function calling, vector database integration, semantic caching, Prometheus metrics, Grafana dashboards, and more. It's built with a microservices architecture leveraging FastAPI, PostgreSQL, Redis, Elasticsearch, and Qdrant, ensuring performance and scalability.
주요 기능
01Real-time streaming responses
02Prometheus metrics and Grafana dashboards
03Conversation management and history
040 GitHub stars
05Function calling and tool usage
06Multi-provider AI support (OpenAI, Anthropic, Google AI, Azure)