关于
This robust backend client acts as a central hub for integrating large language models into your applications. It provides a high-performance Model Context Protocol (MCP) implementation, offering real-time streaming via a WebSocket API and persistent conversation history using SQLite. With built-in support for multiple leading LLM providers like OpenRouter, OpenAI, and Groq, it simplifies the development of AI-powered features by abstracting away the complexities of various model APIs and managing context effectively.
主要功能
- Full Model Context Protocol (MCP) support for tools, prompts, and resources
- High-performance architecture with optimized SQLite for conversation history
- Real-time streaming capabilities via WebSocket API with delta persistence
- Seamless integration with multiple LLM providers: OpenRouter, OpenAI, and Groq
- Ensures data integrity with comprehensive Pydantic type validation
- 0 GitHub stars
使用案例
- Building real-time AI chat applications with persistent conversation history.
- Integrating a unified interface for multiple large language models into existing systems.
- Developing context-aware AI agents that manage complex dialogue flows.
Sponsored