WebSocket
Createdzeropointo
Implements a Model Context Protocol (MCP) server and client using WebSockets for improved communication with local language models.
About
WebSocket MCP provides a robust and flexible Model Context Protocol (MCP) server and client implementation leveraging a custom WebSocket transport layer. Designed to overcome limitations of standard I/O and SSE transports, it facilitates efficient message exchange between clients and local language models (LLMs). The included demo showcases a complete local LLM chatbot, enabling users to interact with models via a client that can connect to a local or remote server. The solution provides a foundation for building sophisticated applications that require real-time interaction with LLMs.
Key Features
- WebSocket-based transport for efficient communication
- Local LLM server integration using the `ollama` package
- Supports various LLM models and configurations
- Generic MCP client for resource listing and data streaming
- Configurable server and client via command-line arguments
- 0 GitHub stars
Use Cases
- Facilitating communication between clients and LLMs
- Creating real-time applications that require LLM interaction
- Building local LLM chatbot applications
