KoboldCPP facilitates AI-to-AI communication by acting as a Model Context Protocol (MCP) server for KoboldAI. It allows MCP-compatible applications, like Claude, to leverage KoboldAI's text generation capabilities, chat completion with memory, and even integrate with Stable Diffusion. Built on the official MCP SDK and implemented in TypeScript, it offers OpenAI-compatible API endpoints for text and chat completion, and extends functionality with audio transcription, text-to-speech, and web search.
Key Features
01OpenAI-compatible API endpoints
021 GitHub stars
03Chat completion with persistent memory
04Built on the official MCP SDK
05Text generation with KoboldAI
06Stable Diffusion integration