Manages and standardizes interactions with multiple Large Language Models (LLMs) through a unified interface.
This server streamlines the management of diverse Large Language Models (LLMs) by providing a standardized interface. It supports models like DeepSeek and Llama, facilitating seamless switching between them. The server also offers conversation context management and supports various storage backends including memory, Redis, and SQLite.