Osaurus

关于

Osaurus is an all-in-one local LLM server specifically engineered for macOS with Apple Silicon, leveraging the MLX runtime for optimized inference. It provides OpenAI and Ollama compatible APIs, allowing seamless integration with existing AI tools and SDKs, including advanced features like tool calling. Beyond a robust server, Osaurus acts as a full Model Context Protocol (MCP) server, enabling AI agents to access an extensible plugin ecosystem for enhanced capabilities like browser automation, file system interaction, and web search. It also features a convenient menu bar chat UI and supports Apple Foundation Models on compatible macOS versions.

主要功能

• Extensible plugin system with official tools (browser, filesystem, git, search)
• Native Apple Silicon LLM server with MLX optimization
• Built-in Menu Bar Chat UI and Model Manager
• Full MCP (Model Context Protocol) server capabilities
• OpenAI & Ollama compatible APIs with streaming and tool calling
• 1,599 GitHub stars

使用案例

• Run various open-source LLMs locally on macOS for privacy and performance
• Integrate local LLMs and their tools with AI agents and development environments via MCP
• Develop custom AI-powered applications leveraging a local OpenAI-compatible API