Routes calls from tools, CLI prompts, and dashboard interactions to local, OpenAI-compatible MLX model servers on Mac.
Sponsored
Local provides a powerful solution for Mac users to leverage their own local MLX models. It acts as an OpenAI-compatible server, intelligently routing requests from MCP tools, CLI prompts, and its integrated web dashboard to a user's local MLX deployments. This enables private, efficient, and customizable large language model inference, complete with robust hardware detection, model fit recommendations, and an intuitive web interface for configuration and monitoring, all optimized for macOS.
主要功能
01Comprehensive hardware detection and model fit scoring for Mac
020 GitHub stars
03Interactive web dashboard for status, routing, and model library management
04CLI for direct model interaction, setup, and system diagnostics
05Automated configuration for MLX models and task-based routing
06OpenAI-compatible local endpoint for MLX model routing
使用案例
01Directly querying and streaming responses from local large language models via the command line.
02Integrating local MLX models with MCP (Modular Command Processor) tools for privacy and control.
03Configuring and monitoring local LLM deployments with a user-friendly web interface on macOS.
