LLM Router FAQs

Question 1

Does LLM Router support different API protocols?

Accepted Answer

Yes, LLM Router features automatic protocol translation between OpenAI and Anthropic Messages formats. This allows clients to use their preferred protocol, while the gateway translates requests and responses as needed for the backend provider.

Question 2

What LLM providers are supported by LLM Router?

Accepted Answer

LLM Router offers multi-provider support for major platforms including OpenAI, Anthropic (Claude), Google (Gemini), Ollama, Mistral AI, and ZAi, with capabilities for custom base URLs and model filtering.

Question 3

What is LLM Router?

Accepted Answer

LLM Router is a unified gateway that aggregates multiple Large Language Model providers (like OpenAI, Claude, Gemini, Ollama, Mistral, ZAi) behind a single API endpoint, simplifying access and management for client applications.

Question 4

How does LLM Router handle multiple LLM providers?

Accepted Answer

It allows you to configure various LLM providers and their models, then intelligently routes client requests based on factors like model name, configurable weight-based load balancing, or advanced Scriptling-powered smart routing rules.

Question 5

What is 'Smart Routing' and how does it work?

Accepted Answer

Smart Routing enables dynamic model selection using custom Scriptling scripts. These scripts can evaluate request content, provider/model tags, current load, and other variables to choose the most suitable LLM provider and model for each specific request.

LLM Router

LLM Router

Key Features

Use Cases

Key Features

Use Cases