Which LLM providers does this skill support?

The LLM Gateway supports major providers including OpenAI, Anthropic, Google Gemini, and Ollama, using a unified Faraday-based client architecture.

How does it handle API rate limits?

It implements structured error handling that detects 429 Too Many Requests responses and triggers automatic retries with exponential backoff.

Can I route requests based on model features like vision?

Yes, the gateway includes a feature detection system that allows you to query model capabilities and select the cheapest or most capable model for vision, function calling, or embeddings.

Does it provide standardized token usage tracking?

Yes, it normalizes usage data (prompt and completion tokens) into a consistent format across all providers and includes cost calculation based on your YAML config.

LLM Gateway for Rails

Name: LLM Gateway for Rails
Author: rbarazi

byrbarazi

0•

데이터 과학 및 ML

Builds a unified abstraction layer for integrating and switching between multiple LLM providers in Rails applications.

The LLM Gateway skill provides a robust architectural pattern for Rails developers to manage multiple AI providers through a single, standardized interface. By implementing a factory pattern and YAML-driven configuration, it enables seamless provider switching, feature-based model routing (such as vision or function calling), and consistent response handling. It is an essential tool for applications requiring cost optimization, provider redundancy, or specific model capabilities without the overhead of rewriting integration logic for every new API.

주요 기능

01Unified Factory Pattern for OpenAI, Anthropic, Gemini, and Ollama clients

02Centralized YAML configuration for model metadata, pricing, and context limits

03Feature-based routing to automatically select models by capability

04Standardized response structure and usage tracking across all providers

05Automated error handling with exponential backoff for rate limiting

060 GitHub stars

사용 사례

01Implementing a multi-model chatbot that switches providers based on cost or availability

02Routing specialized tasks like image analysis to specific vision-capable models

03Standardizing LLM token usage tracking and cost calculation across a Rails platform

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add rbarazi/agent-skills llm-gateway

For use in Claude.ai and ChatGPT

Download Skill