Can I use this skill with LangChain?

Yes, this skill allows you to use the ChatOpenAI class in LangChain by simply pointing the base_url to your local Ollama instance.

Is streaming supported?

Yes, it fully supports the OpenAI streaming interface, allowing for real-time token generation in your applications.

Which models can I use with this skill?

You can use any model currently installed in your Ollama library, such as Llama 3.2, Mistral, or Phi-3.

Do I need a real OpenAI API key?

No, you can use 'ollama' as a placeholder key. Ollama requires a key to be present for library compatibility but ignores the actual value.

Does it support all OpenAI endpoints?

It supports core endpoints like chat completions, text completions, and embeddings. It does not support administrative functions like deleting or copying models.

Ollama OpenAI Compatibility

Name: Ollama OpenAI Compatibility
Author: atrawog

byatrawog

0•

데이터 과학 및 ML

Enables seamless integration between Ollama and the OpenAI ecosystem using a compatible API layer for popular libraries.

This skill provides a standardized OpenAI-compatible interface for local LLMs running via Ollama. It allows developers to leverage the official OpenAI Python library, LangChain, and LlamaIndex without refactoring existing codebases. By supporting key endpoints for chat completions, text generation, and embeddings, it facilitates a smooth transition from cloud-based API services to local hosting, ensuring that tools designed for OpenAI work natively with your local model infrastructure.

주요 기능

01Drop-in replacement for OpenAI API endpoints (/v1/*)

02Seamless integration with LangChain and LlamaIndex

030 GitHub stars

04Standardized Embedding generation for local models

05Support for Chat Completions and Text Generation

06Support for streaming responses and multi-turn conversations

사용 사례

01Migrating production applications from OpenAI to local LLMs to reduce costs

02Prototyping AI applications locally using familiar OpenAI library patterns

03Integrating local Ollama models into frameworks like LangChain or LlamaIndex

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add atrawog/bazzite-ai-plugins openai

For use in Claude.ai and ChatGPT

Download Skill