Go-Llm
Implements a simple API interface for large language models, enabling interaction with services like Ollama, Anthropic, Mistral, and OpenAI.
About
Go-llm provides a unified interface for interacting with various Large Language Models (LLMs). It supports maintaining message sessions, tool calling (including custom tools), generating embedding vectors, streaming responses, multi-modal support for images and audio, and text-to-speech capabilities (OpenAI only). The package includes a command-line tool for easy interaction with the API, as well as programmatic usage through Go code, allowing developers to integrate LLM functionalities into their applications seamlessly. It supports providers like Ollama, Anthropic, Mistral, and OpenAI.
Key Features
- Maintains sessions of messages for conversational AI
- Generates embedding vectors from text
- Enables tool calling with custom tool plugins
- Supports Ollama, Anthropic, Mistral, and OpenAI LLMs
- Supports streaming responses
- 2 GitHub stars
Use Cases
- Generating text embeddings for semantic search
- Implementing custom tools and plugins for LLMs
- Image Caption Generation
- Building chatbots and conversational AI applications
Sponsored