Does Go-Llm support tool calling?

Yes, Go-Llm supports tool calling with custom tool plugins, allowing you to extend the functionality of your LLM applications.

What LLM providers does Go-Llm support?

Go-Llm supports Ollama, Anthropic, Mistral, and OpenAI, providing a unified interface for interacting with different large language models.

Can I use Go-Llm for conversational AI?

Yes, Go-Llm maintains sessions of messages, enabling you to build conversational AI applications with ease.

How can I generate embedding vectors with Go-Llm?

Go-Llm enables you to generate embedding vectors from text, which can be used for various NLP tasks such as semantic search and clustering.

Is streaming supported?

Yes, Go-Llm supports streaming responses from LLMs, providing a more responsive and interactive user experience.

Go-Llm

Name: Go-Llm
Author: mutablelogic

•

Implements a simple API interface for large language models, enabling interaction with services like Ollama, Anthropic, Mistral, and OpenAI.

Go-llm provides a unified interface for interacting with various Large Language Models (LLMs). It supports maintaining message sessions, tool calling (including custom tools), generating embedding vectors, streaming responses, multi-modal support for images and audio, and text-to-speech capabilities (OpenAI only). The package includes a command-line tool for easy interaction with the API, as well as programmatic usage through Go code, allowing developers to integrate LLM functionalities into their applications seamlessly. It supports providers like Ollama, Anthropic, Mistral, and OpenAI.

主な機能

01Maintains sessions of messages for conversational AI

02Generates embedding vectors from text

03Enables tool calling with custom tool plugins

04Supports Ollama, Anthropic, Mistral, and OpenAI LLMs

05Supports streaming responses

062 GitHub stars

ユースケース

01Generating text embeddings for semantic search

02Implementing custom tools and plugins for LLMs

03Image Caption Generation

04Building chatbots and conversational AI applications