Langcorn icon

Langcorn

927

Serves LangChain LLM applications and agents as robust FastAPI-powered API endpoints.

About

Langcorn is an API server designed to streamline the deployment of LangChain models and pipelines. By integrating with the high-performance FastAPI framework, it allows developers to quickly expose their LLM-powered applications and agents as scalable RESTful APIs. It supports easy deployment of single or multiple chains, provides built-in authentication, and offers flexibility for custom API keys, request-specific LLM parameter overrides, and comprehensive memory handling for conversational AI.

Key Features

  • 927 GitHub stars
  • Well-documented RESTful API endpoints with automatic Swagger UI
  • Built-in authentication functionality
  • High-performance FastAPI framework for serving requests
  • Easy deployment of LangChain models and pipelines
  • Supports custom LLM parameters and conversational memory handling

Use Cases

  • Exposing LangChain LLM applications and agents as RESTful APIs
  • Deploying multiple LangChain chains or agents from a single FastAPI server
  • Adding secure API authentication to LangChain-powered services
Langcorn: Serve LangChain LLM Apps as Robust FastAPI APIs