LocalGPT

关于

LocalGPT is an open-source initiative that empowers users to interact with their documents securely and privately. By running the entire Retrieval-Augmented Generation (RAG) pipeline locally, it guarantees that no data ever leaves the user's computer, upholding 100% privacy. This robust tool supports a wide array of open-source language models (including HF, GPTQ, GGML, and GGUF) and embeddings, offering versatile options for local AI interactions. It's an ideal solution for those requiring confidential document analysis or building privacy-focused applications.

主要功能

• Broad Hardware Compatibility: Supports GPU (CUDA), CPU, HPU (Intel® Gaudi®), and MPS (Apple Silicon).
• API & Graphical Interfaces: Provides an API for building RAG applications and comes with two GUIs (one API-based, one standalone Streamlit).
• Versatile Model Support: Integrates various open-source LLMs (HF, GPTQ, GGML, GGUF) and embeddings.
• Utmost Privacy: Ensures data remains on your computer without external data transfer.
• 20,589 GitHub stars
• Chat History & Source Display: Remembers conversation history within a session and can show source documents for answers.

使用案例

• Securely querying personal or confidential documents without cloud exposure.
• Developing and testing privacy-focused Retrieval-Augmented Generation (RAG) applications locally.
• Experimenting with various open-source large language models and embeddings on your own hardware.