TranslateGemma

About

TranslateGemma is a comprehensive, local AI translation service that enables users to translate text across 55 languages without relying on external cloud services. It features a user-friendly web interface for direct interaction, a robust REST API for programmatic access with streaming capabilities, and seamless integration with AI assistants like Claude Desktop via MCP. Packaged as an all-in-one Docker image with embedded Google TranslateGemma models, it offers flexible model selection, smart text chunking for unlimited input length, and detailed GPU monitoring, making it an ideal choice for privacy-conscious or low-latency translation needs.

Key Features

• Full-featured REST API with streaming output support
• Seamless integration with Claude Desktop and other AI assistants (MCP)
• Responsive Web UI with advanced parameter controls and GPU monitoring
• 1 GitHub stars
• Local AI translation service powered by Google's TranslateGemma
• Supports 55 languages and multiple model sizes (4B, 12B, 27B) with Q4/Q8 quantization

Use Cases

• Deploying a private, local translation server for sensitive or proprietary text.
• Integrating real-time, high-quality translation capabilities into custom applications via a REST API.
• Enhancing AI assistants and desktop tools with local translation services for improved privacy and performance.