Xiaozhi ESP32

概要

Xiaozhi ESP32 Server is an open-source backend service designed for the Xiaozhi ESP32 intelligent hardware project. Implemented in Python, Java, and Vue based on the Xiaozhi communication protocol, it facilitates the quick setup of your own Xiaozhi server. This project is ideal for users with ESP32 hardware who wish to independently host a robust backend for intelligent dialogue, IoT control, visual perception, and more, offering both simplified and full-module deployment options via Docker or source code.

主な機能

• IOT/MCP Control Protocols: Provides device registration management and intelligent control interfaces compatible with both IOT and MCP protocols.
• Extensible Plugin System: Allows for easy extension of functionalities through a plugin system, custom plugin development, and hot loading.
• Intelligent Dialogue Integration: Enables smart conversations by supporting various Large Language Models (LLMs) and Visual Large Language Models (VLLMs).
• Comprehensive Core Service Architecture: Features WebSocket and HTTP servers with a full console management and authentication system.
• 5,026 GitHub stars
• Advanced Voice Interaction System: Supports stream-based ASR (speech recognition), TTS (text-to-speech), VAD (voice activity detection), and multilingual processing.

ユースケース

• Implement smart home or IoT solutions by controlling appliances and integrating various smart functionalities via ESP32 devices.
• Independently deploy a backend server for Xiaozhi ESP32 hardware devices.
• Create custom AI-powered voice assistants for ESP32 with features like custom voices, multilingual interaction, and real-time interruption.