Overlay Companion
Enables AI-assisted, human-in-the-loop screen interaction capabilities through a streamlined, containerized infrastructure.
소개
Overlay Companion provides an AI-powered screen overlay system deeply integrated with the Model Context Protocol (MCP), offering intelligent screen interaction. It leverages a simplified containerized architecture, primarily with KasmVNC for web-native, multi-monitor remote desktop access, making it easier to deploy and manage than legacy systems. The system includes an MCP server for screen capture, overlay annotations, and AI interaction, a management web interface, and an optional clipboard bridge for seamless host-VM clipboard synchronization.
주요 기능
- AI-powered screen overlay system with Model Context Protocol (MCP) integration
- True multi-monitor support for remote desktops via web-native KasmVNC
- Optional Flatpak-based clipboard bridge for host-VM content synchronization
- Streamlined containerized infrastructure using KasmVNC for deployment
- Simplified YAML-based configuration without requiring a database
- 1 GitHub stars
사용 사례
- Developing AI agents for automating screen-based tasks and interactions
- Setting up remote, AI-assisted work environments with advanced multi-monitor support
- Integrating intelligent overlay and screen interaction capabilities into custom applications
Advertisement