Enables robust inspection and interaction with the GNOME Wayland desktop for automation purposes.
Sponsored
Gnome UI MCP provides a small server designed to facilitate automation of the GNOME Wayland desktop. It achieves this by exposing desktop inspection capabilities via AT-SPI for discovering elements and utilizing Mutter RemoteDesktop for input. This allows for powerful actions such as element lookup, activation, typing, taking screenshots, and implementing wait helpers, all within the current desktop session. It is particularly well-suited for integration with Model Context Protocol clients, offering a reliable backend for automating interactive workflows on GNOME.
Key Features
01Supports element lookup and activation
02Facilitates typing simulation
03Provides screenshot capabilities and wait helpers
040 GitHub stars
05Exposes GNOME desktop inspection via AT-SPI
06Enables GNOME desktop interaction via Mutter RemoteDesktop
Use Cases
01Automating interactive tasks on the GNOME Wayland desktop
02Performing UI testing for GNOME applications
03Scripting complex desktop workflows for efficiency