Auten

•

Provide AI agents with hands to view, click, type, and automate tasks across desktop environments and mobile devices.

Auten is a computer-use Model Context Protocol server that bridges AI clients like Claude Code, Cursor, and Codex directly to your operating system. Rather than relying solely on screen pixels, it leverages the accessibility tree alongside OCR to interact accurately with UI elements across macOS, Windows, Linux, and Android devices. Auten operates using a bring-your-own-agent model, executing automated desktop and mobile actions locally while keeping sensitive credentials protected inside native system keychains. It also features task recording capabilities, enabling agents to learn repeatable skills that execute rapidly on future runs without consuming additional AI tokens.

主要功能

01Skill recording and replay mechanism to execute learned workflows instantly without consuming AI tokens
02Secure local credential management that inputs secrets directly without exposing them to AI models
030 GitHub stars
04Cross-platform support spanning macOS, Windows, Linux, and Android over USB
05Flexible connection options supporting both local stdio and remote Server-Sent Events (SSE)
06Accessibility-first UI reading that pairs structured element trees with visual OCR and screenshots

使用案例

01Automating repetitive workflows in legacy desktop software lacking native APIs
02Extracting data, documents, and reports across desktop applications directly into local directories
03Testing and operating mobile interfaces on connected Android devices using plain-language agent prompts