Enable AI agents to perceive and interact with any desktop application through a cross-platform accessibility API.
Sponsored
Touchpoint is a robust Python library designed to empower AI agents with the ability to "see" and "act" on any desktop, regardless of operating system. It achieves this by directly interfacing with native accessibility APIs, providing structured data on UI elements like names, roles, states, and positions, rather than relying on pixel-scraping or computationally expensive vision models. This approach ensures fast, reliable, and precise interaction with both native applications and web content in browsers or Electron apps via Chrome DevTools Protocol (CDP). Furthermore, it includes a built-in Model Context Protocol (MCP) server, making it ready out-of-the-box for LLM agents such as Claude or Cursor to control diverse desktop applications effectively, enabling complex automation tasks like data research and spreadsheet creation.
主要功能
01Integrates Chrome DevTools Protocol (CDP) for browser and Electron app content
021 GitHub stars
03Provides a comprehensive API for UI discovery, search, actions, and input
