The Button Heist is a comprehensive framework designed to provide AI agents and human users with granular, programmatic control over iOS applications. By embedding a lightweight client, TheInsideJob, directly into an iOS app, users can connect via an MCP server or CLI to remotely inspect UI elements, simulate complex gestures like taps, swipes, and pinches, and inject text input. This persistent connection enables real-time interaction, screen recording with touch indicators, and robust authentication, making it an ideal solution for advanced mobile app testing, automation, and AI-driven interaction.
Key Features
01Comprehensive gesture simulation, including multi-touch and complex paths.
02Real-time UI element inspection and live screen recording with touch indicators.
03Programmatic text input and value reading via UIKeyboardImpl injection.
04Automated device discovery for both WiFi and USB connections.
051 GitHub stars
06AI Agent integration through an MCP server for native tool calls.