Automates macOS user interfaces through screen capture, element inspection, and simulated user interactions.
Peekaboo is a comprehensive macOS UI automation skill that enables Claude to interact with the operating system like a human user. By leveraging the Peekaboo CLI, this skill allows for capturing screenshots, inspecting UI elements, driving keyboard and mouse input, and managing system-level components like the Dock, Menu Bar, and application windows. It is particularly useful for automating repetitive desktop tasks, performing end-to-end UI testing, and creating complex cross-application workflows directly within the macOS environment.
主要功能
01Scriptable CLI interface with JSON support for seamless automation integration
020 GitHub stars
03Full macOS UI inspection and element targeting by ID, query, or coordinates
04Vision-enhanced screen capture and analysis with annotated UI maps
05Comprehensive app and window management including launch, quit, resize, and focus
06Simulated user input including clicks, drags, typing, and complex hotkey combinations
使用场景
01Automating repetitive data entry or workflows across multiple desktop applications
02Capturing and analyzing system states for automated troubleshooting or documentation
03Performing automated end-to-end UI testing for macOS desktop software
