How do I install the necessary Peekaboo components?

The Peekaboo binary can be installed via Homebrew using the command: brew install steipete/tap/peekaboo.

Can Peekaboo target specific elements within an application?

Yes, using the 'see' command, Peekaboo generates annotated UI maps that provide unique IDs for elements, allowing for precise clicking and interaction.

What operating systems does the Peekaboo skill support?

Peekaboo is designed exclusively for macOS (Darwin) and requires specific system permissions for Screen Recording and Accessibility to function.

Does this skill support scripted automation?

Absolutely. Peekaboo includes a 'run' command for .peekaboo.json scripts and supports global --json flags for easy data parsing in automated workflows.

Can I use Peekaboo to manage system windows and spaces?

Yes, it includes dedicated commands to list, focus, resize, and move windows across different macOS Spaces.

macOS UI Automation (Peekaboo)

Name: macOS UI Automation (Peekaboo)
Author: ishuru

byishuru

Productivity & Workflow

Automates macOS user interfaces through screen capture, element inspection, and programmatic input control.

About

Peekaboo is a comprehensive CLI designed for full macOS desktop automation, allowing Claude to interact directly with the operating system's visual layer. It enables the capture and inspection of screen elements, precise targeting of UI components via IDs or coordinates, and the execution of complex input sequences like dragging, scrolling, and hotkey combinations. This skill is particularly useful for automating native application workflows, performing visual audits, and executing end-to-end tests on macOS where traditional web-based automation tools cannot reach.

Key Features

Keyboard automation for complex hotkey sequences and text entry
0 GitHub stars
Comprehensive input control including mouse clicks, drags, and directional scrolls
System-wide management of windows, apps, the Dock, and the Menubar
Visual UI inspection with annotated screenshots and element mapping
Advanced vision capabilities for screen analysis and frame extraction

Use Cases

Automated end-to-end testing for native macOS desktop applications
Automating repetitive multi-app workflows that lack official API support
Programmatic screen capturing and UI state auditing for documentation or debugging

About

Key Features

Keyboard automation for complex hotkey sequences and text entry
0 GitHub stars
Comprehensive input control including mouse clicks, drags, and directional scrolls
System-wide management of windows, apps, the Dock, and the Menubar
Visual UI inspection with annotated screenshots and element mapping
Advanced vision capabilities for screen analysis and frame extraction

Use Cases

Automated end-to-end testing for native macOS desktop applications
Automating repetitive multi-app workflows that lack official API support
Programmatic screen capturing and UI state auditing for documentation or debugging