Does this skill support natural language commands?

Yes, Peekaboo includes an 'agent' mode that allows you to provide high-level natural language instructions which the tool translates into UI actions.

What version of macOS is required?

Peekaboo is designed for macOS 15.0 and later versions to leverage the latest system automation capabilities.

What permissions are required for Peekaboo to function?

Peekaboo requires macOS Screen Recording and Accessibility permissions to capture the screen and interact with UI elements programmatically.

How does Peekaboo handle UI changes during automation?

It uses snapshot IDs to ensure that clicks and interactions are performed on the correct elements even if the UI shifts between commands.

Can Peekaboo automate any macOS application?

Yes, Peekaboo can interact with most applications that support standard macOS accessibility APIs, including system dialogs and menu bars.

macOS UI Automation

Name: macOS UI Automation
Author: diegopetrucci

bydiegopetrucci

生产力与工作流

Automates macOS desktop applications and captures annotated screenshots using accessibility APIs for seamless AI-driven interactions.

关于

Peekaboo is a specialized macOS automation skill that enables Claude to interact with the desktop environment through programmatic control and visual analysis. It provides the ability to capture screenshots with precise UI element annotations, automate mouse and keyboard actions, and manage application windows or system dialogs. This skill is ideal for developers and power users looking to bridge the gap between AI reasoning and native macOS applications, facilitating complex multi-step workflows, UI testing, and visual auditing.

主要功能

Comprehensive window, space, and application management
Annotated screen and window capture with accessibility metadata
Natural language automation for complex desktop tasks
0 GitHub stars
Precision UI interaction including clicking, typing, and scrolling
Detailed menu bar and system dialog programmatic navigation

使用场景

Automating repetitive data entry and navigation tasks across multiple macOS apps
Creating automated UI/UX testing suites for native desktop software
Capturing visual snapshots and analyzing UI layouts for design consistency

关于

主要功能

Comprehensive window, space, and application management
Annotated screen and window capture with accessibility metadata
Natural language automation for complex desktop tasks
0 GitHub stars
Precision UI interaction including clicking, typing, and scrolling
Detailed menu bar and system dialog programmatic navigation

使用场景

Automating repetitive data entry and navigation tasks across multiple macOS apps
Creating automated UI/UX testing suites for native desktop software
Capturing visual snapshots and analyzing UI layouts for design consistency