Do I need to install anything besides the skill?

Yes, you must have idb-companion installed (usually via Homebrew) and an active iOS Simulator running the target application for the skill to interact with the UI.

Can I use this to generate automated tests?

Yes, the skill records its actions and observations, which can be exported to create deterministic Maestro flows or other test scripts for regression testing.

What is the ORAV loop used in this skill?

ORAV stands for Observe-Reason-Act-Verify. It is a four-phase cycle where the skill captures screen state, analyzes the data, executes an action via idb, and verifies the result to navigate apps autonomously.

How does it handle complex UI elements?

It uses a dual-channel approach, combining visual screenshots for spatial context with accessibility trees for precise metadata, allowing it to interact with elements that might be hard to identify via a single method.

Does this skill work on physical iOS devices?

While idb supports physical devices, this skill is specifically optimized for the iOS Simulator to ensure consistent performance and easier screenshot management during exploration.

iOS Agentic UI Exploration (idb)

Name: iOS Agentic UI Exploration (idb)
Author: koromiko

bykoromiko

0•

Mobile Development

Automates iOS application testing and UI discovery using the idb bridge and an autonomous ORAV (Observe-Reason-Act-Verify) loop.

This skill empowers Claude to perform autonomous exploratory testing on iOS apps within a simulator environment. By leveraging the iOS Development Bridge (idb), it implements a structured Observe-Reason-Act-Verify loop that combines visual screenshots with accessibility tree data to navigate complex mobile interfaces. It is particularly effective for discovering edge cases, validating accessibility labels, and generating deterministic Maestro flows without the need for pre-written scripts, making it an essential tool for mobile QA and developer workflows.

主要功能

01Automatic coordinate calculation for precise UI interactions like taps, swipes, and text input.

02Support for both goal-directed testing and open-ended app discovery modes.

03Autonomous ORAV (Observe-Reason-Act-Verify) loop for systematic UI navigation.

04Action logging and state tracking to assist in generating Maestro regression tests.

050 GitHub stars

06Dual-channel observation using synchronized screenshots and JSON accessibility trees.

使用场景

01Accessibility auditing to identify missing labels or untappable elements in iOS apps.

02Automatic reproduction of reported bugs by following step-by-step UI actions recorded in the loop.

03Exploratory testing to find UI bugs and edge cases without manual scripts.

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add koromiko/my_claudecode_marketplace idb-exploration

For use in Claude.ai and ChatGPT

Download Skill