How does visual regression work in Seer?

It uses a loop comparison script to check current window captures against saved 'baseline' images, generating pixel diffs and reports to identify UI regressions.

Does Seer require any external dependencies?

Yes, certain features require Python 3 with the Pillow library installed, and frame extraction from video requires ffmpeg.

Can I use Seer to create UI wireframes?

Yes, Seer includes a utility to convert natural language descriptions into Excalidraw scene files, making it easy to generate wireframes directly from chat.

Can Seer interact with apps, or just take screenshots?

Seer can perform basic interactions like focusing applications, typing text, and clicking relative coordinates within a window to simulate user behavior.

What operating systems does Seer support?

Seer is specifically designed for macOS, utilizing system-level tools like osascript and screencapture to interact with native windowing.

Seer Visual Automation

Name: Seer Visual Automation
Author: w00ing

byw00ing

•

デザインツール

Captures and analyzes macOS application windows for visual UI verification and automated regression testing.

Seer is a comprehensive visual automation skill for macOS that empowers Claude to see and interact with running applications. It provides a robust suite of tools for capturing precise window screenshots, recording interaction videos, and extracting frames for granular analysis. Beyond simple capture, Seer facilitates automated UI mockups via JSON specs, natural language conversion to Excalidraw wireframes, and a sophisticated visual regression loop that compares current UI states against baselines. This ensures visual consistency and rapid UI feedback throughout the development lifecycle.

主な機能

01Visual regression testing with baseline comparison and diff reporting

02Automated UI interaction including text input and relative clicking

0359 GitHub stars

04Natural language to Excalidraw wireframe generation

05High-precision window screenshot and video recording on macOS

06Image annotation and mockup creation via JSON specifications

ユースケース

01Generating quick wireframes and annotated mockups from text descriptions

02Verifying UI changes match design specs during frontend development

03Automating visual regression tests for macOS applications

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add w00ing/seer-skill seer

For use in Claude.ai and ChatGPT

Download Skill