Extracts text and precise click coordinates from images and screenshots using EasyOCR for automated UI workflows.
The OCR Finder skill enables Claude to interpret and interact with text within any image format, such as PNG or JPG, without requiring macOS accessibility permissions. By leveraging EasyOCR, it identifies text regions, provides detailed bounding boxes, and calculates center-point click coordinates. This tool is particularly valuable for UI automation, testing non-standard interfaces, and extracting data from visual captures where traditional UI inspection tools are restricted or unavailable.
主要功能
010 GitHub stars
02Configurable confidence thresholds to fine-tune OCR detection accuracy
03Supports substring, exact, and case-sensitive text matching filters
04Extracts text from screenshots and UI captures without accessibility permissions
05Returns structured JSON output for seamless automation pipeline integration
06Provides precise X/Y click coordinates for detected text elements
使用场景
01Verifying visual UI elements and button placements during automated regression testing
02Automating interactions with legacy applications or custom UIs that lack accessibility labels
03Extracting text data from low-contrast or complex images for research and documentation
