Linux AT-SPI2 Automation

概要

This skill provides expert-level guidance for navigating the AT-SPI2 (Assistive Technology Service Provider Interface) ecosystem to automate Linux desktop applications. It specializes in cross-toolkit automation for GTK and Qt applications, focusing on the discovery of accessible objects, session bus communication, and event monitoring. A core tenet of this skill is a security-first approach, implementing strict controls to block access to sensitive applications, protect password fields, and enforce rate limits, making it a powerful resource for building reliable and safe desktop automation scripts.

主な機能

• Strict security controls including application blocklisting and PASSWORD_TEXT role filtering.
• TDD-first workflow for validating accessibility tree interactions and UI actions.
• Performance-aware implementation patterns like node caching and event filtering.
• 4 GitHub stars
• Cross-toolkit automation for GTK and Qt applications using pyatspi2 and D-Bus.
• Reliability frameworks with mandatory timeouts and graceful D-Bus error handling.

ユースケース

• Developing accessibility-focused tools that audit and interact with the desktop object tree.
• Automating functional UI testing for Linux desktop applications without toolkit-specific drivers.
• Creating secure workflow automation scripts that require system-wide UI interaction.