Computer Control
CreatedAB498
Automates computer interactions, providing control over mouse, keyboard, and screen via OCR.
About
Computer Control allows for automated interaction with a computer through a server interface. It leverages PyAutoGUI for mouse and keyboard control, RapidOCR with ONNXRuntime for optical character recognition, and offers screen and window management capabilities. This allows for programmatically controlling a computer, similar to Anthropic's 'computer-use' functionality, without external dependencies.
Key Features
- Control mouse movements and clicks
- 1 GitHub stars
- Type text at the current cursor position
- Capture screenshots with optional OCR
- List and activate windows
- Press keyboard keys
Use Cases
- Automated testing
- Robotic Process Automation (RPA)
- Accessibility tools