Computer Control icon

Computer Control

CreatedAB498

Automates computer interactions, providing control over mouse, keyboard, and screen via OCR.

About

Computer Control allows for automated interaction with a computer through a server interface. It leverages PyAutoGUI for mouse and keyboard control, RapidOCR with ONNXRuntime for optical character recognition, and offers screen and window management capabilities. This allows for programmatically controlling a computer, similar to Anthropic's 'computer-use' functionality, without external dependencies.

Key Features

  • Control mouse movements and clicks
  • 1 GitHub stars
  • Type text at the current cursor position
  • Capture screenshots with optional OCR
  • List and activate windows
  • Press keyboard keys

Use Cases

  • Automated testing
  • Robotic Process Automation (RPA)
  • Accessibility tools
Craft Better Prompts with AnyPrompt