📋

Desktop Control

Advanced desktop automation with pixel-perfect mouse control, keyboard input, screen capture, window management, and clipboard operations. Built on PyAutoGUI.

matagulv1.0.0
Productivity & TasksAutomation
Verbindung zu VM wird hergestellt...
Verbindung zu VM wird hergestellt...
npx clawhub@latest install desktop-control
543Aktuelle Installationen
120Gesamte Installationen
v1.0.0Version
Quellcode ansehen(ClawHub)

Desktop Control provides comprehensive desktop automation capabilities, allowing OpenClaw to interact with any application on your computer. It offers pixel-perfect mouse control, fast keyboard input, screen capture with image recognition, window management, and clipboard operations — all with built-in safety features.

Funktionsweise

The skill uses PyAutoGUI as its core automation engine, with Pillow for image processing, OpenCV for image recognition, and PyGetWindow for window management. It provides a Python API through the DesktopController class that handles mouse movements (including smooth bezier curves), keyboard events, screen captures, and window state management. Safety mechanisms include failsafe corners, pause control, and an optional approval mode.

Hauptfunktionen

Mouse Control
Absolute and relative positioning, smooth movement, left/right/middle/double click, drag-and-drop, and scrolling
Keyboard Input
Fast text typing with configurable WPM, hotkey shortcuts, special keys, key combinations, and hold/release control
Screen Operations
Full-screen and region screenshots, image recognition via OpenCV, pixel color detection, and multi-monitor support
Window Management
List all windows, activate by title, get window info, and minimize/maximize control
Clipboard Operations
Copy text to and read text from the system clipboard
Safety Features
Failsafe corner abort, emergency pause, optional approval mode for actions, bounds checking, and action logging

Voraussetzungen

Python Packages
PyAutoGUI, Pillow, and PyGetWindow are required. OpenCV (opencv-python) is optional for image recognition
Operating System
Works on macOS, Linux, and Windows. Some features may require elevated privileges
Display
A graphical desktop environment is required (not compatible with headless servers)

Anwendungsfälle

Form Filling
Automatically fill out web forms or desktop application fields with typed input
Application Automation
Control any desktop application through mouse and keyboard simulation
Screen Monitoring
Capture screenshots, detect specific UI elements via image recognition, and respond to visual changes
File Management
Drag and drop files between folders, multi-select with Ctrl+click
Testing & QA
Automate manual GUI testing workflows across desktop applications

Installation

1
Run in your terminal
npx clawhub@latest install desktop-control
or
2
Click the Install button at the top of this page for one-click setup

Bewertungen

0 Bewertungen

Anmelden, um eine Bewertung zu schreiben

Noch keine Bewertungen. Sei der Erste, der seine Erfahrungen teilt!