📋

Desktop Control

Advanced desktop automation with pixel-perfect mouse control, keyboard input, screen capture, window management, and clipboard operations. Built on PyAutoGUI.

matagulv1.0.0
Productivity & TasksAutomation
Подключение к ВМ...
Подключение к ВМ...
npx clawhub@latest install desktop-control
542Текущие установки
120Всего установок
v1.0.0Версия

Desktop Control provides comprehensive desktop automation capabilities, allowing OpenClaw to interact with any application on your computer. It offers pixel-perfect mouse control, fast keyboard input, screen capture with image recognition, window management, and clipboard operations — all with built-in safety features.

Принцип работы

The skill uses PyAutoGUI as its core automation engine, with Pillow for image processing, OpenCV for image recognition, and PyGetWindow for window management. It provides a Python API through the DesktopController class that handles mouse movements (including smooth bezier curves), keyboard events, screen captures, and window state management. Safety mechanisms include failsafe corners, pause control, and an optional approval mode.

Ключевые возможности

Mouse Control
Absolute and relative positioning, smooth movement, left/right/middle/double click, drag-and-drop, and scrolling
Keyboard Input
Fast text typing with configurable WPM, hotkey shortcuts, special keys, key combinations, and hold/release control
Screen Operations
Full-screen and region screenshots, image recognition via OpenCV, pixel color detection, and multi-monitor support
Window Management
List all windows, activate by title, get window info, and minimize/maximize control
Clipboard Operations
Copy text to and read text from the system clipboard
Safety Features
Failsafe corner abort, emergency pause, optional approval mode for actions, bounds checking, and action logging

Требования

Python Packages
PyAutoGUI, Pillow, and PyGetWindow are required. OpenCV (opencv-python) is optional for image recognition
Operating System
Works on macOS, Linux, and Windows. Some features may require elevated privileges
Display
A graphical desktop environment is required (not compatible with headless servers)

Сценарии использования

Form Filling
Automatically fill out web forms or desktop application fields with typed input
Application Automation
Control any desktop application through mouse and keyboard simulation
Screen Monitoring
Capture screenshots, detect specific UI elements via image recognition, and respond to visual changes
File Management
Drag and drop files between folders, multi-select with Ctrl+click
Testing & QA
Automate manual GUI testing workflows across desktop applications

Как установить

1
Run in your terminal
npx clawhub@latest install desktop-control
or
2
Click the Install button at the top of this page for one-click setup

Отзывы

0 отзывов

Войдите, чтобы написать отзыв

Отзывов пока нет. Будьте первым, кто поделится своим опытом!