Database · MODEL CONTEXT PROTOCOL
hetaoBackend mcp pyautogui server
A MCP (Model Context Protocol) server that provides automated GUI testing and control capabilities through PyAutoGUI.
WHAT IT CONNECTS
What hetaoBackend mcp pyautogui server gives an AI Agent
- Control mouse movements and clicks
- Simulate keyboard input
- Take screenshots
- Find images on screen
- Get screen information
- Cross-platform support (Windows, macOS, Linux)
- Move mouse to specific coordinates
- Click at current or specified position
- Drag and drop operations
- Get current mouse position
- Type text
- Press individual keys
- Hotkey combinations
- Take screenshots
- Get screen size
- Find image locations on screen
- Get pixel colors
- Python 3.12+
- PyAutoGUI
- Other dependencies will be installed automatically
- Sync dependencies and update lockfile:
- Build package distributions:
- Publish to PyPI:
- Token: `--token` or `UV_PUBLISH_TOKEN`
- Username/password: `--username`/`UV_PUBLISH_USERNAME` and `--password`/`UV_PUBLISH_PASSWORD`
SECURITY
An MCP listing is not a security review
An MCP server may receive model context, credentials, local files, or permission to call external systems. Review its code, requested environment variables, network behavior, package provenance, and maintenance status before connecting it to an agent.