gui-automation repositories

Trending repositories tagged gui-automation, ranked by trending score. Updated daily.

  1. 1
    iFurySt/open-computer-use

    ๐Ÿ‘พ Open Computer Use โ€“ Open-Source Alternative to Codex Computer Use

    GitHub ยท Swift ยท 3,032 stars ยท 278 forks ยท +24 stars in 24 hours ยท Trending score 2.81

  2. 2
    OpenAdaptAI/OpenAdapt

    For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.

    GitHub ยท Python ยท 1,890 stars ยท 285 forks ยท +5 stars in 24 hours ยท Trending score 1.70

  3. 3
    munimtechnologies/munim-computer-use

    Open-source Computer Use MCP server for any coding agent โ€” macOS, Windows, Linux. Accessibility-first, background input, agent pointer, zoom, your signed-in Chrome.

    GitHub ยท Rust ยท 43 stars ยท 9 forks ยท +8 stars in 24 hours ยท Trending score 1.54

  4. 4
    microsoft/Hybrid-Computer-Use

    Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"

    GitHub ยท Go ยท 63 stars ยท 7 forks ยท 0 stars in 24 hours ยท Trending score 0.87

  5. 5
    Jeffrey-Automations/AutoControlGUI

    A framework for GUI automation

    GitHub ยท Python ยท 61 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.22

  6. 6
    ltmroberthk915/dsh-computer-use

    The most precise Windows computer use for DeepSeek Harness: 19 tools address controls by exact UI Automation identity, and numbered marks are checked against the live window before input, so a stale target is refused instead of mis-clicked. Batches, incremental observations and compact receipts cut round trips and token cost.

    GitHub ยท JavaScript ยท 6 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.09

  7. 7
    AmrDab/clawdcursor

    Local MCP server that gives any AI agent safe desktop control on Windows, macOS and Linux. Reads the screen as text and structure (accessibility + OCR) and acts by element name, with screenshots as the last resort. Multi-monitor aware, verifies every action, one safety gate.

    GitHub ยท TypeScript ยท 406 stars ยท 59 forks ยท 0 stars in 24 hours ยท Trending score 0.08

  8. 8
    Fhaxikii/Nano-Lumen

    Nano-Lumen is resident general-purpose agent for Windows desktop, designed as a persistent-state system: cross-session, crash-recoverable, local-first privacy. (Beta)

    GitHub ยท Python ยท 6 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.06

  9. 9
    Ar9av/clippy

    Clippy rebuilt as a macOS agent that can use your computer. It reads your screen and clicks/types the thing

    GitHub ยท Swift ยท 12 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.04

  10. 10
    imbus/robotframework-robosapiens

    Fully localized Robot Framework library for automating the SAP GUI using text locators

    GitHub ยท Python ยท 56 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.03

  11. 11
    wq19901103wq/wechat-mac-rpa

    ๅŸบไบŽๅคšๆจกๆ€่ง†่ง‰ๆ„Ÿ็ŸฅไธŽ LLM Agent ็š„ macOS ๅพฎไฟก่‡ชๅŠจๅŒ–ๆก†ๆžถ | Visual RPA for WeChat

    GitHub ยท Python ยท 138 stars ยท 42 forks ยท 0 stars in 24 hours ยท Trending score 0.02

  12. 12
    OpenAdaptAI/openadapt-flow

    Now part of OpenAdapt: https://github.com/OpenAdaptAI/OpenAdapt (packages/flow)

    GitHub ยท Python ยท 10 stars ยท 4 forks ยท 0 stars in 24 hours ยท Trending score 0.01

  13. 13
    Core-Mate/OpenGUI

    OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

    GitHub ยท HTML ยท 1,819 stars ยท 114 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  14. 14
    camel-ai/crab

    ๐Ÿฆ€๏ธ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/

    GitHub ยท Python ยท 430 stars ยท 64 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  15. 15
    qirabot/qirabot

    AI vision GUI automation for browsers, mobile apps, desktops, and games โ€” no DOM, no selectors. Standalone or on top of Playwright / Selenium / Appium / pytest.

    GitHub ยท Python ยท 18 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  16. 16
    moeru-ai/auv

    ๐Ÿ“ฑ๐Ÿญ Are we computer use, I guess not, it's Application Use Via... a unified orchestration layer of OS automation, 0 token cost. Supports Linux, macOS, Windows, offering TypeScript / Rust / Python / Go SDK

    GitHub ยท Rust ยท 202 stars ยท 17 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  17. 17
    Integration-Automation/PyBreeze

    PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

    GitHub ยท Python ยท 65 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  18. 18
    opengenesishq/EastGenesis

    CaoGen โ€” a vendor-neutral, local-first AI work desktop. Multi-provider agent runtime, GUI automation, MCP, Git worktree, task orchestration, effect ledger, and 3D office workspace. macOS/Windows/Linux.

    GitHub ยท TypeScript ยท 112 stars ยท 4 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  19. 19
    Anionex/dsh-vision-toolkit

    [dsh]ไธบ็บฏๆ–‡ๆœฌๆจกๅž‹่ฎพ่ฎกๆ›ดๅผบๅคง็š„่ง†่ง‰ๅทฅๅ…ท็ฎฑ๏ผšไธ€่กŒๅฎ‰่ฃ…ไฝฟ็”จใ€็ฒ˜่ดดๅ›พ็‰‡็›ดๆŽฅ่ฏ†ๅˆซใ€ๅคšๅผ ๅ›พ็‰‡้—ฎ็ญ”ใ€ๆˆชๅ›พๅˆฐๅ‰็ซฏUI ่ฟ˜ๅŽŸ็ญ‰๏ฝœDeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.

    GitHub ยท TypeScript ยท 918 stars ยท 46 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  20. 20
    ByronScottJones/uictl-mac-mcp

    macOS GUI-automation CLI/MCP server for coding agents

    GitHub ยท Swift ยท 7 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  21. 21
    myna-recorder/Myna-Macro-Recorder-Auto-Clicker

    Myna Recorder โ€” a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.

    GitHub ยท 61 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  22. 22
    jcpsimmons/jev-macos-loop

    Open-source macOS AI computer use and native GUI automation on Apple silicon. Jev + OmniParser CoreML + Apple Vision OCR. Bring your own OpenRouter, Vercel AI Gateway, or TypesafeAI token.

    GitHub ยท JavaScript ยท 23 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  23. 23
    Alpha-Park/genpark-spatial-relationship-grounding-evaluator-skill

    Geometric spatial relationship grounding evaluator verifying relative positional assertions between objects and UI controls

    GitHub ยท Python ยท 7 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  24. 24
    Alpha-Park/genpark-gui-screen-som-coordinate-mapper-skill

    Set-of-Marks (SoM) bounding box resolution and relative viewport coordinate mapper for computer-use vision agents

    GitHub ยท Python ยท 7 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00