gui-automation repositories
Trending repositories tagged gui-automation, ranked by trending score. Updated daily.
-
1
iFurySt/open-computer-use
๐พ Open Computer Use โ Open-Source Alternative to Codex Computer Use
GitHub ยท Swift ยท 3,032 stars ยท 278 forks ยท +24 stars in 24 hours ยท Trending score 2.81
-
2
OpenAdaptAI/OpenAdapt
For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.
GitHub ยท Python ยท 1,890 stars ยท 285 forks ยท +5 stars in 24 hours ยท Trending score 1.70
-
3
munimtechnologies/munim-computer-use
Open-source Computer Use MCP server for any coding agent โ macOS, Windows, Linux. Accessibility-first, background input, agent pointer, zoom, your signed-in Chrome.
GitHub ยท Rust ยท 43 stars ยท 9 forks ยท +8 stars in 24 hours ยท Trending score 1.54
-
4
microsoft/Hybrid-Computer-Use
Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"
GitHub ยท Go ยท 63 stars ยท 7 forks ยท 0 stars in 24 hours ยท Trending score 0.87
-
5
Jeffrey-Automations/AutoControlGUI
A framework for GUI automation
GitHub ยท Python ยท 61 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.22
-
6
ltmroberthk915/dsh-computer-use
The most precise Windows computer use for DeepSeek Harness: 19 tools address controls by exact UI Automation identity, and numbered marks are checked against the live window before input, so a stale target is refused instead of mis-clicked. Batches, incremental observations and compact receipts cut round trips and token cost.
GitHub ยท JavaScript ยท 6 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.09
-
7
AmrDab/clawdcursor
Local MCP server that gives any AI agent safe desktop control on Windows, macOS and Linux. Reads the screen as text and structure (accessibility + OCR) and acts by element name, with screenshots as the last resort. Multi-monitor aware, verifies every action, one safety gate.
GitHub ยท TypeScript ยท 406 stars ยท 59 forks ยท 0 stars in 24 hours ยท Trending score 0.08
-
8
Fhaxikii/Nano-Lumen
Nano-Lumen is resident general-purpose agent for Windows desktop, designed as a persistent-state system: cross-session, crash-recoverable, local-first privacy. (Beta)
GitHub ยท Python ยท 6 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.06
-
9
Ar9av/clippy
Clippy rebuilt as a macOS agent that can use your computer. It reads your screen and clicks/types the thing
GitHub ยท Swift ยท 12 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.04
-
10
imbus/robotframework-robosapiens
Fully localized Robot Framework library for automating the SAP GUI using text locators
GitHub ยท Python ยท 56 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.03
-
11
wq19901103wq/wechat-mac-rpa
ๅบไบๅคๆจกๆ่ง่งๆ็ฅไธ LLM Agent ็ macOS ๅพฎไฟก่ชๅจๅๆกๆถ | Visual RPA for WeChat
GitHub ยท Python ยท 138 stars ยท 42 forks ยท 0 stars in 24 hours ยท Trending score 0.02
-
12
OpenAdaptAI/openadapt-flow
Now part of OpenAdapt: https://github.com/OpenAdaptAI/OpenAdapt (packages/flow)
GitHub ยท Python ยท 10 stars ยท 4 forks ยท 0 stars in 24 hours ยท Trending score 0.01
-
13
Core-Mate/OpenGUI
OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.
GitHub ยท HTML ยท 1,819 stars ยท 114 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
14
camel-ai/crab
๐ฆ๏ธ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
GitHub ยท Python ยท 430 stars ยท 64 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
15
qirabot/qirabot
AI vision GUI automation for browsers, mobile apps, desktops, and games โ no DOM, no selectors. Standalone or on top of Playwright / Selenium / Appium / pytest.
GitHub ยท Python ยท 18 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
16
moeru-ai/auv
๐ฑ๐ญ Are we computer use, I guess not, it's Application Use Via... a unified orchestration layer of OS automation, 0 token cost. Supports Linux, macOS, Windows, offering TypeScript / Rust / Python / Go SDK
GitHub ยท Rust ยท 202 stars ยท 17 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
17
Integration-Automation/PyBreeze
PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.
GitHub ยท Python ยท 65 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
18
opengenesishq/EastGenesis
CaoGen โ a vendor-neutral, local-first AI work desktop. Multi-provider agent runtime, GUI automation, MCP, Git worktree, task orchestration, effect ledger, and 3D office workspace. macOS/Windows/Linux.
GitHub ยท TypeScript ยท 112 stars ยท 4 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
19
Anionex/dsh-vision-toolkit
[dsh]ไธบ็บฏๆๆฌๆจกๅ่ฎพ่ฎกๆดๅผบๅคง็่ง่งๅทฅๅ ท็ฎฑ๏ผไธ่กๅฎ่ฃ ไฝฟ็จใ็ฒ่ดดๅพ็็ดๆฅ่ฏๅซใๅคๅผ ๅพ็้ฎ็ญใๆชๅพๅฐๅ็ซฏUI ่ฟๅ็ญ๏ฝDeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.
GitHub ยท TypeScript ยท 918 stars ยท 46 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
20
ByronScottJones/uictl-mac-mcp
macOS GUI-automation CLI/MCP server for coding agents
GitHub ยท Swift ยท 7 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
21
myna-recorder/Myna-Macro-Recorder-Auto-Clicker
Myna Recorder โ a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.
GitHub ยท 61 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
22
jcpsimmons/jev-macos-loop
Open-source macOS AI computer use and native GUI automation on Apple silicon. Jev + OmniParser CoreML + Apple Vision OCR. Bring your own OpenRouter, Vercel AI Gateway, or TypesafeAI token.
GitHub ยท JavaScript ยท 23 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
23
Alpha-Park/genpark-spatial-relationship-grounding-evaluator-skill
Geometric spatial relationship grounding evaluator verifying relative positional assertions between objects and UI controls
GitHub ยท Python ยท 7 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
24
Alpha-Park/genpark-gui-screen-som-coordinate-mapper-skill
Set-of-Marks (SoM) bounding box resolution and relative viewport coordinate mapper for computer-use vision agents
GitHub ยท Python ยท 7 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00