gui-agent repositories
Trending repositories tagged gui-agent, ranked by trending score. Updated daily.
-
1
JosssphZhou/poki
Poki uses your iPhone like you do. An open-source agent app that runs on your iPhone, reads the screen, and taps, types and swipes in real apps with your own model account.
GitHub · Swift · 1,745 stars · 269 forks · +98 stars in 24 hours · Trending score 4.09
-
2
nano-muse/nanoMuse
nanoMuse: an open-source personal agent for every device you own. One agent with a name and a look of its own that does things, keeps working while the app is closed, remembers you, and asks before anything you cannot undo. On Android, iPhone and iPad, Windows / macOS / Linux and in the browser; your phone's screen and your computer as its hands.
GitHub · Swift · 3,627 stars · 440 forks · +37 stars in 24 hours · Trending score 3.24
-
3
web-infra-dev/midscene
See interfaces like a human. E2E testing in natural language.
GitHub · TypeScript · 15,684 stars · 1,229 forks · +32 stars in 24 hours · Trending score 2.88
-
4
OmniJev/OneJev
🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.
GitHub · Python · 274 stars · 28 forks · 0 stars in 24 hours · Trending score 1.26
-
5
edgerunners-2/capri-ai-desktop
Capri — Free open-source AI desktop pet, gaming overlay & voice companion for Windows. Visual GUI for Claude Code, Ollama, DeepSeek & MCP. Joins Discord calls, launches Steam games, comments on gameplay & automates screen tasks offline.
GitHub · Python · 1,738 stars · 161 forks · 0 stars in 24 hours · Trending score 0.91
-
6
microsoft/Hybrid-Computer-Use
Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"
GitHub · Go · 63 stars · 7 forks · 0 stars in 24 hours · Trending score 0.87
-
7
moching-ai-dev/moching
Not a chatbot. Not a coding assistant. A digital operator that controls your entire PC — 219 tools, screen perception, HID control, browser automation, Office suite, AI media. One sentence in, finished work out.
GitHub · 15 stars · 1 forks · +2 stars in 24 hours · Trending score 0.73
-
8
rfdiosuao/lom-desktop
麓鸣 Lom — 桌面 AI 工作台:一个总指挥带多个电脑 Agent(Codex、Claude Code、Gemini CLI)和 Android 手机 Agent 协作。Desktop AI workspace: one commander leads computer agents and Android phone agents as a team. Community source, built on AionUi & OpenMinis.
GitHub · Rust · 15 stars · 1 forks · 0 stars in 24 hours · Trending score 0.42
-
9
physiclaw/PhysiClaw
The AI agent that physically operates a phone — the way you do.
GitHub · Python · 423 stars · 49 forks · 0 stars in 24 hours · Trending score 0.37
-
10
xydzf520/stepx
StepX Companion — STEPX Neo 手机桌面伴侣:Amoo / Work、手机空间压缩、Google Play 安装、背屏设置与体感游戏、投屏控制、文件互传及应用管理。Linux / macOS / Windows。
GitHub · Rust · 21 stars · 7 forks · 0 stars in 24 hours · Trending score 0.30
-
11
xjyzs/Operator-on-Android
能后台操作手机的 AI Agent, 免 Root, 执行步数少, 成功率高 An AI agent running in your phone with high efficiency, running in the background, non-root
GitHub · Kotlin · 36 stars · 6 forks · 0 stars in 24 hours · Trending score 0.24
-
12
yxq953/MuseLite
MuseLite is an open-source AI workspace combining chat, Agent tools, browser automation, and scheduled tasks for users who enjoy Muse and Dots.
GitHub · Python · 93 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14
-
13
edgerunners2/capri-ai-desktop
Capri — Free open-source AI desktop pet, gaming overlay & voice companion for Windows. Visual GUI for Claude Code, Ollama, DeepSeek & MCP. Joins Discord calls, launches Steam games, comments on gameplay & automates screen tasks offline.
GitHub · Python · 214 stars · 45 forks · 0 stars in 24 hours · Trending score 0.07
-
14
bytedance/UI-TARS-desktop
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra
GitHub · TypeScript · 39,581 stars · 4,028 forks · 0 stars in 24 hours · Trending score 0.03
-
15
Core-Mate/OpenGUI
OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.
GitHub · HTML · 1,814 stars · 106 forks · 0 stars in 24 hours · Trending score 0.00
-
16
gtt116/enikk
Open-source Computer Use Agent that works for Any App (GUI or CLI) by Any Model (Vision or Text).
GitHub · Python · 78 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00
-
17
zouyuanqing/vision-primitives-mcp
Vision-primitives MCP server for text-only LLMs: describe, locate (coordinates), OCR with bbox, annotate, crop, zoom, automated anomaly scanning, computer use — powered by Xiaomi MiMo V2.5. Single-file Python, Pillow-only dependency.
GitHub · Python · 9 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
18
Yuxuan2003/Awesome-GUI-Agent-Security
GUI / Computer-Use / Browser Agent 安全论文清单 —— 按攻防轴组织,每篇附中文简介
GitHub · Python · 60 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
19
alphaparkinc/genpark-spatial-grid-anchor-point-mapper-skill
Continuous viewport to discrete UI grid cell and center click coordinate mapper for computer-use agents
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
jin-s13/awesome-gui-agent-hub
A curated hub for GUI agent papers, benchmarks, datasets, projects, and computer-use research.
GitHub · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
21
deskmind-ai/deskmind
Small enough to run on your Mac. Smart enough to ask. An open-source computer use agent for macOS, with local models (MLX) that see, decide and act. 得心,应手。
GitHub · Swift · 133 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
22
Matthew-Eucaristo/s1
Voice-first macOS agent — drive your whole Mac by voice: sees the screen via Accessibility, acts via clicks/typing, verifies every step. Fast local System 1 + pluggable System 2 LLM. Beta.
GitHub · Swift · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00