ui-automation repositories
Trending repositories tagged ui-automation, ranked by trending score. Updated daily.
-
1
pywinauto/pywinauto
Windows GUI Automation with Python (based on text properties)
GitHub · Python · 6,450 stars · 795 forks · +241 stars in 24 hours · Trending score 3.89
-
2
mobile-dev-inc/Maestro
Painless E2E Automation for Mobile and Web
GitHub · Kotlin · 16,474 stars · 1,027 forks · +21 stars in 24 hours · Trending score 2.64
-
3
hridaya423/phonedriver
MCP server and CLI that lets AI agents (Claude Code, Codex, Cursor) see and control Android phones and iPhones. Reads the screen as text. Asks before it pays.
GitHub · Rust · 328 stars · 31 forks · +140 stars in 24 hours · Trending score 2.39
-
4
alexshpunt/pi-agent-computer-use
Computer use for the Pi coding agent — Windows apps, browsers and desktops through native UI trees, screenshots and real input.
GitHub · TypeScript · 103 stars · 6 forks · +10 stars in 24 hours · Trending score 2.06
-
5
cameroncooke/AXe
AXe is a CLI tool for interacting with Simulators using Apple's Private Accessibility APIs.
GitHub · Swift · 2,397 stars · 114 forks · +12 stars in 24 hours · Trending score 2.06
-
6
shanselman/sandbox-mcp
Fresh, throwaway Windows machines for testing your apps: an MCP server and CLI that automate Windows Sandbox
GitHub · JavaScript · 492 stars · 25 forks · +5 stars in 24 hours · Trending score 1.98
-
7
OpenAdaptAI/OpenAdapt
For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.
GitHub · Python · 1,893 stars · 286 forks · +3 stars in 24 hours · Trending score 1.55
-
8
Hacker-Valley-Media/Interceptor
Browser automation and computer use for AI agents. One CLI and MCP server for your signed-in browser, native macOS apps, and real iPhones.
GitHub · TypeScript · 638 stars · 97 forks · +2 stars in 24 hours · Trending score 1.32
-
9
wangzhe04/ruyi-workbench-oss
开源 Windows 本地 AI 工作台|OpenAI-compatible + Claude CLI,99 个桌面/Office 工具,可回退文件操作与可视化多 Agent 工作流。
GitHub · JavaScript · 50 stars · 5 forks · +1 stars in 24 hours · Trending score 1.13
-
10
microsoft/Hybrid-Computer-Use
Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"
GitHub · Go · 63 stars · 7 forks · 0 stars in 24 hours · Trending score 0.87
-
11
AbuZar-Ansarii/Jarvis
An autonomous, local-first on-device AI agent and Android OS automation framework featuring full accessibility control, │ continuous voice intelligence, and self-evolving workflow execution.
GitHub · Dart · 125 stars · 53 forks · 0 stars in 24 hours · Trending score 0.66
-
12
LeonEvo1103/surfaceloom
Open-source AI agent testing framework for browser and native desktop apps, with explicit tool effects, evidence, lifecycle, and trace contracts.
GitHub · TypeScript · 23 stars · 2 forks · +1 stars in 24 hours · Trending score 0.45
-
13
qgindi/LibreAutomate
C# script editor and automation library for Windows
GitHub · C# · 295 stars · 36 forks · 0 stars in 24 hours · Trending score 0.29
-
14
rock3r/spectre
Programmatically drive your real Compose UI on the desktop.
GitHub · Kotlin · 41 stars · 0 forks · 0 stars in 24 hours · Trending score 0.28
-
15
bmcreations/loupe
Android devices, emulators and iOS simulators from your Mac, live in any browser at 60 fps, shared between you and your agents over a CLI, MCP or HTTP.
GitHub · Go · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.24
-
16
Harusame64/desktop-touch-mcp
Windows computer-use MCP server: drive any desktop app via semantic discover-then-act targeting (entities + leases, not pixel coordinates), with per-action perception guards, a native Rust UIA engine, Chrome CDP, and Key Locker credential autofill for ssh/sudo password prompts. Works with Claude, Cursor, and any MCP client.
GitHub · TypeScript · 26 stars · 5 forks · 0 stars in 24 hours · Trending score 0.24
-
17
witchan/ios-mcp
让 Claude、Codex、Cursor 等 AI 助手看懂 iPhone 屏幕并直接操作手机的 iOS 自动化工具与 MCP Server,支持 UI 树获取、元素定位、截图与 OCR 识别、点击滑动、文字输入、应用管理和日志读取,适用于自动化测试与 iOS 逆向调试
GitHub · Objective-C · 692 stars · 122 forks · 0 stars in 24 hours · Trending score 0.22
-
18
cgissing/windows-computer-use
让 Agent 操控 Windows 桌面软件
GitHub · JavaScript · 34 stars · 3 forks · 0 stars in 24 hours · Trending score 0.14
-
19
chuccp/NestSpace
Android app-level virtual space with multi-instance isolation, AI assistant, MCP control and optional root host control. 在 Android 上运行虚拟应用空间,支持多开、数据隔离、AI 助手与 MCP,可选 Root 宿主控制。
GitHub · Kotlin · 7 stars · 4 forks · 0 stars in 24 hours · Trending score 0.09
-
20
shayann07/antigravity-computer-use
Computer Use Skill for Google Antigravity on Windows and macOS. The agent sees your screen, reads accessibility trees and drives real apps with your mouse and keyboard, and Esc stops it at once. Signed updates, no extra LLM, no MCP required.
GitHub · JavaScript · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08
-
21
tiefeiyu/qt-commander
MCP server for live Qt UI automation. Inject into running QWidget or QML/QQuickWindow apps, query the live tree, act/get/set/call, screenshot/annotate, and resolve QML source. Qt 5/6; Windows/Linux.
GitHub · C++ · 8 stars · 2 forks · 0 stars in 24 hours · Trending score 0.04
-
22
dongxinsuperman/ai-phone
iOS / Android / HarmonyOS 三端真机 + 三端虚拟机 AI 自动化中台 · 自然语言驱动纯视觉执行,开箱即用的设备调度、多设备并发与报告回传
GitHub · Python · 135 stars · 26 forks · 0 stars in 24 hours · Trending score 0.04
-
23
ZSeven-W/dsh-ios
DeepSeek Harness (DSH) plugin: a live iOS Simulator — and a USB-connected iPhone — inside the conversation. 22 agent tools for booting, building, driving the UI by accessibility identity, OCR text or list rows, plus a streaming sidebar panel you can tap and drag on.
GitHub · TypeScript · 454 stars · 41 forks · 0 stars in 24 hours · Trending score 0.03
-
24
ZSeven-W/dsh-android
DeepSeek Harness plugin for Android — build, run, and interact with a live emulator or USB device stream inside a conversation, driven entirely through adb.
GitHub · TypeScript · 348 stars · 35 forks · 0 stars in 24 hours · Trending score 0.03