multimodal-ai repositories
Trending repositories tagged multimodal-ai, ranked by trending score. Updated daily.
-
1
jiangjin1999/awesome-multimodal-agentic-coding
A curated list of 640+ papers and tools on multimodal coding agents: visual feedback → models as tools → bridging digital and physical worlds. Towards physical AGI.
GitHub · Python · 32 stars · 4 forks · +20 stars in 24 hours · Trending score 2.21
-
2
NVIDIA-AI-Blueprints/video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
GitHub · Python · 1,997 stars · 421 forks · +8 stars in 24 hours · Trending score 2.06
-
3
video-db/skills
Server-side video workflows for agents: ingest, understand, search, edit, stream.
GitHub · 148 stars · 12 forks · +9 stars in 24 hours · Trending score 1.75
-
4
off-grid-ai/OGAD
Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval, for one payment. No cloud or account.
GitHub · TypeScript · 150 stars · 28 forks · +3 stars in 24 hours · Trending score 1.05
-
5
Felix-au/CorvusX-Intelligence-in-the-Shadows
An always-on-top Electron HUD overlay that acts as a stealth desktop copilot. Integrates real-time multimodal screen vision, mixed microphone and system audio loopback capture, global key mirroring, and human-like typing simulation.
GitHub · TypeScript · 104 stars · 38 forks · 0 stars in 24 hours · Trending score 1.01
-
6
zjunlp/LightMem-Ego
[EMNLP 2026] LightMem-Ego: Your AI Memory for Everyday Life
GitHub · Python · 127 stars · 13 forks · 0 stars in 24 hours · Trending score 0.85
-
7
SeanWong17/album-assetizer
个人相册语义资产生成器:扫描照片 → 视觉大模型标注 → 结构化数据 | Semantic asset generator for personal photo albums
GitHub · Python · 255 stars · 14 forks · 0 stars in 24 hours · Trending score 0.85
-
8
RobinaMirbahar/Comic-Studio-Ai
Multi-Agent Comic Generator powered by Google Gemini API & FastAPI on Google Cloud Run (Consistent Characters & 7 Languages) — by Robina Mirbahar
GitHub · HTML · 18 stars · 4 forks · +2 stars in 24 hours · Trending score 0.81
-
9
OrderogNebula/ai-resocket-test-architect
AI-Driven Visual & Functional QA Agent powered by Gemini Multimodal Structured Outputs & Terminal CLI
GitHub · HTML · 50 stars · 0 forks · 0 stars in 24 hours · Trending score 0.50
-
10
tuya/agentic-kit
Multimodal AI SDK for IoT Devices
GitHub · C · 56 stars · 7 forks · 0 stars in 24 hours · Trending score 0.47
-
11
Anil-matcha/Wan-3.0-API
Wan 3.0 API Python SDK and MCP server; see the uncensored Wan 3.0 Spicy API companion for relaxed-moderation routes. Standard text-to-video, image-to-video, multimodal references, uploads, and async jobs.
GitHub · Python · 81 stars · 10 forks · 0 stars in 24 hours · Trending score 0.41
-
12
moksh-m9u/Multimodal-Rag
Production-ready multimodal RAG pipeline for PDFs. Extracts text, tables, and images down to the atomic element level via unstructured, chunks and AI-enriches them with a vision LLM, stores them in ChromaDB, and answers queries with full multimodal context
GitHub · Jupyter Notebook · 6 stars · 3 forks · 0 stars in 24 hours · Trending score 0.31
-
13
AhmadJeddi/LLM-VLM-Guide
A beginner-first guide to how language and multimodal models work — from language models and Transformers to LLMs, VLMs, audio, video, and modern model families.
GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22
-
14
lancedb/vectordb-recipes
Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs
GitHub · Jupyter Notebook · 989 stars · 169 forks · 0 stars in 24 hours · Trending score 0.22
-
15
hurry060215-tech/learnnote-assistant
A local-first AI learning assistant that turns browser videos and local media into grounded, structured study notes.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.21
-
16
humanbound/humanbound-firewall
Multi-tier firewall for AI agents — blocks prompt injections, jailbreaks, and scope violations. Local tiers first; LLM judge only when uncertain.
GitHub · Python · 57 stars · 6 forks · 0 stars in 24 hours · Trending score 0.18
-
17
Supervertaler/Supervertaler-Workbench
Free, open-source standalone CAT tool: editor, AI translation, termbases, TMs, plus system-wide clipboard manager, SuperLookup, QuickTrans and voice dictation.
GitHub · Python · 62 stars · 13 forks · 0 stars in 24 hours · Trending score 0.10
-
18
Raytorin/triton-openai-gateway
OpenAI-compatible gateway for NVIDIA Triton and vLLM with tools, multimodal inputs, embeddings, reranking, and observability.
GitHub · Python · 10 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08
-
19
ROCK-LAB-PRIVATE-LIMITED/federaide
P2P multi agent orchestration harness, universal automation system and IDE
GitHub · Python · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
20
BuzzPlay/infinite-world
An open-source system for building persistent worlds with multimodal AI.
GitHub · TypeScript · 354 stars · 20 forks · −34 stars in 24 hours · Trending score 0.07
-
21
studerus/pepper-android-realtime-chat
Open-source Android framework for low-latency, LLM-driven multimodal interaction on Pepper. Uses end-to-end speech-to-speech models and extensive Function Calling for agentic robot control (navigation, gaze, vision, touch). Also runs on regular Android devices.
GitHub · Kotlin · 21 stars · 8 forks · 0 stars in 24 hours · Trending score 0.07
-
22
hpnkv/a11
A streaming action runtime for AI agents, model serving, and multimodal APIs
GitHub · C++ · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
23
humanbound/humanbound
Open-source adversarial testing engine, SDK, and CLI for AI agents. Runs locally or against the Humanbound Platform.
GitHub · Python · 237 stars · 22 forks · 0 stars in 24 hours · Trending score 0.05
-
24
sandbaseai/cli
Open-source AI CLI and local MCP server connecting 25 clients—Claude Code, Cursor, Codex, ChatGPT, Hermes, and OpenClaw—to 2,000+ models/APIs, with OAuth and rollback.
GitHub · TypeScript · 186 stars · 17 forks · 0 stars in 24 hours · Trending score 0.04