multimodal-ai repositories

Trending repositories tagged multimodal-ai, ranked by trending score. Updated daily.

  1. 1
    jiangjin1999/awesome-multimodal-agentic-coding

    A curated list of 640+ papers and tools on multimodal coding agents: visual feedback → models as tools → bridging digital and physical worlds. Towards physical AGI.

    GitHub · Python · 32 stars · 4 forks · +20 stars in 24 hours · Trending score 2.21

  2. 2
    NVIDIA-AI-Blueprints/video-search-and-summarization

    NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

    GitHub · Python · 1,997 stars · 421 forks · +8 stars in 24 hours · Trending score 2.06

  3. 3
    video-db/skills

    Server-side video workflows for agents: ingest, understand, search, edit, stream.

    GitHub · 148 stars · 12 forks · +9 stars in 24 hours · Trending score 1.75

  4. 4
    off-grid-ai/OGAD

    Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval, for one payment. No cloud or account.

    GitHub · TypeScript · 150 stars · 28 forks · +3 stars in 24 hours · Trending score 1.05

  5. 5
    Felix-au/CorvusX-Intelligence-in-the-Shadows

    An always-on-top Electron HUD overlay that acts as a stealth desktop copilot. Integrates real-time multimodal screen vision, mixed microphone and system audio loopback capture, global key mirroring, and human-like typing simulation.

    GitHub · TypeScript · 104 stars · 38 forks · 0 stars in 24 hours · Trending score 1.01

  6. 6
    zjunlp/LightMem-Ego

    [EMNLP 2026] LightMem-Ego: Your AI Memory for Everyday Life

    GitHub · Python · 127 stars · 13 forks · 0 stars in 24 hours · Trending score 0.85

  7. 7
    SeanWong17/album-assetizer

    个人相册语义资产生成器:扫描照片 → 视觉大模型标注 → 结构化数据 | Semantic asset generator for personal photo albums

    GitHub · Python · 255 stars · 14 forks · 0 stars in 24 hours · Trending score 0.85

  8. 8
    RobinaMirbahar/Comic-Studio-Ai

    Multi-Agent Comic Generator powered by Google Gemini API & FastAPI on Google Cloud Run (Consistent Characters & 7 Languages) — by Robina Mirbahar

    GitHub · HTML · 18 stars · 4 forks · +2 stars in 24 hours · Trending score 0.81

  9. 9
    OrderogNebula/ai-resocket-test-architect

    AI-Driven Visual & Functional QA Agent powered by Gemini Multimodal Structured Outputs & Terminal CLI

    GitHub · HTML · 50 stars · 0 forks · 0 stars in 24 hours · Trending score 0.50

  10. 10
    tuya/agentic-kit

    Multimodal AI SDK for IoT Devices

    GitHub · C · 56 stars · 7 forks · 0 stars in 24 hours · Trending score 0.47

  11. 11
    Anil-matcha/Wan-3.0-API

    Wan 3.0 API Python SDK and MCP server; see the uncensored Wan 3.0 Spicy API companion for relaxed-moderation routes. Standard text-to-video, image-to-video, multimodal references, uploads, and async jobs.

    GitHub · Python · 81 stars · 10 forks · 0 stars in 24 hours · Trending score 0.41

  12. 12
    moksh-m9u/Multimodal-Rag

    Production-ready multimodal RAG pipeline for PDFs. Extracts text, tables, and images down to the atomic element level via unstructured, chunks and AI-enriches them with a vision LLM, stores them in ChromaDB, and answers queries with full multimodal context

    GitHub · Jupyter Notebook · 6 stars · 3 forks · 0 stars in 24 hours · Trending score 0.31

  13. 13
    AhmadJeddi/LLM-VLM-Guide

    A beginner-first guide to how language and multimodal models work — from language models and Transformers to LLMs, VLMs, audio, video, and modern model families.

    GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22

  14. 14
    lancedb/vectordb-recipes

    Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

    GitHub · Jupyter Notebook · 989 stars · 169 forks · 0 stars in 24 hours · Trending score 0.22

  15. 15
    hurry060215-tech/learnnote-assistant

    A local-first AI learning assistant that turns browser videos and local media into grounded, structured study notes.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.21

  16. 16
    humanbound/humanbound-firewall

    Multi-tier firewall for AI agents — blocks prompt injections, jailbreaks, and scope violations. Local tiers first; LLM judge only when uncertain.

    GitHub · Python · 57 stars · 6 forks · 0 stars in 24 hours · Trending score 0.18

  17. 17
    Supervertaler/Supervertaler-Workbench

    Free, open-source standalone CAT tool: editor, AI translation, termbases, TMs, plus system-wide clipboard manager, SuperLookup, QuickTrans and voice dictation.

    GitHub · Python · 62 stars · 13 forks · 0 stars in 24 hours · Trending score 0.10

  18. 18
    Raytorin/triton-openai-gateway

    OpenAI-compatible gateway for NVIDIA Triton and vLLM with tools, multimodal inputs, embeddings, reranking, and observability.

    GitHub · Python · 10 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08

  19. 19
    ROCK-LAB-PRIVATE-LIMITED/federaide

    P2P multi agent orchestration harness, universal automation system and IDE

    GitHub · Python · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  20. 20
    BuzzPlay/infinite-world

    An open-source system for building persistent worlds with multimodal AI.

    GitHub · TypeScript · 354 stars · 20 forks · −34 stars in 24 hours · Trending score 0.07

  21. 21
    studerus/pepper-android-realtime-chat

    Open-source Android framework for low-latency, LLM-driven multimodal interaction on Pepper. Uses end-to-end speech-to-speech models and extensive Function Calling for agentic robot control (navigation, gaze, vision, touch). Also runs on regular Android devices.

    GitHub · Kotlin · 21 stars · 8 forks · 0 stars in 24 hours · Trending score 0.07

  22. 22
    hpnkv/a11

    A streaming action runtime for AI agents, model serving, and multimodal APIs

    GitHub · C++ · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  23. 23
    humanbound/humanbound

    Open-source adversarial testing engine, SDK, and CLI for AI agents. Runs locally or against the Humanbound Platform.

    GitHub · Python · 237 stars · 22 forks · 0 stars in 24 hours · Trending score 0.05

  24. 24
    sandbaseai/cli

    Open-source AI CLI and local MCP server connecting 25 clients—Claude Code, Cursor, Codex, ChatGPT, Hermes, and OpenClaw—to 2,000+ models/APIs, with OAuth and rollback.

    GitHub · TypeScript · 186 stars · 17 forks · 0 stars in 24 hours · Trending score 0.04