multimodal repositories

Trending repositories tagged multimodal, ranked by trending score. Updated daily.

  1. 1
    bojieli/ai-agent-book

    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

    GitHub · Python · 58,895 stars · 6,913 forks · +280 stars in 24 hours · Trending score 4.67

  2. 2
    Mintplex-Labs/anything-llm

    Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

    GitHub · JavaScript · 68,457 stars · 7,739 forks · +59 stars in 24 hours · Trending score 3.55

  3. 3
    screenpipe/screenpipe

    YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.

    GitHub · Rust · 22,485 stars · 2,311 forks · +63 stars in 24 hours · Trending score 3.36

  4. 4
    vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    GitHub · Python · 7,856 stars · 2,162 forks · +36 stars in 24 hours · Trending score 3.29

  5. 5
    sgl-project/sglang-omni

    High Performance Serving Runtime For Interactive Super Intelligence System

    GitHub · Python · 1,827 stars · 762 forks · +15 stars in 24 hours · Trending score 2.83

  6. 6
    Neywa-Labs/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

    GitHub · Python · 8,306 stars · 800 forks · +37 stars in 24 hours · Trending score 2.83

  7. 7
    ARahim3/DigUp

    Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

    GitHub · Swift · 6,481 stars · 518 forks · +24 stars in 24 hours · Trending score 2.75

  8. 8
    chaw1/datakeel

    Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.

    GitHub · Python · 220 stars · 0 forks · +22 stars in 24 hours · Trending score 2.50

  9. 9
    modelscope/ms-swift

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

    GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42

  10. 10
    OmniJev/Flide

    🔥🔥 The extremely fast inference engine for decision model

    GitHub · Python · 546 stars · 37 forks · +9 stars in 24 hours · Trending score 2.36

  11. 11
    rerun-io/rerun

    Visualize, query, and stream to train on multimodal robotics data.

    GitHub · Rust · 11,840 stars · 909 forks · +10 stars in 24 hours · Trending score 2.33

  12. 12
    SAOS-3624/dsh-video-storyboard

    Scene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.

    GitHub · JavaScript · 580 stars · 40 forks · +11 stars in 24 hours · Trending score 2.15

  13. 13
    StarTrail-org/PixelRAG

    https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

    GitHub · Python · 10,969 stars · 988 forks · +7 stars in 24 hours · Trending score 2.10

  14. 14
    antflydb/antfly

    GitHub · Zig · 512 stars · 36 forks · +14 stars in 24 hours · Trending score 2.08

  15. 15
    apache/seatunnel

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    GitHub · Java · 9,819 stars · 2,471 forks · +6 stars in 24 hours · Trending score 1.96

  16. 16
    vortex-data/vortex

    An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

    GitHub · Rust · 3,332 stars · 267 forks · +6 stars in 24 hours · Trending score 1.87

  17. 17
    ysr666/dsh-vision-router

    Eyes for text-only DeepSeek Harness agents: built-in free vision chain (no key) + pixel-level vision tools (Q&A, grounding, crop, pixel diff, colors, OCR, SVG trace, cutout, screenshots). One-command install, no Python, image turns work like ordinary tool-calling turns.

    GitHub · JavaScript · 1,291 stars · 63 forks · +7 stars in 24 hours · Trending score 1.86

  18. 18
    genkit-ai/genkit

    Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

    GitHub · TypeScript · 6,605 stars · 887 forks · +4 stars in 24 hours · Trending score 1.75

  19. 19
    TanStack/ai

    🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.

    GitHub · TypeScript · 3,373 stars · 409 forks · +3 stars in 24 hours · Trending score 1.73

  20. 20
    liustack/modlens

    The first vision plugin for DeepSeek Harness, and the vision bridge for every text-only coding agent. Paste an image, get structured JSON evidence (OCR, layout, semantics). | 全网最强 DeepSeek Harness 外挂视觉插件,为 DeepSeek、GLM 等纯文本模型外挂视觉能力,粘贴图片即得结构化 JSON 证据(OCR、版面、语义)。

    GitHub · TypeScript · 4,985 stars · 156 forks · 0 stars in 24 hours · Trending score 1.70

  21. 21
    NeuroBrix/neurobrix

    Run real AI models on the GPU you already own: language, speech, image and video models from one engine and one container format, with or without PyTorch. NVIDIA GPUs, Mac GPUs through Metal, CPU; other GPUs experimental. Apache 2.0.

    GitHub · Python · 67 stars · 0 forks · +8 stars in 24 hours · Trending score 1.62

  22. 22
    NVIDIA-NeMo/DataDesigner

    🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.

    GitHub · Python · 2,417 stars · 249 forks · +5 stars in 24 hours · Trending score 1.61

  23. 23
    fedibenameur11/ai-manus

    AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

    GitHub · Python · 152 stars · 104 forks · 0 stars in 24 hours · Trending score 1.59

  24. 24
    monirchemrubd/ai-manus

    AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

    GitHub · Python · 152 stars · 105 forks · 0 stars in 24 hours · Trending score 1.59