multimodal repositories
Trending repositories tagged multimodal, ranked by trending score. Updated daily.
-
1
bojieli/ai-agent-book
《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
GitHub · Python · 58,895 stars · 6,913 forks · +280 stars in 24 hours · Trending score 4.67
-
2
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
GitHub · JavaScript · 68,457 stars · 7,739 forks · +59 stars in 24 hours · Trending score 3.55
-
3
screenpipe/screenpipe
YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.
GitHub · Rust · 22,485 stars · 2,311 forks · +63 stars in 24 hours · Trending score 3.36
-
4
vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
GitHub · Python · 7,856 stars · 2,162 forks · +36 stars in 24 hours · Trending score 3.29
-
5
sgl-project/sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
GitHub · Python · 1,827 stars · 762 forks · +15 stars in 24 hours · Trending score 2.83
-
6
Neywa-Labs/mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
GitHub · Python · 8,306 stars · 800 forks · +37 stars in 24 hours · Trending score 2.83
-
7
ARahim3/DigUp
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
GitHub · Swift · 6,481 stars · 518 forks · +24 stars in 24 hours · Trending score 2.75
-
8
chaw1/datakeel
Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.
GitHub · Python · 220 stars · 0 forks · +22 stars in 24 hours · Trending score 2.50
-
9
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42
-
10
OmniJev/Flide
🔥🔥 The extremely fast inference engine for decision model
GitHub · Python · 546 stars · 37 forks · +9 stars in 24 hours · Trending score 2.36
-
11
rerun-io/rerun
Visualize, query, and stream to train on multimodal robotics data.
GitHub · Rust · 11,840 stars · 909 forks · +10 stars in 24 hours · Trending score 2.33
-
12
SAOS-3624/dsh-video-storyboard
Scene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
GitHub · JavaScript · 580 stars · 40 forks · +11 stars in 24 hours · Trending score 2.15
-
13
StarTrail-org/PixelRAG
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
GitHub · Python · 10,969 stars · 988 forks · +7 stars in 24 hours · Trending score 2.10
-
14
antflydb/antfly
GitHub · Zig · 512 stars · 36 forks · +14 stars in 24 hours · Trending score 2.08
-
15
apache/seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
GitHub · Java · 9,819 stars · 2,471 forks · +6 stars in 24 hours · Trending score 1.96
-
16
vortex-data/vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
GitHub · Rust · 3,332 stars · 267 forks · +6 stars in 24 hours · Trending score 1.87
-
17
ysr666/dsh-vision-router
Eyes for text-only DeepSeek Harness agents: built-in free vision chain (no key) + pixel-level vision tools (Q&A, grounding, crop, pixel diff, colors, OCR, SVG trace, cutout, screenshots). One-command install, no Python, image turns work like ordinary tool-calling turns.
GitHub · JavaScript · 1,291 stars · 63 forks · +7 stars in 24 hours · Trending score 1.86
-
18
genkit-ai/genkit
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
GitHub · TypeScript · 6,605 stars · 887 forks · +4 stars in 24 hours · Trending score 1.75
-
19
TanStack/ai
🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.
GitHub · TypeScript · 3,373 stars · 409 forks · +3 stars in 24 hours · Trending score 1.73
-
20
liustack/modlens
The first vision plugin for DeepSeek Harness, and the vision bridge for every text-only coding agent. Paste an image, get structured JSON evidence (OCR, layout, semantics). | 全网最强 DeepSeek Harness 外挂视觉插件,为 DeepSeek、GLM 等纯文本模型外挂视觉能力,粘贴图片即得结构化 JSON 证据(OCR、版面、语义)。
GitHub · TypeScript · 4,985 stars · 156 forks · 0 stars in 24 hours · Trending score 1.70
-
21
NeuroBrix/neurobrix
Run real AI models on the GPU you already own: language, speech, image and video models from one engine and one container format, with or without PyTorch. NVIDIA GPUs, Mac GPUs through Metal, CPU; other GPUs experimental. Apache 2.0.
GitHub · Python · 67 stars · 0 forks · +8 stars in 24 hours · Trending score 1.62
-
22
NVIDIA-NeMo/DataDesigner
🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.
GitHub · Python · 2,417 stars · 249 forks · +5 stars in 24 hours · Trending score 1.61
-
23
fedibenameur11/ai-manus
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
GitHub · Python · 152 stars · 104 forks · 0 stars in 24 hours · Trending score 1.59
-
24
monirchemrubd/ai-manus
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
GitHub · Python · 152 stars · 105 forks · 0 stars in 24 hours · Trending score 1.59