video-understanding repositories
Trending repositories tagged video-understanding, ranked by trending score. Updated daily.
-
1
Aseiel/VideoHighlighter
Open-source local AI video analyzer powered by Ollama. Visual search, automatic highlights, scene/action/object detection, audio analysis, and subtitle generation. Free, offline alternative to Twelve Labs, Runway, and Descript.
GitHub · Python · 442 stars · 57 forks · +45 stars in 24 hours · Trending score 3.02
-
2
SAOS-3624/dsh-video-storyboard
Scene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
GitHub · JavaScript · 583 stars · 40 forks · +11 stars in 24 hours · Trending score 2.15
-
3
NVIDIA-AI-Blueprints/video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
GitHub · Python · 1,997 stars · 421 forks · +8 stars in 24 hours · Trending score 2.06
-
4
devinxzhang/CycleGRPO
[ECCV 2026] Official code for CycleGRPO and its video extension Generalized CycleGRPO — unifying region understanding and localization via caption-grounding cycle-consistency RL
GitHub · Python · 17 stars · 0 forks · +8 stars in 24 hours · Trending score 1.54
-
5
OmniJev/OneJev
🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.
GitHub · Python · 274 stars · 28 forks · 0 stars in 24 hours · Trending score 1.27
-
6
NVIDIA/context-aware-rag
Context-Aware RAG library for Knowledge Graph ingestion and retrieval functions.
GitHub · Python · 94 stars · 31 forks · +4 stars in 24 hours · Trending score 1.24
-
7
UditAkhourii/cdaf
CDAF (Cached Descriptive Asset Files) - open sidecar format for video so AI agents stop re-analyzing the same footage. Spec, CLI, agent skill, reproducible benchmark.
GitHub · Python · 226 stars · 12 forks · 0 stars in 24 hours · Trending score 1.21
-
8
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
GitHub · Python · 4,497 stars · 699 forks · 0 stars in 24 hours · Trending score 0.81
-
9
Lechoung-J/reelpack-alpha
Reelpack — 给 AI 的视频理解引擎 / The Video-Understanding Engine for AI · License: FSL-1.1-MIT
GitHub · Python · 199 stars · 0 forks · 0 stars in 24 hours · Trending score 0.57
-
10
MuseLinn/MusePi
MusePi — desktop-first AI coding assistant: Electron GUI + TUI/CLI + daemon + desktop companion. Native video understanding, MCP, advisor, memory, multi-domain skills; own update channel.
GitHub · TypeScript · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.38
-
11
The-Martyr/Awesome-Multimodal-Reasoning
Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs
GitHub · 108 stars · 13 forks · 0 stars in 24 hours · Trending score 0.29
-
12
MirroS-Lab/Code-as-World
Code as World: Agentic Discovery of Executable World Representations for Physical Reasoning
GitHub · Python · 452 stars · 10 forks · 0 stars in 24 hours · Trending score 0.28
-
13
junnhwan/vid-lens
基于 Go 与 Eino 的多模态视频解读 Agent:阅读转写文本/字幕、按需查看真实画面,将 YouTube 视频整理为图文文章,支持围绕原视频持续问答。
GitHub · Go · 76 stars · 10 forks · 0 stars in 24 hours · Trending score 0.19
-
14
yiliu-li/Visual-Agentic-Memory
Official Implementation of "Visual Agentic Memory: Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval"
GitHub · Python · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14
-
15
oxbshw/watch-skill
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic contracts, not model opinion. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.
GitHub · Python · 586 stars · 84 forks · 0 stars in 24 hours · Trending score 0.08
-
16
ambient-intelligence-hq/ambient
A video understanding and research agent that can reason over long-form videos
GitHub · TypeScript · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07
-
17
bytedance/Lance
A 3B-active-parameter native unified multimodal model for image and video understanding, generation, and editing.
GitHub · Python · 1,371 stars · 92 forks · 0 stars in 24 hours · Trending score 0.00
-
18
momentslab/peek
[BMVC 2026] Official implementation of PEEK: Picking Essential frames via Efficient Knowledge distillation
GitHub · Python · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
19
OpenMOSS/MOSS-VL
An open-weight 11B model series for long-form and real-time video understanding
GitHub · C++ · 766 stars · 38 forks · 0 stars in 24 hours · Trending score 0.00
-
20
TeleAI-UAGI/telemem
TeleMem is a high-performance drop-in replacement for Mem0, featuring semantic deduplication, long-term dialogue memory, and multimodal video reasoning.
GitHub · Python · 494 stars · 36 forks · 0 stars in 24 hours · Trending score 0.00
-
21
iBz-04/boomerang
Exact-moment video search & retrieval
GitHub · Rust · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
22
bytedance/SALMONN
SALMONN family: A suite of advanced multi-modal LLMs
GitHub · 1,544 stars · 127 forks · 0 stars in 24 hours · Trending score 0.00
-
23
zai-org/GLM-V
GLM-4.6V/4.5V/4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
GitHub · Python · 2,399 stars · 188 forks · 0 stars in 24 hours · Trending score 0.00
-
24
grayhatdevelopers/vidxp
VidXP (Video eXPlain) - Video Indexing Engine. Search in videos in natural language. 👀 Connect your Hermes / Claude / OpenClaw agents, allow them to understand videos with low token cost.
GitHub · Python · 59 stars · 21 forks · 0 stars in 24 hours · Trending score 0.00