vision-language-model repositories

Trending repositories tagged vision-language-model, ranked by trending score. Updated daily.

  1. 1
    off-grid-ai/OGAM

    The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

    GitHub · TypeScript · 3,398 stars · 339 forks · +7 stars in 24 hours · Trending score 2.24

  2. 2
    NVIDIA-AI-Blueprints/video-search-and-summarization

    NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

    GitHub · Python · 1,997 stars · 421 forks · +8 stars in 24 hours · Trending score 2.06

  3. 3
    Neywa-Labs/mlx-vlm

    MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

    GitHub · Python · 5,863 stars · 901 forks · +4 stars in 24 hours · Trending score 1.83

  4. 4
    Carol-lyh/Jeveration

    [arXiv] Jeveration: System One Models Now Generate. https://arxiv.org/abs/2611.24738

    GitHub · Python · 69 stars · 3 forks · +31 stars in 24 hours · Trending score 1.72

  5. 5
    devinxzhang/CycleGRPO

    [ECCV 2026] Official code for CycleGRPO and its video extension Generalized CycleGRPO — unifying region understanding and localization via caption-grounding cycle-consistency RL

    GitHub · Python · 17 stars · 0 forks · +8 stars in 24 hours · Trending score 1.54

  6. 6
    OmniJev/OneJev

    🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.

    GitHub · Python · 274 stars · 28 forks · 0 stars in 24 hours · Trending score 1.27

  7. 7
    CVHub520/X-AnyLabeling

    X-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, point cloud and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.

    GitHub · Python · 10,964 stars · 1,219 forks · 0 stars in 24 hours · Trending score 1.18

  8. 8
    EvolvingLMMs-Lab/LLaVA-OneVision-2.5

    Fully Open Framework for Democratized Multimodal Training

    GitHub · Python · 1,236 stars · 78 forks · +4 stars in 24 hours · Trending score 1.14

  9. 9
    RISE-UNIBAS/humanities_data_benchmark

    LLM Benchmark Suite for Humanities Data

    GitHub · Python · 34 stars · 8 forks · +3 stars in 24 hours · Trending score 1.10

  10. 10
    datalab-to/surya

    OCR, layout analysis, reading order, table recognition in 90+ languages

    GitHub · Python · 21,606 stars · 1,569 forks · +1 stars in 24 hours · Trending score 0.94

  11. 11
    EvolvingLMMs-Lab/lmms-eval

    One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

    GitHub · Python · 4,497 stars · 699 forks · 0 stars in 24 hours · Trending score 0.81

  12. 12
    EliotAndres/iphone-use-app

    An iPhone app where an LLM controls the phone it runs on (no Mac required after setup)

    GitHub · C · 46 stars · 6 forks · +1 stars in 24 hours · Trending score 0.75

  13. 13
    llm-jp/awesome-japanese-llm

    日本語LLMまとめ - Overview of Japanese LLMs

    GitHub · TypeScript · 1,447 stars · 49 forks · 0 stars in 24 hours · Trending score 0.70

  14. 14
    aosama/astronomical

    Set one RAM ceiling. Run bigger sparse language and vision models on Apple Silicon — experts stream from SSD when they don't fit, without hidden quantization. Join Discord Server https://discord.gg/dc4E6r4WD

    GitHub · Rust · 28 stars · 8 forks · 0 stars in 24 hours · Trending score 0.61

  15. 15
    EnragedAntelope/EA_LMStudio

    ComfyUI node for local LLMs and vision models via LM Studio: prompt enhancing, image captioning, reasoning extraction, structured JSON output and VRAM management.

    GitHub · Python · 26 stars · 9 forks · +1 stars in 24 hours · Trending score 0.61

  16. 16
    arpitpatel25/ReadAnyDoc

    Open-source Reducto alternative: parse PDFs, scans and forms into Markdown, tables and typed data with a citation for every value. Claude Haiku or any model. Python library, MCP server, Reducto-compatible API.

    GitHub · Python · 11 stars · 3 forks · +1 stars in 24 hours · Trending score 0.42

  17. 17
    nicedreamzapp/nemotron-omni-mlx

    Run NVIDIA's tri-modal Nemotron Omni (text+vision+audio) entirely on Apple Silicon — pure MLX runtime, parity-verified against NVIDIA's reference

    GitHub · Python · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.40

  18. 18
    BobClawblaw/deepseek-v41-flash-mlx-m5-ultra

    DeepSeek-V4.1-Flash-1017 (2/3-bit experts) on one 256 GB M5 Ultra: the full 1M context, DSpark drafts, int8 x int8 prompt experts, up to four streams, images, tools, JSON. TensorFold native Metal.

    GitHub · Python · 16 stars · 1 forks · 0 stars in 24 hours · Trending score 0.30

  19. 19
    xjyzs/Operator-on-Android

    能后台操作手机的 AI Agent, 免 Root, 执行步数少, 成功率高 An AI agent running in your phone with high efficiency, running in the background, non-root

    GitHub · Kotlin · 36 stars · 6 forks · 0 stars in 24 hours · Trending score 0.29

  20. 20
    Zihao-Wu06/distillops

    Black-box LLM distillation for any verifiable task, with text or image inputs: teacher API -> rejection sampling -> SFT -> eval -> GRPO

    GitHub · Python · 101 stars · 7 forks · 0 stars in 24 hours · Trending score 0.25

  21. 21
    vaibhav-space/vindex

    Open-source video compiler that turns videos into structured knowledge for AI agents.

    GitHub · Python · 20 stars · 3 forks · 0 stars in 24 hours · Trending score 0.24

  22. 22
    llm-jp/simple-evals-mm

    A reproducible, reliable evaluation framework for English and Japanese multimodal tasks.

    GitHub · Python · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.24

  23. 23
    nicedreamzapp/RealTimeAICam

    A camera that tells you what it sees, out loud and offline. On-device scene and page description from a fine-tuned vision model, live OCR, 601-class detection and LiDAR depth. Built for VoiceOver and TalkBack. Free on iPhone and Android.

    GitHub · Swift · 12 stars · 1 forks · 0 stars in 24 hours · Trending score 0.22

  24. 24
    eulogik/TinyDoc-VLM

    256M-param document VLM: SigLIP + SmolLM2. LoRA fine-tuning, ONNX export, runs on CPU. Apache 2.0.

    GitHub · Python · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.21