multimodal-llm repositories

Trending repositories tagged multimodal-llm, ranked by trending score. Updated daily.

  1. 1
    hec-ovi/vllm-awq4-qwen

    vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-stream, vision, tool calling, 256K context, OpenAI-compatible, Docker. Matches DGX Spark FP8+DFlash+MTP at a third of the cost. No CUDA.

    GitHub · Python · 53 stars · 5 forks · +8 stars in 24 hours · Trending score 1.60

  2. 2
    Tencent/WeMM-Video

    WeMM-Video is a family of omni-modal foundation models by WeChat Vision at Tencent, excelling in omni-modal video understanding and reasoning while maintaining top-tier capabilities across general audio, image, and text.

    GitHub · Python · 58 stars · 2 forks · +21 stars in 24 hours · Trending score 1.53

  3. 3
    NVIDIA/sports-intelligence-playbooks

    This repository provides a starter kit for sports intelligence built on NVIDIA AI stack: playbooks, training recipes, and inference for Multimodal Language Models.

    GitHub · Python · 94 stars · 12 forks · +1 stars in 24 hours · Trending score 1.24

  4. 4
    Tencent/WeMM-Embedding

    WeMM-Embedding is a family of universal multimodal embedding models by the WeChat Vision Team at Tencent, supporting multimodal understanding and retrieval.

    GitHub · Python · 1,824 stars · 125 forks · +1 stars in 24 hours · Trending score 0.82

  5. 5
    sirkosophia/Where-OPD

    Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes. Official implementation.

    GitHub · Python · 18 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46

  6. 6
    HVision-NKU/OraRL

    🎬 OraRL — Annotations as Rollouts for efficient, scalable reinforcement learning of unified video MLLMs.

    GitHub · Python · 165 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00

  7. 7
    v-modal/vmodal_sdk_robotics

    Robotics vision SDK

    GitHub · Python · 448 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    alphaparkinc/genpark-image-token-cost-calculator-skill

    Multi-modal vision token cost and tile decomposition calculator for OpenAI, Anthropic, and Google architectures

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    yxwang1215/Glance-ETD

    Glance, then Select: Evidence-Tempered Visual Token Selection for Extremely Compressed Multimodal LLMs

    GitHub · Python · 9 stars · 0 forks · Trending score 0.09