vllm-omni repositories

Trending repositories tagged vllm-omni, ranked by trending score. Updated daily.

  1. 1
    adventists-ai/sophon-realtime

    Open full-duplex voice models that hear your tone and speak with one. One GPU with vLLM-Omni, or fully offline on a Mac with MLX. Zero-shot voice cloning, OpenAI Realtime / GPT-Live compatible, free hosted API trial. Apache-2.0.

    GitHub · Python · 511 stars · 45 forks · +43 stars in 24 hours · Trending score 3.26

  2. 2
    InferMatrixLab/vllm-omni-mlx

    High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.

    GitHub · Python · 27 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00