vllm-omni repositories
Trending repositories tagged vllm-omni, ranked by trending score. Updated daily.
-
1
adventists-ai/sophon-realtime
Open full-duplex voice models that hear your tone and speak with one. One GPU with vLLM-Omni, or fully offline on a Mac with MLX. Zero-shot voice cloning, OpenAI Realtime / GPT-Live compatible, free hosted API trial. Apache-2.0.
GitHub · Python · 511 stars · 45 forks · +43 stars in 24 hours · Trending score 3.26
-
2
InferMatrixLab/vllm-omni-mlx
High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.
GitHub · Python · 27 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00