vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
GitHub repository with 5,127 stars and 1,107 forks.
Language: Python
Topics: audio-generation, diffusion, image-generation, inference, model-serving, multimodal, pytorch, transformer, video-generation