imrajdas/llm-deployment
Serve an open model with vLLM and a Streamlit chat UI. An Azure VM runs the Kubernetes control plane, and a JarvisLabs GPU VM runs the model.
GitHub repository with 27 stars and 0 forks.
Language: Shell
Topics: azure, gpu, huggingface, kubernetes, llm, streamlit, vllm, jarvislabs