T-Crypt/berth
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
GitHub repository with 284 stars and 29 forks.
Language: Go
Topics: comfyui, golang, gpu, inference, llama-cpp, llama-swap, llm, local-ai, nvidia, ollama