llama-swap repositories
Trending repositories tagged llama-swap, ranked by trending score. Updated daily.
-
1
T-Crypt/berth
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
GitHub · Go · 300 stars · 30 forks · 0 stars in 24 hours · Trending score 0.47
-
2
dakotacookson/Llama-RPC-Farm
Web UI to pool your home machines into one llama.cpp cluster: multi-machine RPC GPU pooling + on-demand multi-model serving via llama-swap
GitHub · Python · 12 stars · 2 forks · 0 stars in 24 hours · Trending score 0.37
-
3
T-Crypt/speculum
monitor for a local LLM runtime (llama-swap, NInfer, Strata, more) -- metrics ported to berth.
GitHub · Python · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22
-
4
elektricM/gpuq
Stop GPU programs fighting over VRAM on Linux: queues jobs, unloads LLM models, stops services. Ollama, llama.cpp, vLLM, ComfyUI, Stable Diffusion
GitHub · Rust · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.17