llama-swap repositories

Trending repositories tagged llama-swap, ranked by trending score. Updated daily.

  1. 1
    T-Crypt/berth

    Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.

    GitHub · Go · 300 stars · 30 forks · 0 stars in 24 hours · Trending score 0.47

  2. 2
    dakotacookson/Llama-RPC-Farm

    Web UI to pool your home machines into one llama.cpp cluster: multi-machine RPC GPU pooling + on-demand multi-model serving via llama-swap

    GitHub · Python · 12 stars · 2 forks · 0 stars in 24 hours · Trending score 0.37

  3. 3
    T-Crypt/speculum

    monitor for a local LLM runtime (llama-swap, NInfer, Strata, more) -- metrics ported to berth.

    GitHub · Python · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22

  4. 4
    elektricM/gpuq

    Stop GPU programs fighting over VRAM on Linux: queues jobs, unloads LLM models, stops services. Ollama, llama.cpp, vLLM, ComfyUI, Stable Diffusion

    GitHub · Rust · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.17