dakotacookson/Llama-RPC-Farm
Web UI to pool your home machines into one llama.cpp cluster: multi-machine RPC GPU pooling + on-demand multi-model serving via llama-swap
GitHub repository with 11 stars and 2 forks.
Language: Python
Topics: distributed-inference, gpu, homelab, inference, llama-swap, llamacpp, llm, local-llm, multi-node, openai-compatible