GitHub · Shell
hossbit/local-ai-server
Run GGUF language models locally with llama.cpp, llama-swap, CUDA/Vulkan GPU acceleration, automatic model discovery, systemd integration, and an OpenAI-compatible API.
- Stars
- 8
- Forks
- 1
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: ai-server, cuda, debian, fedora, gguf, gpu-acceleration, linux, llama-cpp, llama-swap, llm
Latest data point: Nov 22, 2026 · 8 stars · 1 forks