GitHub · Rust
seuros/MDMA
Model Dispatch and Memory Allocator: an LLM inference engine for the hardware you own. Custom CPU, ROCm, Vulkan, CUDA, Metal and Level Zero kernels, exact memory admission, mTLS gRPC and private federation.
- Stars
- 21
- Forks
- 5
- Stars gained in 24 hours
- +4
- Forks gained in 24 hours
- +1
Topics: amd, apple-silicon, cuda, federation, freebsd, gguf, gpu, grpc, homelab, inference
Latest data point: Nov 22, 2026 · 21 stars · 5 forks