alleyxd/quantpicker
Measures which GGUF quant of a model to run on your GPU: real speed and quality loss (KL divergence), not estimates.
GitHub repository with 15 stars and 0 forks.
Language: Rust
Topics: benchmark, gguf, llama-cpp, llm, local-llm, quantization, rust