whit3rabbit/turbospark
MacOS metal LLM inference engine. Run large models with small amount of memory. Inspired by turbo-fieldfare
GitHub repository with 5 stars and 0 forks.
Language: Rust
Topics: gguf, gguf-model-support, mlx, mlx-lm, rust, rust-crate, rust-lang, rust-library, rustlang