gguf-model-support repositories

Trending repositories tagged gguf-model-support, ranked by trending score. Updated daily.

  1. 1
    Atomic-Germ/OpenFlowLM-Next

    Active and open development fork of FastFlowLM.

    GitHub · C++ · 44 stars · 18 forks · 0 stars in 24 hours · Trending score 0.20

  2. 2
    mxxm-t/llmx

    C++ LLM inference runtime built from scratch, with CPU and Vulkan backends, GGUF support, and multi-GPU serving.

    GitHub · C++ · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  3. 3
    asher/gmlx

    Local inference platform for K/IQ-quant GGUF models on Apple Silicon

    GitHub · Python · 49 stars · 3 forks · 0 stars in 24 hours · Trending score 0.09

  4. 4
    whit3rabbit/turbospark

    MacOS metal LLM inference engine. Run large models with small amount of memory. Inspired by turbo-fieldfare

    GitHub · Rust · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  5. 5
    brontoguana/krasis

    Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

    GitHub · C++ · 522 stars · 33 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    Sudharsanselvaraj/Token-Print

    Interactive 3D visualization platform for exploring transformer architectures, tensors, and real-time LLM inference.

    GitHub · TypeScript · 223 stars · 44 forks · 0 stars in 24 hours · Trending score 0.00