Ton-Llop/Jaull
Find LLMs that fit your hardware and validate them with reproducible local tests.
GitHub repository with 13 stars and 1 forks.
Language: Python
Topics: benchmarking, cuda, cuda-programming, gguf, gguf-models, hardware-detection, huggingface, llama-cpp, llm, local-ai