hyperionaidev/smolmaxxing
maxxing the ability to run different LLMs on the smallest devices possible
GitHub repository with 704 stars and 23 forks.
Language: C
Topics: edge-ai, llama-cpp, llama-cpp-alternative, llm, local-llm, local-llm-support, on-device, quantization, quantization-algorithms