hybridgroup/yzma
Go with your own intelligence - Go applications that directly integrate llama.cpp for local inference using hardware acceleration.
GitHub repository with 498 stars and 17 forks.
Language: Go
Topics: golang, llama, llamacpp, llm, purego, vlm, cuda, metal, vulkan, rocm