ardanlabs/kronk
Your personal engine for running open source models locally. Use Go for hardware accelerated local inference with llama.cpp and whisper.cpp directly integrated into your Go applications. Kronk provides a high-level API and a model server.
GitHub repository with 648 stars and 39 forks.
Language: Go