yeixio/toskar-core
Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your network. Local first, with OpenAI- and Anthropic-compatible APIs, people and roles, and MCP.
GitHub repository with 5 stars and 6 forks.
Language: Go
Topics: ai-orchestration, anthropic-api, distributed-inference, gguf, golang, homelab, llama-cpp, llm, local-ai, local-llm