thepr0metheus/lama-caravan
LAMA CARAVAN — Local And Multi-backend Adaptive Computation And Routing Across Various AI Nodes. Self-hosted control plane for llama.cpp fleets and AI agents: hybrid local/cloud token routing with queues & schedules, remote server cells, HF model browser, usage accounting. Stdlib Python.
GitHub repository with 5 stars and 1 forks.
Language: Python
Topics: ai-agents, gguf, hermes, hermes-agent, llama-cpp, llm, llm-router, openai-api, openclaw, openclaw-agent