llm-runtime repositories
Trending repositories tagged llm-runtime, ranked by trending score. Updated daily.
-
1
zhangshuibai/molten
Run a coding model at 300+ tok/s on your Mac. Native Rust + Metal inference engine for LiquidAI LFM2.5-24B-A2B (MLX 4-bit) on Apple Silicon.
GitHub · Metal · 29 stars · 2 forks · +1 stars in 24 hours · Trending score 0.59
-
2
initializ/forge
Forge is the open-source runtime for Anthropic's Agent Skills standard — built for the agent that runs next to a service, in your environment, on infrastructure you already operate. Write a SKILL.md. Compile to a portable, hardened agent. Deploy it anywhere containers run: Kubernetes, on-prem, air-gapped, embedded in CI, or as an A2A endpoint.
GitHub · Go · 230 stars · 17 forks · 0 stars in 24 hours · Trending score 0.23
-
3
xarillian/chorus-llm
A local LLM runtime for many-agent applications, built on llama.cpp. One model, shared inference, many agents, embedded. C++/C, Vulkan, Metal, Godot.
GitHub · C++ · 20 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00