hybrid-inference repositories
Trending repositories tagged hybrid-inference, ranked by trending score. Updated daily.
-
1
OpenBMB/EC2-Bench
EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposure. arXiv 2610.17816
GitHub · Python · 24 stars · 0 forks · +2 stars in 24 hours · Trending score 0.81
-
2
brontoguana/krasis
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
GitHub · C++ · 522 stars · 33 forks · 0 stars in 24 hours · Trending score 0.00