hybrid-inference repositories

Trending repositories tagged hybrid-inference, ranked by trending score. Updated daily.

  1. 1
    OpenBMB/EC2-Bench

    EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposure. arXiv 2610.17816

    GitHub · Python · 24 stars · 0 forks · +2 stars in 24 hours · Trending score 0.81

  2. 2
    brontoguana/krasis

    Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

    GitHub · C++ · 522 stars · 33 forks · 0 stars in 24 hours · Trending score 0.00