distributed-llm repositories

Trending repositories tagged distributed-llm, ranked by trending score. Updated daily.

  1. 1
    b4rtaz/distributed-llama

    Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

    GitHub · C++ · 3,135 stars · 260 forks · 0 stars in 24 hours · Trending score 0.03