llm-infernece repositories

Trending repositories tagged llm-infernece, ranked by trending score. Updated daily.

  1. 1
    VectorInstitute/vector-inference

    Efficient LLM inference on Slurm clusters.

    GitHub · Python · 110 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00