vllm-inference repositories

Trending repositories tagged vllm-inference, ranked by trending score. Updated daily.

  1. 1
    IBM/vLLM-Hook

    Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM

    GitHub · Python · 172 stars · 38 forks · 0 stars in 24 hours · Trending score 0.07