rockswe/sptc-gate
Admission control for speculative LLM calls on a shared vLLM/SGLang/Tensor-RT LLM server
GitHub repository with 8 stars and 0 forks.
Language: Python
Topics: ai-agents, llm-inference, llm-serving, sglang, tensor-rt, tool-calling, vllm