umouyoumou-del/DeepInfer-SM86
DeepInfer SM86 native Qwen2.5 kernels plus a local OpenAI-compatible productivity gateway
GitHub repository with 11 stars and 0 forks.
Language: Python
Topics: cuda, deepinfer, llm, local-llm, openai-api, productivity, qwen2, rtx3050, sm86