Deep-Spark/DeepSparkInference
DeepSparkInference has selected 216 inference models of both small and large sizes. The small models cover fields such as computer vision, natural language processing, and speech recognition; the LLMs involve various frameworks including vLLM, TGI and LMDeploy. This repository is the mirror of Gitee.
GitHub repository with 29 stars and 8 forks.
Language: Python
Topics: gpgpu, inference, llm, modelzoo