GitHub · Python
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- Stars
- 8,151
- Forks
- 786
- Stars gained in 24 hours
- +1
- Forks gained in 24 hours
- +1
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference
Latest data point: Nov 20, 2026 · 8,151 stars · 786 forks