he-yufeng/core-deepinfer
A readable NumPy inference loop: prefill, prefix recovery, verification budgets and speculative KV rollback
GitHub repository with 12 stars and 1 forks.
Language: Python
Topics: deepinfer, deepseek, educational, kv-cache, llm-inference, numpy, speculative-decoding