ernie-research/DCore
Speculative decoding has plenty of tricks. Which ones actually make LLMs faster? Explore 7 methods, 26 checkpoints, and a shared training and evaluation framework.
GitHub repository with 35 stars and 1 forks.
Language: Python
Topics: speculative-decoding