Prajwal7-2002/streamspec
Asynchronous Speculative Layer-Streaming for Frontier & Futuristic AI (70B & DeepSeek-R1 on Consumer Silicon)
GitHub repository with 6 stars and 0 forks.
Language: Jupyter Notebook
Topics: deepseek, deepseek-r1, edge-ai, layer-streaming, llm-inference, pytorch, speculative-decoding, transformers