FonaTech/Project_Chronos
⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with Hybrid MLA+Sliding Window Attention.
GitHub repository with 207 stars and 23 forks.
Language: Python
Topics: artificial-intelligence, async-dma, dual-layer-moe, generative-ai, high-throughput, io-latency-hiding, large-language-model, llm, lookahead-routing, lora