gautam1858/banach
Runs everything, needed for the giants. Local LLM inference that fits 300B–3T Mixture-of-Experts models onto the machine you already own: exact weights on NVMe, a precision ladder in RAM, certified fidelity, honest predictions before you download.
GitHub repository with 13 stars and 0 forks.
Language: Rust