GitHub · Python
alphastorm/omp-ninfer
Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.
- Stars
- 50
- Forks
- 5
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: coding-agent, cuda, local-llm, nvidia, oh-my-pi, qwen, rtx-5090, self-hosted, speculative-decoding, rtx-3090
Latest data point: Nov 22, 2026 · 50 stars · 5 forks