GitHub · Python
architectds/collabosm
A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or Flash-Next (125B-A6B MoE) on an A100-80G. The cost is shown before it starts; chat with images; Codex or any OpenAI client uses a fixed local /v1. Auto-stop, CU ledger, live prefill/decode. Windows, macOS, Linux.
- Stars
- 103
- Forks
- 4
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: colab, exllamav3, google-colab, gpu, llm, llm-inference, openai-api, qwen
Latest data point: Nov 21, 2026 · 103 stars · 4 forks