architectds / collabosm
A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or Flash-Next (125B-A6B MoE) on an A100-80G. The cost is shown before it starts; chat with images; Codex or any OpenAI client uses a fixed local /v1. Auto-stop, CU ledger, live prefill/decode. Windows, macOS, Linux.
Why this job: says: chat with
What it does
You pay Google for the GPU only while it runs. collabosm itself is free and open source.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 30 days ago
- Stars
- 103
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 70% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- None
- No issues filed
- Pull requests
- 0 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- Python 70%
- HTML 24%
- Shell 6%
Topics
- colab
- exllamav3
- google-colab
- gpu
- llm
- llm-inference
- openai-api
- qwen
Project record
- JobChat apps
- StatusListed
- Commits58
- Forks4
- Watching1
- Stars in 28 days+5
- CreatedSep 25, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026