msmarkgu / RelayFreeLLM
A restful API designed to route user prompts to various AI model providers.
Why this job: matched by what the repo talks about: api, provider, model, route
What it does
- Streaming responses. real-time token-by-token output
- Provider attribution. see which provider/model handled each response
- Conversation history. persist chats in your browser (localStorage) or on the server (opt-in)
- Conversation management. sidebar with search, rename, copy, delete
- Edit & delete messages. fix typos or prune unwanted branches mid-conversation
Get started
git clone https://github.com/msmarkgu/RelayFreeLLM.git && cd RelayFreeLLM
pip install -r requirements.txt - Maintenance
- Active
- Last commit 2 months ago
- Stars
- 178
- +2 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 78% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 0% closed
- 1 still open
- Pull requests
- 11 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| jwadow / kiro-gateway | 2,355 | 5 months ago | AGPL-3.0 | No downloads |
| vibe-coding-labs / JoyCode2Api | 219 | 4 months ago | Apache-2.0 | Mac, Linux |
More: languages, topics and project record
Languages
- Python 78%
- JavaScript 14%
- CSS 7%
- HTML 1%
Topics
- api-aggregator
- api-gateway
- auto-failover
- consistent-output
- context-man
- fastapi
- free
- llm
- openai
- python
- quota-tracking
- rate-limit
Project record
- JobModel gateways
- StatusListed
- Commits95
- Forks22
- Watching3
- Stars in 28 days+2
- CreatedMar 16, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026