peva3 / SmarterRouter
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
Why this job: says: llm gateway; topics: ai-gateway, llm-proxy, llm-router
What it does
- Live Model Hot‑Swap. Add or remove models without restarting the router. Automatic discovery, optional auto‑profiling, and cleanup of missing models.
- Enhanced Cache Analytics. Detailed time‑series statistics, per‑model cache counts, and advanced monitoring via new admin endpoints.
- Improved Performance. Optimized cache statistics collection and parallel model polling.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 6 months ago
- Stars
- 158
- +3 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- 2.2.5
- Released 6 months ago
- Built with
- Python
- 99% of the code
Is it looked after?
- Contributors
- 0
- Last 90 days
- Issues
- 83% closed
- 2 still open
- Pull requests
- 0 merged
- 0 waiting
- Releases
- 17
- 17 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| maximhq / bifrost | 9,444 | today | Apache-2.0 | No downloads |
| lidge-jun / opencodex | 18,309 | today | MIT | Mac, Windows, Linux |
| respanai / respan-gateway | 638 | today | Apache-2.0 | Mac, Windows, Linux |
More: languages, topics, project record and preview image
Languages
- Python 99%
- Shell <1%
- JavaScript <1%
- Dockerfile <1%
Topics
- ai-cache
- ai-gateway
- docker
- fastapi
- gpu-monitoring
- llm
- llm-proxy
- llm-router
- local-llm
- model-serving
- ollama
- ollama-api
Project record
- JobModel gateways
- StatusListed
- Commits64
- Forks20
- Watching5
- Stars in 28 days+5
- CreatedFeb 16, 2026
- First seen by usNov 7, 2026
- CheckedNov 7, 2026