vllm-project / semantic-router
An open, programmable decision layer for models and compute.
Why this job: topics: vllm, inference
What it does
Give your agent harness one API for many models. vLLM Semantic Router selects or combines models for each call, guided by your policy.
Get started
curl -fsSL https://vllm-sr.ai/install.sh | bash -s -- --channel stable - Maintenance
- Active
- Last commit today
- Stars
- 6,428
- +52 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.4.0
- Released 43 days ago
- Built with
- Go
- 50% of the code
Is it looked after?
- Contributors
- 30
- Last 90 days
- Issues
- 85% closed
- 358 still open
- Pull requests
- 2,636 merged
- 251 waiting
- Releases
- 4
- 4 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| microsoft / vidur | 721 | 2 months ago | MIT | No downloads |
| LMCache / LMCache | 12,310 | today | Apache-2.0 | Linux |
| InftyAI / llmaz | 314 | 2 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Go 50%
- Python 32%
- TypeScript 12%
- CSS 2%
Topics
- mixture-of-models
- semantic-router
- vllm
- ai-gateway
- kubernetes
- llmrouter
- llm
- guardrails
- inference
- pytorch
- transformer
Project record
- JobLocal LLMs
- StatusFeatured
- Commits3,203
- Forks1,112
- Watching61
- Stars in 28 days+318
- CreatedAug 26, 2025
- First seen by usNov 7, 2026
- CheckedNov 9, 2026