sgl-project / rbg
A workload for deploying LLM inference services on Kubernetes
Why this job: matched by what the repo talks about: inference, llm, kubernete, deploy
What it does
Traditional Kubernetes primitives (StatefulSets / Deployments) struggle with LLM inference services that:
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 3 days ago
- Stars
- 314
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.8.0
- Released 2 months ago
- Built with
- Go
- 99% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 51% closed
- 59 still open
- Pull requests
- 350 merged
- 34 waiting
- Releases
- 22
- 17 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| ome-projects / ome | 525 | yesterday | Apache-2.0 | No downloads |
| eagle-hq / EAGLE-4 | 1,163 | 9 days ago | Custom | No downloads |
| bitcloud-ai / Bittune | 213 | 4 days ago | MIT | Linux |
More: languages, topics and project record
Languages
- Go 99%
- Shell 1%
- Makefile <1%
- Dockerfile <1%
Topics
- k8s
- llm
- sglang
- pd-disagg
Project record
- JobLocal LLMs
- StatusListed
- Commits529
- Forks86
- Watching3
- Stars in 28 days+10
- CreatedAug 28, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026