alibaba / ServeGen
A framework for generating realistic LLM serving workloads
Why this job: topics: llm-serving, model-serving
What it does
ServeGen is a framework for generating realistic large language model (LLM) serving workloads. Powered by the analysis of billions of inference requests across 12 production models on Alibaba Cloud Model Studio (百炼), ServeGen is able to replicate the nuanced complexity of real-world workloads, such as:
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 2 months ago
- Stars
- 192
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 50% closed
- 3 still open
- Pull requests
- 0 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| vllm-project / vllm | 96,634 | today | Apache-2.0 | Mac, Linux |
| thu-pacman / chitu | 2,999 | 3 days ago | Apache-2.0 | No downloads |
| liguodongiot / llm-action | 25,268 | 27 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 100%
Topics
- deepseek
- llm
- llm-serving
- model-serving
- qwen
Project record
- JobLocal LLMs
- StatusListed
- Commits15
- Forks17
- Watching1
- Stars in 28 days+12
- CreatedJun 5, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026