shtjww / llm-inference-capacity-handbook
大模型推理案头手册（开源版）：给定 GPU 算力，一个模型能扛多少 QPS？三层模型 × 三面墙 × 排队论 × 开环压测
Why this job: says: handbook
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 51 days ago
- Stars
- 186
- +1 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Not stated
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- None
- No issues filed
- Pull requests
- 0 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| patchy631 / time-to-first-token | 1,161 | 2 months ago | Apache-2.0 | No downloads |
More: topics and project record
Topics
- capacity-planning
- gpu
- llm-inference
- llmops
- queueing-theory
- vllm
Project record
- JobLists and guides
- StatusListed
- Commits13
- Forks0
- Watching0
- Stars in 28 days+1
- CreatedSep 2, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026