astra-sim / GenZ-LLM-Analyzer
LLM Inference analyzer for different hardware platforms
Why this job: says: llm inference; topics: llm-inference
What it does
GenZ to designed to simplify the relationship between the hardware platform used for serving Large Language Models(LLMs) and inference serving metrics like latency and memory.
Get started
pip install genz-llm- Maintenance
- Active
- Last commit yesterday
- Stars
- 129
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Jupyter Notebook
- 70% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- 83% closed
- 1 still open
- Pull requests
- 2 merged
- 2 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| liguodongiot / llm-action | 25,268 | 27 days ago | Apache-2.0 | No downloads |
| ashhart / TensorFold | 1,719 | yesterday | Apache-2.0 | Mac, Linux |
| incoai / splash | 2,170 | 4 days ago | Apache-2.0 | Mac |
More: languages, topics and project record
Languages
- Jupyter Notebook 70%
- Python 30%
- Shell <1%
Topics
- llm-inference
Project record
- JobLocal LLMs
- StatusListed
- Commits147
- Forks26
- Watching6
- Stars in 28 days+2
- CreatedMay 30, 2024
- First seen by usNov 7, 2026
- CheckedNov 10, 2026