nicorobinreal / llmspeed
Feel how fast a local LLM runs before you buy the hardware
Why this job: says: local llm; topics: ollama, local-llm, llm-inference, inference
What it does
- Real-time simulation. text streams at the predicted tokens/sec, after a realistic time to first token for your prompt length
- Race mode. run two setups side by side, e.g. a 5090 against a Mac Studio
- Memory fit. see whether a model fits at each quantization, needs partial offload to system RAM, or won't run at all
- 30 GPUs, Macs and CPUs × 15 popular models, across CUDA, Metal, ROCm, Vulkan and CPU
- Shareable links to any setup or race
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 21 days ago
- Stars
- 171
- +2 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- TypeScript
- 89% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- 0% closed
- 4 still open
- Pull requests
- 0 merged
- 1 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| triton-inference-server / server | 11,135 | yesterday | BSD-3-Clause | Linux |
| aidatatools / ollama-benchmark | 397 | 14 days ago | MIT | No downloads |
| uncSoft / anubis-oss | 217 | 2 months ago | GPL-3.0 | No downloads |
More: languages, topics and project record
Languages
- TypeScript 89%
- CSS 6%
- HTML 3%
- Dockerfile 2%
Topics
- llm
- benchmark
- gpu
- hardware
- inference
- llm-inference
- local-llm
- ollama
- self-hosted
Project record
- JobLocal LLMs
- StatusListed
- Commits32
- Forks7
- Watching0
- Stars in 28 days+164
- CreatedAug 28, 2026
- First seen by usNov 7, 2026
- CheckedNov 10, 2026