lightseekorg / tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
Why this job: says: inference engine, llm inference
What it does
TokenSpeed is a speed-of-light LLM inference engine designed for agentic workloads, with TensorRT-LLM-level performance and vLLM-level usability. The goal is to be the most performant inference engine for production agentic workloads.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 2,895
- +48 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.1.1
- Released 34 days ago
- Built with
- Python
- 88% of the code
Is it looked after?
- Contributors
- 15
- Last 90 days
- Issues
- 92% closed
- 6 still open
- Pull requests
- 2,445 merged
- 93 waiting
- Releases
- 2
- 2 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| vllm-project / vllm | 96,588 | today | Apache-2.0 | Mac, Linux |
| GradientHQ / parallax | 1,423 | 4 months ago | Apache-2.0 | No downloads |
| ekzhang / resin | 422 | 4 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 88%
- C++ 7%
- Rust 5%
- Shell <1%
Topics
- deepseek
- gpt-oss
- kimi
- lightseek
- llm
- minimax
- qwen
- speed-of-light
- tokenspeed
- blackwell
- glm
- vlm
Project record
- JobLocal LLMs
- StatusFeatured
- Commits2,420
- Forks404
- Watching16
- Stars in 28 days+204
- CreatedMay 6, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026