triton-inference-server / server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Why this job: says: inference server; topics: inference
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 4 days ago
- Stars
- 11,134
- +14 this week
- Licence
- BSD-3-Clause
- Allows business use
- Downloads for
- Linux
- From the latest release
- Latest version
- v2.74.0
- Released 7 days ago
- Built with
- Python
- 59% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 81% closed
- 780 still open
- Pull requests
- 4,084 merged
- 132 waiting
- Releases
- 96
- 12 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| openvinotoolkit / model_server | 956 | 3 days ago | Apache-2.0 | Windows |
| ekzhang / resin | 422 | 4 days ago | Apache-2.0 | No downloads |
| nicorobinreal / llmspeed | 171 | 20 days ago | MIT | No downloads |
More: download files, languages, topics and project record
Languages
- Python 59%
- Shell 21%
- C++ 17%
- CMake 1%
Topics
- inference
- gpu
- machine-learning
- deep-learning
- cloud
- datacenter
- edge
Project record
- JobLocal LLMs
- StatusListed
- Commits3,895
- Forks1,867
- Watching144
- Stars in 28 days+71
- CreatedOct 4, 2018
- First seen by usNov 7, 2026
- CheckedNov 8, 2026