cyrusbehr / tensorrt-cpp-api
TensorRT C++ API Tutorial
Why this job: works in the areas we cover, but does not say which job it does
What it does
- Engine cache that's actually safe. Build-or-load keyed by ONNX content hash + build options
- Dynamic shapes, done right. Per-input min/opt/max optimization profiles; -1-aware Shape;
- Concurrency. EnginePool leases execution contexts for multi-stream inference; every call
- No leaky abstractions. No nvinfer1, OpenCV, or spdlog types in any public header (PImpl +
- Quantization without surprises. Precision::kFp16 / kInt8Qdq / kFp8 …; precision is
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 5 months ago
- Stars
- 813
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- C++
- 81% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 90% closed
- 7 still open
- Pull requests
- 18 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| pytorch / TensorRT | 3,023 | yesterday | BSD-3-Clause | Windows, Linux |
| GeeeekExplorer / nano-vllm | 16,396 | 6 months ago | MIT | No downloads |
| CVCUDA / CV-CUDA | 2,734 | 23 days ago | Custom | Linux |
More: languages, topics and project record
Languages
- C++ 81%
- CMake 7%
- Shell 6%
- Python 4%
Topics
- computer-vision
- cpp
- inference
- machine-learning
- tensorrt
Project record
- JobOther AI tools
- StatusListed
- Commits157
- Forks105
- Watching9
- Stars in 28 days+2
- CreatedOct 25, 2021
- First seen by usNov 7, 2026
- CheckedNov 8, 2026