pykeio / ort
Fast ML inference & training for ONNX models in Rust
Why this job: matched by what the repo talks about: inference, model, fast, rust
What it does
Based on the now-inactive onnxruntime-rs crate, ort is primarily a wrapper for Microsoft's ONNX Runtime library, but offers support for other pure-Rust runtimes.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 10 days ago
- Stars
- 2,611
- +7 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v2.0.0-rc.15
- Released 23 days ago
- Built with
- Rust
- 98% of the code
Is it looked after?
- Contributors
- 5
- Last 90 days
- Issues
- 99% closed
- 2 still open
- Pull requests
- 158 merged
- 1 waiting
- Releases
- 36
- 5 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| robertknight / rten | 362 | yesterday | Apache-2.0 | No downloads |
| fastmachinelearning / qonnx | 195 | 2 months ago | Apache-2.0 | No downloads |
| CogitatorTech / infera | 137 | 20 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Rust 98%
- Python 1%
- TypeScript <1%
- JavaScript <1%
Topics
- ai
- inference
- machine-learning
- onnxruntime
- rust
- onnx
- ai-training
- fine-tuning
Project record
- JobLocal LLMs
- StatusListed
- Commits1,104
- Forks279
- Watching17
- Stars in 28 days+50
- CreatedNov 26, 2022
- First seen by usNov 7, 2026
- CheckedNov 9, 2026