trymirai / uzu
A high-performance inference engine for AI models
Why this job: says: inference engine; topics: inference
What it does
A high-performance inference engine for AI models. It allows you to deploy AI directly in your app with zero latency, full data privacy, and no inference costs. Key features:
Get started
uv add uzu==0.6.17- Maintenance
- Active
- Last commit yesterday
- Stars
- 3,247
- +42 this week
- Licence
- MIT
- Allows business use
- Downloads for
- Mac
- From the latest release
- Latest version
- 0.6.17
- Released 6 days ago
- Built with
- Rust
- 58% of the code
Is it looked after?
- Contributors
- 13
- Last 90 days
- Issues
- 76% closed
- 8 still open
- Pull requests
- 849 merged
- 19 waiting
- Releases
- 38
- 30+ in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| incoai / splash | 2,170 | 4 days ago | Apache-2.0 | Mac |
| SharpAI / SwiftLM | 797 | 3 days ago | MIT | Mac |
| vllm-project / vllm-metal | 1,979 | yesterday | Apache-2.0 | Mac |
More: download files, languages, topics and project record
Languages
- Rust 58%
- TypeScript 16%
- Swift 9%
- C++ 6%
Topics
- high-performance
- inference
- llm
- metal
- rust
- ai
- tts
Project record
- JobLocal LLMs
- StatusFeatured
- Commits978
- Forks223
- Watching22
- Stars in 28 days+343
- CreatedJun 23, 2025
- First seen by usNov 7, 2026
- CheckedNov 10, 2026