EricLBuehler / mistral.rs
Fast, flexible LLM inference
Why this job: says: llm inference
Get started
curl -fsSL https://mistralrs.dev/install.sh | sh - Maintenance
- Active
- Last commit yesterday
- Stars
- 7,821
- +20 this week
- Licence
- MIT
- Allows business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- v0.9.5
- Released 22 days ago
- Built with
- Rust
- 81% of the code
Is it looked after?
- Contributors
- 13
- Last 90 days
- Issues
- 66% closed
- 255 still open
- Pull requests
- 1,367 merged
- 166 waiting
- Releases
- 76
- 30+ in the last year
- No contributing guide
- Security policy (opens in new tab)
- No code of conduct
More: download files, languages, topics and project record
Download files, v0.9.5
- Mac1 file, 193 downloads
- Windows1 file, 229 downloads
- Linux48 files, 1,034 downloads
Languages
- Rust 81%
- Cuda 10%
- Python 4%
- Metal 3%
Topics
- llm
- rust
- uqff
Project record
- JobLocal LLMs
- StatusListed
- Commits3,515
- Forks764
- Watching46
- Stars in 28 days+86
- CreatedFeb 26, 2024
- First seen by usNov 7, 2026
- CheckedNov 9, 2026