Avarok-Cybersecurity / atlas
Pure Rust Inference Engine
Why this job: says: inference engine; topics: llm-inference

Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 47 days ago
- Stars
- 714
- +1 this week
- Licence
- AGPL-3.0
- Share-alike, even hosted
- Downloads for
- None listed
- No release files
- Latest version
- 208 releases
- None marked latest
- Built with
- Rust
- 63% of the code
Is it looked after?
- Contributors
- 7
- Last 90 days
- Issues
- 27% closed
- 141 still open
- Pull requests
- 539 merged
- 63 waiting
- Releases
- 208
- 30+ in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| hasso5703 / alzeo | 252 | yesterday | MIT | No downloads |
| Entrpi / ds4-on-spark | 414 | 2 months ago | MIT | No downloads |
| incoai / splash | 2,159 | 3 days ago | Apache-2.0 | Mac |
More: languages, topics and project record
Languages
- Rust 63%
- Cuda 23%
- Python 5%
- JavaScript 3%
Topics
- cuda
- gb10
- llm-inference
- mamba
- nvfp4
- openai-api
- rust
- speculative-decoding
- ssm
- transformers
- dgx
- dgx-spark
Project record
- JobLocal LLMs
- StatusListed
- Commits470
- Forks105
- Watching8
- Stars in 28 days+11
- CreatedMay 5, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026
