cloudrift-ai / emmy
Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel fusion, autotuning, and advanced scheduling. Run benchmarks across different GPU types and configurations, track results and share experiments with the community.
Why this job: topics: llm-inference, inference, llm inference
What it does
The package includes ready-to-use recipes. Remote deployment and benchmarking do not require a local GPU or CUDA installation. For gated Hugging Face models, accept the model's license and set HF_TOKEN.
Get started
pip install emmy-ml
emmy --version- Maintenance
- Active
- Last commit today
- Stars
- 123
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.3.23
- Released 11 days ago
- Built with
- Python
- 96% of the code
Is it looked after?
- Contributors
- 5
- Last 90 days
- Issues
- 30% closed
- 7 still open
- Pull requests
- 1,245 merged
- 7 waiting
- Releases
- 25
- 25 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| liguodongiot / llm-action | 25,268 | 27 days ago | Apache-2.0 | No downloads |
| xLLM-AI / xllm | 1,619 | yesterday | Apache-2.0 | No downloads |
| alibaba / rtp-llm | 1,394 | yesterday | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 96%
- Rust 3%
- Shell 1%
- Makefile <1%
Topics
- compilers
- gpu-computing
- inference
- llm-inference
- llmops
Project record
- JobLocal LLMs
- StatusListed
- Commits1,575
- Forks20
- Watching0
- Stars in 28 days+16
- CreatedAug 2, 2025
- First seen by usNov 7, 2026
- CheckedNov 10, 2026