beehive-lab / jitllm
Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
Why this job: says: llm inference; topics: gguf
What it does
One .jar runs the same model on NVIDIA, Intel, AMD, and Apple Silicon, from a laptop to an RTX 5090.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 4 days ago
- Stars
- 295
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest tag
- jitllm-v2.0.0
- Released 21 days ago
- Built with
- Java
- 98% of the code
Is it looked after?
- Contributors
- 3
- Last 90 days
- Issues
- 61% closed
- 21 still open
- Pull requests
- 172 merged
- 11 waiting
- Releases
- 14
- 10 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- Java 98%
- Python 1%
- Shell 1%
- Jinja <1%
Topics
- accelerators
- compilers
- gpu
- java
- java21
- llama3
- nvidia
- tornadovm
- gguf
- llm
- mistral
- mistral-7b
Project record
- JobLocal LLMs
- StatusListed
- Commits2,001
- Forks42
- Watching9
- Stars in 28 days+5
- CreatedMay 10, 2025
- First seen by usNov 7, 2026
- CheckedNov 9, 2026