containers / ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Why this job: topics: llamacpp, vllm
What it does
RamaLama strives to make working with AI simple, straightforward, and familiar by using OCI containers.
Get started
pip install ramalama- Maintenance
- Active
- Last commit 3 days ago
- Stars
- 3,112
- +11 this week
- Licence
- MIT
- Allows business use
- Downloads for
- Mac
- From the latest release
- Latest version
- v0.26.0
- Released 5 days ago
- Built with
- Python
- 88% of the code
Is it looked after?
- Contributors
- 13
- Last 90 days
- Issues
- 88% closed
- 73 still open
- Pull requests
- 1,931 merged
- 44 waiting
- Releases
- 68
- 13 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| jundot / omlx | 23,475 | 4 days ago | Apache-2.0 | Mac |
| dphnAI / sonar | 1,906 | yesterday | AGPL-3.0 | Mac, Linux |
| thushan / olla | 337 | 8 days ago | Apache-2.0 | Mac, Windows, Linux |
More: download files, languages, topics and project record
Languages
- Python 88%
- Shell 7%
- Perl 2%
- Dockerfile 1%
Topics
- ai
- containers
- cuda
- hip
- inference-server
- intel
- llamacpp
- llm
- podman
- vllm
- hacktoberfest
Project record
- JobLocal LLMs
- StatusListed
- Commits4,648
- Forks388
- Watching33
- Stars in 28 days+34
- CreatedJul 24, 2024
- First seen by usNov 7, 2026
- CheckedNov 9, 2026