nekomeowww / ollama-operator
🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
Why this job: topics: llamacpp, ollama, llama
What it does
- Abilities to run multiple models on the same cluster.
- Compatible with all Ollama models, APIs, and CLI.
- Able to run on general Kubernetes clusters, K3s clusters (Respberry Pi, TrueNAS SCALE, etc.), kind, minikube, etc. You name it!
- Easy to install, uninstall, and upgrade.
- Pull image once, share across the entire node (just like normal images).
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Inactive
- Last commit 7 months ago
- Stars
- 242
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- v0.10.10
- Released 12 months ago
- Built with
- Go
- 90% of the code
Is it looked after?
- Contributors
- 0
- Last 90 days
- Issues
- 54% closed
- 12 still open
- Pull requests
- 115 merged
- 14 waiting
- Releases
- 22
- 0 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| ngxson / wllama | 1,386 | 4 days ago | MIT | No downloads |
| pythops / tenere | 687 | 6 months ago | GPL-3.0 | Mac, Windows, Linux |
| awaescher / OllamaSharp | 1,415 | yesterday | MIT | No downloads |
More: download files, languages, topics and project record
Download files, v0.10.10
- Mac2 files, 29 downloads
- Windows3 files, 2,036 downloads
- Linux3 files, 59 downloads
Languages
- Go 90%
- Makefile 9%
- Dockerfile 1%
Topics
- ai
- kubernetes
- kubernetes-operators
- llama
- llamacpp
- llm
- ollama
Project record
- JobLocal LLMs
- StatusListed
- Commits211
- Forks28
- Watching3
- Stars in 28 days0
- CreatedApr 10, 2024
- First seen by usNov 7, 2026
- CheckedNov 12, 2026