voidmind-io / voidllm
Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Why this job: says: ai gateway, llm proxy; topics: llm-gateway, ai-gateway, llm-proxy, api-gateway
What it does
VoidLLM is a self-hosted LLM proxy that sits between your applications and LLM providers - OpenAI, Anthropic, Azure, Ollama, vLLM, or any custom endpoint. It gives you organization-wide access control, API key management, usage tracking, rate limiting, and multi-deployment load balancing. One Go binary, sub-2ms proxy overhead, zero knowledge of your prompts.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 24 days ago
- Stars
- 147
- +1 this week
- Licence
- Custom
- Read before business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- v0.0.30
- Released 41 days ago
- Built with
- Go
- 89% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 86% closed
- 5 still open
- Pull requests
- 126 merged
- 20 waiting
- Releases
- 53
- 30+ in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Kong / kong | 44,369 | 22 days ago | Apache-2.0 | No downloads |
| eliasbiondo / antirion | 455 | 12 days ago | Apache-2.0 | Linux |
| BerriAI / litellm | 62,998 | today | Custom | No downloads |
More: download files, languages, topics and project record
Download files, v0.0.30
- Mac2 files, 15 downloads
- Windows2 files, 44 downloads
- Linux2 files, 29 downloads
Languages
- Go 89%
- TypeScript 11%
- Go Template <1%
- Dockerfile <1%
Topics
- ai
- ai-gateway
- anthropic
- api-gateway
- docker
- golang
- helm
- kubernetes
- llm
- llm-gateway
- llm-proxy
- ollama
Project record
- JobModel gateways
- StatusListed
- Commits207
- Forks15
- Watching1
- Stars in 28 days+7
- CreatedMar 17, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026