BerriAI / litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Why this job: says: ai gateway; topics: llm-gateway, ai-gateway
What it does
- AI Gateway (Proxy Server)
- AI Gateway (Proxy Server)
- Python SDK. A2A Protocol
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 62,998
- +429 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.108.4
- Released yesterday
- Built with
- Python
- 84% of the code
Is it looked after?
- Contributors
- 22
- Last 90 days
- Issues
- 89% closed
- 1,492 still open
- Pull requests
- 20,525 merged
- 3,603 waiting
- Releases
- 1,000
- 30+ in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Portkey-AI / gateway | 13,354 | 5 months ago | MIT | No downloads |
| LianjiaTech / bella-openapi | 241 | 11 days ago | MIT | No downloads |
| Kong / kong | 44,369 | 22 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 84%
- TypeScript 10%
- Rust 4%
- HTML 1%
Topics
- anthropic
- langchain
- llm
- llmops
- openai
- ai-gateway
- azure-openai
- bedrock
- gateway
- openai-proxy
- vertex-ai
- llm-gateway
Project record
- JobModel gateways
- StatusListed
- Commits56,223
- Forks13,175
- Watching237
- Stars in 28 days+1,865
- CreatedJul 27, 2023
- First seen by usNov 7, 2026
- CheckedNov 10, 2026