maximhq / bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Why this job: says: llm gateway, ai gateway, openai compatible; topics: llm-gateway, ai-gateway, llm-proxy, api-gateway, llm-router, openai-compatible
What it does
- Unified Interface. Single OpenAI-compatible API for all providers
- Multi-Provider Support. OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cerebras, Cohere, Mistral, Ollama, Groq, and more
- Automatic Fallbacks. Seamless failover between providers and models with zero downtime
- Load Balancing. Intelligent request distribution across multiple API keys and providers
- Model Context Protocol (MCP). Enable AI models to use external tools (filesystem, web search, databases)
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 9,444
- +142 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest tag
- ent-v2.5.0-base
- Released 3 days ago
- Built with
- Go
- 78% of the code
Is it looked after?
- Contributors
- 10
- Last 90 days
- Issues
- 64% closed
- 624 still open
- Pull requests
- 6,194 merged
- 850 waiting
- Releases
- 1,000
- 30+ in the last year
- No contributing guide
- Security policy (opens in new tab)
- Code of conduct (opens in new tab)
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Portkey-AI / gateway | 13,348 | 5 months ago | MIT | No downloads |
| ferro-labs / ai-gateway | 284 | 10 days ago | Apache-2.0 | Mac, Windows, Linux |
| mozilla-ai / otari | 881 | yesterday | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Go 78%
- TypeScript 14%
- JavaScript 5%
- Python 2%
Topics
- gateway
- llm-gateway
- guardrails
- mcp-gateway
- ai-gateway
- llm-cost
- llm-observability
- load-balancing
- model-router
- agent-gateway
- ai-governance
- api-gateway
Project record
- JobModel gateways
- StatusFeatured
- Commits9,080
- Forks1,557
- Watching35
- Stars in 28 days+737
- CreatedMar 19, 2025
- First seen by usNov 7, 2026
- CheckedNov 9, 2026