Skip to content
The Daily Repo
Menu
Search repos

cuihuan / awesome-ai-gateway

⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

Why this job: name: awesome; says: handbook; topics: awesome-list, awesome

Open on GitHub (opens in new tab)Website (opens in new tab)
Decision tree: which AI gateway should you use? Hosted (OpenRouter, Vercel, Cloudflare, Bedrock, Azure, Vertex, Portkey) vs self-hosted open source (LiteLLM, Bifrost, new-api, one-api, GPT-Load, Kong, Higress, APISIX, Envoy AI Gateway, agentgateway), chosen by what you need.
How this list works, in four steps: pick by requirement (routing, cost, observability, compliance, supply-chain, caching, K8s, MCP/agents, fidelity), match the trust tier to your data, check evidence-based five-axis scores, and mind the 106x model cost spread ($0.03 vs $3.01 for the same 100K-token report).
1 of 2

What it does

  • Not Diamond. SOTA model-routing intelligence; powers OpenRouter's Auto router.
  • Martian. Pioneer commercial model router; Accenture partnership.
  • Inworld Router. One API for 200+ models with real-time complexity-based routing and 0% markup (pass-through pricing); adds first-party realtime inference for open models. Research preview.
  • RouteLLM ⭐ 5.7k. LMSYS's open router framework (research-grade; inactive since 2024 but still the canonical paper/code).
  • OpenRouter Auto. One model id (openrouter/auto) that routes per-prompt.

Get started

No single install command. Read the steps in the README (opens in new tab)

Maintenance
Active
Last commit yesterday
Stars
149
+3 this week
Licence
CC0-1.0
Read the terms
Downloads for
None listed
No release files
Latest version
v1.1.0
Released 4 months ago
Built with
HTML
50% of the code

Is it looked after?

Contributors
14
Last 90 days
Issues
81% closed
4 still open
Pull requests
33 merged
14 waiting
Releases
2
2 in the last year

Similar repos

Repos similar to this one
RepoStarsLast commitLicenceDownloads for
kyrolabs / awesome-langchain9,59123 days agoCC0-1.0No downloads
YuzeHao2023 / Awesome-MCP-Servers1,0863 months agoApache-2.0No downloads
InftyAI / Awesome-LLMOps271yesterdayApache-2.0No downloads
More: languages, topics and project record

Languages

  • HTML 50%
  • Python 49%
  • JavaScript 1%
  • Shell <1%

Topics

  • ai-gateway
  • ai-infrastructure
  • api-gateway
  • awesome
  • awesome-list
  • litellm
  • llm
  • llm-gateway
  • llm-proxy
  • llm-router
  • llmops
  • mcp

Project record

  • JobLists and guides
  • StatusListed
  • Commits532
  • Forks143
  • Watching1
  • Stars in 28 days+20
  • CreatedJun 11, 2026
  • First seen by usNov 7, 2026
  • CheckedNov 9, 2026

Type to search.

Try