aws-samples / sample-genai-on-eks-starter-kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
Why this job: topics: llm-inference, vllm, llm-serving
What it does
A production-ready starter kit for deploying generative AI infrastructure on Amazon EKS (Elastic Kubernetes Service). Deploy LLM serving engines (vLLM, SGLang, TGI), AI gateways, vector databases, GPU-accelerated inference platforms, and AI agent frameworks on Kubernetes with a single CLI command. Built for teams running self-hosted LLMs and AI workloads on AWS.
Get started
npm installYou need: Terraform; Docker and Buildx
- Maintenance
- Active
- Last commit 26 days ago
- Stars
- 100
- +1 this week
- Licence
- MIT-0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.1.3
- Released 2 months ago
- Built with
- JavaScript
- 49% of the code
Is it looked after?
- Contributors
- 10
- Last 90 days
- Issues
- 61% closed
- 18 still open
- Pull requests
- 127 merged
- 16 waiting
- Releases
- 7
- 6 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| liguodongiot / llm-action | 25,268 | 27 days ago | Apache-2.0 | No downloads |
| vllm-project / vllm-ascend | 3,064 | yesterday | Apache-2.0 | No downloads |
| matrixhub-ai / matrixhub | 366 | 6 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- JavaScript 49%
- Python 19%
- HCL 19%
- Shell 6%
Topics
- agentic-ai
- ai-engineering
- ai-platform
- kubernetes
- llm-inference
- llmops
- ai-agents
- ai-gateway
- amazon-eks
- aws
- generative-ai
- gpu-inference
Project record
- JobLocal LLMs
- StatusListed
- Commits303
- Forks63
- Watching3
- Stars in 28 days+5
- CreatedJul 4, 2025
- First seen by usNov 7, 2026
- CheckedNov 10, 2026