sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐Ÿš€ AI Gateway (LiteLLM) ๐Ÿค– LLM Serving (vLLM, SGLang, Ollama) ๐Ÿ“Š Vector Databases, ๐Ÿ” Embedding Models (TEI) ๐Ÿ“ˆ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

GitHub

Official source

Start locally with the CLI guide

Back to catalog
My interests๋‚ด ๊ด€์‹ฌ ์ฃผ์ œ

Tools

Sort

Loading catalogโ€ฆ์นดํƒˆ๋กœ๊ทธ๋ฅผ ๋ถˆ๋Ÿฌ์˜ค๋Š” ์ค‘โ€ฆ