A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐ AI Gateway (LiteLLM) ๐ค LLM Serving (vLLM, SGLang, Ollama
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐ AI Gateway (LiteLLM) ๐ค LLM Serving (vLLM, SGLang, Ollama) ๐ Vector Databases, ๐ Embedding Models (TEI) ๐ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
Marketplace
Independent
Category
engineering
More like this
Browse engineering agents โ
Refrax
Command-Line Agentic Refactoring of Java Code
Free
engineeringOpencode Plan Manager
A simple collection of tools for better plan management by AI agents on OpenCode.
Free
engineeringRuby Sdk
The official Ruby SDK for the Model Context Protocol.
Free
engineeringTabnine
Privacy-first AI code completion for enterprise teams
$12/mo