Learn about optimizing AI data center operations through container technologies in this 21-minute conference talk from SK AI SUMMIT 2024. Explore how container technology provides essential flexibility, scalability, and rapid deployment for GPU servers in AI workloads. Discover Amazon EKS container hybrid solution portfolio including EKS, EKS Anywhere, and EKS Distro, along with the Data & GenAI on EKS reference framework for leveraging container technology in AI cloud operations. Gain insights into key architectural patterns for operational issues like observability, AI model deployment and serving scenarios, and infrastructure efficiency optimization using Karpenter. Presented by Young-rak Choi, an AWS Container Specialist who focuses on helping enterprises leverage container technology for business transformation through migration and modernization initiatives.
Overview
Syllabus
AI DC 운영 최적화를 위한 AWS 컨테이너 솔루션 및 사례 소개 | AWS 최영락
Taught by
SK AI SUMMIT 2024