From Chaos to Harmony - Transforming ML Engineering Through Kubernetes Adoption

Learn about a transformative journey in machine learning engineering through this 24-minute conference talk that explores how Ekstra Bladet's Data Science team evolved from a small group of ML engineers to a sophisticated ML ecosystem. Discover the challenges faced with an initial rigid AWS-based pipeline and complex Infrastructure as Code project, and understand the strategic decision to adopt Kubernetes as a container infrastructure solution. Follow the team's progression in building robust frameworks for ML model training and deployment, implementing GitOps principles, and leveraging advanced techniques like autoscaling, scheduling, event triggers, and dynamic service deployment. Gain insights into how this transformation enabled the team to serve multiple stakeholders across JP/Politikens Hus organization while maintaining operational agility and scalability.