Lessons from Scaling AI-Powered Translation Services Using Istio

Explore the journey of scaling AI-powered translation services using Istio in this informative conference talk. Discover how Lilt, a global AI solution for enterprise translation and localization, addressed architectural challenges while handling large translation workloads for customers like Intel. Learn about the transition from a monolithic application server to a microservices-oriented architecture using Kubernetes and Istio. Gain insights into the organizational strategies for implementing these changes, and delve into the technical details of leveraging Istio's observability, Ingress Gateway, and External Authorization functionality. Understand the benefits of gradual architectural changes in improving system stability and increasing product velocity. Finally, get a glimpse of future plans for optimizing Istio usage and adopting more platform features in this 18-minute presentation by Tim Gallant from Lilt and Malini Bhandaru from Intel.