Scaling Machine Learning Pipelines in Cloud

Explore scaling machine learning pipelines in the cloud with this NDC Oslo 2021 conference talk by Salman Iqbal. Learn how to overcome common hurdles in developing end-to-end data science and machine learning models that operate at scale and in real-time. Discover the benefits of using Kubeflow, an open-source Kubernetes-based platform that abstracts away non-machine learning tasks while retaining control. Understand how Kubeflow enables easy development of ML models, repeatable and portable deployments across diverse infrastructures, and scalable operations based on demand. Gain insights into current use cases of Kubeflow and how teams from various industries leverage cloud technology to scale their machine learning operations. The talk covers topics such as Docker, Kubernetes, scaling pipelines, GPU workers, experimenting with pipelines, and considerations for platform management. Ideal for data scientists, machine learning engineers, and professionals looking to optimize their ML workflows and infrastructure.