Using Docker Images in Production - Databricks Case Study

Explore the evolution of deploying production environments using Docker images in this 25-minute talk from Databricks. Learn how Condé Nast, a global media leader, transformed their user segmentation and targeted advertising service, Spire, from databricks notebooks to containerized solutions. Discover the process of packaging entire production environments into Docker images for deployment on Databricks clusters. Gain insights into streamlining deployment workflows, overcoming growing pains, and effectively managing challenges. Delve into topics such as base image selection, GitHub package integration, CICD pipeline implementation, automation techniques, debugging strategies, Docker version compatibility, package management, image size optimization, Docker caches utilization, security considerations, and data handling. Understand the pros and cons of this approach and how it can enhance your own deployment processes.