Creating Our Own Kubernetes and Docker to Run Data Infrastructure

Explore how Modal achieves rapid deployment of large-scale containers in this 33-minute conference talk by Erik Bernhardsson, founder and CEO of Modal. Dive into the technical details of Modal's custom-built infrastructure, including a Rust-written file system, proprietary container runtime, and container image builder. Gain insights into the inner workings of containers and underlying Linux mechanisms. Examine why traditional infrastructure tools can hinder data teams and learn about the need for faster, more efficient solutions. Benefit from Bernhardsson's extensive experience in data infrastructure, drawing from his roles as CTO at Better and his seven-year tenure at Spotify developing music recommendation systems and leading data teams.