Adventures in Building CLIP and Other Large Language Models

Dive into a captivating podcast episode featuring Sachin Abeywardana, Deep Learning Engineer at Canva AI, as he shares his adventures in building CLIP and other large language models. Explore insights on understanding broader product implications, incorporating AI and machine learning capabilities, and the challenges of balancing work and family life. Learn about AI models for grammar correction and code generation, the fascinating CLIP model, and Sachin's journey from completing a PhD in Bayesian Machine Learning to focusing on NLP problems. Gain valuable perspectives on leading ML engineers and teams, the importance of being practical with math, and the insufficient exploration of Transformers. Discover Sachin's thoughts on vector databases, recommendation systems, and the criticisms of current architecture limitations. This informative and thought-provoking discussion covers a wide range of topics in the field of machine learning and AI, offering valuable insights for both beginners and experienced practitioners.