Adventures in Building CLIP and Other Large Language Models

Overview

Dive into a captivating podcast episode featuring Sachin Abeywardana, Deep Learning Engineer at Canva AI, as he shares his adventures in building CLIP and other large language models. Explore insights on understanding broader product implications, incorporating AI and machine learning capabilities, and the challenges of balancing work and family life. Learn about AI models for grammar correction and code generation, the fascinating CLIP model, and Sachin's journey from completing a PhD in Bayesian Machine Learning to focusing on NLP problems. Gain valuable perspectives on leading ML engineers and teams, the importance of being practical with math, and the insufficient exploration of Transformers. Discover Sachin's thoughts on vector databases, recommendation systems, and the criticisms of current architecture limitations. This informative and thought-provoking discussion covers a wide range of topics in the field of machine learning and AI, offering valuable insights for both beginners and experienced practitioners.

Syllabus

[] Sachin's preferred beverage
[] Takeaways
[] Chat GPT user
[] Understanding on reliable Agents
[] Sachin's background
[] Staying at Deep Learning
[] Recommendation or Lead Scoring
[] Vector database
[] Sachin's blogs
[] The cap people
[] Pursuing business case
[] Canva
[] Incorporating AI and Machine Learning
[] Sponsor Ad
[] Eliminating unnecessary steps
[] Interacting with the product team
[] Criticisms on the current architecture limitations
[] Insufficient exploration of Transformers
[] Explaining GraphML
[] Fine-tuning ChatGPT2
[] Leading ML Engineers and teams
[] Being practical with Math
[] Wrap up