Explore the far-reaching impacts of AI and its transformative role across various sectors in this Gradient Dissent podcast episode featuring Joseph Spisak, Product Director of Generative AI at Meta. Dive into the complexities of models like GPT and Llama2, examining their influence on user experiences and groundbreaking contributions to fields such as biology, material science, and green hydrogen production through the Open Catalyst Project. Gain insights into AI's practical business applications, from document summarization to intelligent note-taking, while addressing the ethical challenges of AI deployment. Learn about the importance of open-source AI development, community collaboration, and AI democratization. Discover valuable perspectives on the expansive world of AI, relevant to developers, business leaders, and tech enthusiasts, including discussions on model quality measurement, size selection, training techniques, safety mechanisms, multilingual capabilities, and real-world applications.
The Impact of Machine Learning on Material Innovation and Scientific Progress
Overview
Syllabus
Intro
Joe is Back at Meta
What Does Meta Get Out Of Putting Out LLMs?
Measuring The Quality Of LLMs
How Do You Pick The Sizes Of Models
Advice On Choosing Which Model To Start With
The Secret Sauce In The Training
What Is Being Worked On Now
The Safety Mechanisms In Llama 2
The Datasets Llama 2 Is Trained On
On Multilingual Capabilities & Tone
On The Biggest Applications Of Llama 2
On Why The Best Teams Are Built By Users
The Culture Differences Of Meta vs Open Source
The AI Learning Alliance
Where To Learn About Machine Learning
Why AI For Science Is Under-rated
What Are The Biggest Issues With Real-World Applications
Taught by
Weights & Biases
