Dive into an insightful interview with Hailey Schoelkopf from EleutherAI, exploring her journey and contributions to cutting-edge AI projects. Learn about the Pythia project, the potential applications of open-data and open-weights language models, and the development of research infrastructure. Discover the Llemma project, which focuses on open-weights mathematics base models, and gain insights into the LM-Eval-Harness tool. Engage with a comprehensive Q&A session covering various aspects of AI research and development in this hour-long discussion.
EleutherAI Pythia and Open-Source Language Models - Interview with Hailey Schoelkopf
Aleksa Gordić - The AI Epiphany via YouTube
Overview
Syllabus
Hailey's story
Pythia
What can you do with open-data, weights LMs?
Research infra
Llemma: open-weights mathematics base models
LM-Eval-Harness
Q&A
Taught by
Aleksa Gordić - The AI Epiphany
