Imbue - Training a 70B Model from Scratch - Infrastructure and Challenges

Imbue - Training a 70B Model from Scratch - Infrastructure and Challenges

Aleksa Gordić - The AI Epiphany via YouTube Direct link

00:45 - Hyperstack GPUs sponsored

2 of 7

2 of 7

00:45 - Hyperstack GPUs sponsored

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Imbue - Training a 70B Model from Scratch - Infrastructure and Challenges

Automatically move to the next video in the Classroom when playback concludes

  1. 1 00:00 - Intro
  2. 2 00:45 - Hyperstack GPUs sponsored
  3. 3 02:25 - Bowei's background
  4. 4 11:30 - More on Imbue, their research, their focus
  5. 5 18:30 - Training a 70B model
  6. 6 26:20 - Building a cluster from scratch
  7. 7 45:40 - Anecdotes, Q&A

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.