Running Llama Models with PyTorch and KleidiAI on Arm Servers - A Step-by-Step Tutorial

Running Llama Models with PyTorch and KleidiAI on Arm Servers - A Step-by-Step Tutorial

Arm Software Developers via YouTube Direct link

Request access to the Meta Llama models

2 of 9

2 of 9

Request access to the Meta Llama models

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Running Llama Models with PyTorch and KleidiAI on Arm Servers - A Step-by-Step Tutorial

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Request access to the Meta Llama models
  3. 3 Create the Arm-based AWS EC2 instance
  4. 4 Update and install the required software
  5. 5 Download and quantize the Llama 3.1 model
  6. 6 Test that the model is working
  7. 7 Run the Torchchat backend and Streamlit frontend
  8. 8 Modify the Learning Path to run Llama 3.2
  9. 9 Outro

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.