Running Gemma 2B and Llama-2 7B with Model Quantization - A Hands-on Lab

Running Gemma 2B and Llama-2 7B with Model Quantization - A Hands-on Lab

Donato Capitella via YouTube Direct link

- Loading Gemma 2B

3 of 8

3 of 8

- Loading Gemma 2B

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Running Gemma 2B and Llama-2 7B with Model Quantization - A Hands-on Lab

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Resources to build your own LLM from scratch
  2. 2 - Determining hardware requirements to run LLMs
  3. 3 - Loading Gemma 2B
  4. 4 - Prompting Gemma 2B completion, zero shot, one-shot
  5. 5 - Loading and using the instruction tuned version of Gemma 2B chat formatters
  6. 6 - Model quantization 16bit, 8bit, 4bit
  7. 7 - Loading Llama-2 7B with 4bit quantization
  8. 8 - RunningLlama 2 7B Chat

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.