Completed
- Loading Llama-2 7B with 4bit quantization
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Running Gemma 2B and Llama-2 7B with Model Quantization - A Hands-on Lab
Automatically move to the next video in the Classroom when playback concludes
- 1 - Resources to build your own LLM from scratch
- 2 - Determining hardware requirements to run LLMs
- 3 - Loading Gemma 2B
- 4 - Prompting Gemma 2B completion, zero shot, one-shot
- 5 - Loading and using the instruction tuned version of Gemma 2B chat formatters
- 6 - Model quantization 16bit, 8bit, 4bit
- 7 - Loading Llama-2 7B with 4bit quantization
- 8 - RunningLlama 2 7B Chat
