[BETA] Finetuning Transformer Models

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Grab it

Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.

* Understanding finetuning

* GPU use in deep learning

* Finetuning with Hugging Face

Syllabus

Finetuning Transformer Models: Learn the basics of finetuning transformer models as well as the techniques used to efficiently train large models on consumer hardware (PEFT).

Lesson: Finetuning Fundamentals
Lesson: Finetuning with LoRA and QLoRA
Quiz: Introduction to Finetuning Quiz

Finetuning with Hugging Face: Practice finetuning with Hugging Face libraries, performing a full finetune, LoRA, and QLoRA on a BERT sentiment classifier.

Lesson: Finetuning Transformers with Hugging Face
Quiz: Finetuning Transformers with Hugging Face
KanbanProject: Finetuning a Generative Language Model
Informational: Next Steps