Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Codecademy

[BETA] Finetuning Transformer Models

via Codecademy

Overview

Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.


* Understanding finetuning

* GPU use in deep learning

* Finetuning with Hugging Face

Syllabus

  • Finetuning Transformer Models: Learn the basics of finetuning transformer models as well as the techniques used to efficiently train large models on consumer hardware (PEFT).
    • Lesson: Finetuning Fundamentals
    • Lesson: Finetuning with LoRA and QLoRA
    • Quiz: Introduction to Finetuning Quiz
  • Finetuning with Hugging Face: Practice finetuning with Hugging Face libraries, performing a full finetune, LoRA, and QLoRA on a BERT sentiment classifier.
    • Lesson: Finetuning Transformers with Hugging Face
    • Quiz: Finetuning Transformers with Hugging Face
    • KanbanProject: Finetuning a Generative Language Model
    • Informational: Next Steps

Taught by

Kenny Lin

Reviews

Start your review of [BETA] Finetuning Transformer Models

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.