Completed
Limitations of LoReFT and LoRA fine-tuning
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Very Few Parameter Fine-Tuning with ReFT and LoRA
Automatically move to the next video in the Classroom when playback concludes
- 1 ReFT and LoRA Fine-tuning with few parameters
- 2 Video Overview
- 3 Transformer Architecture Review
- 4 Weight fine-tuning with LoRA
- 5 Representation Fine-tuning ReFT
- 6 Comparing LoRA with ReFT
- 7 Fine-tuning GPU setup
- 8 LoRA Fine-tuning walk-through
- 9 ReFT fine-tuning walk through
- 10 Combining ReFT fine-tunes
- 11 Orthogonality and combining fine-tunes
- 12 Limitations of LoReFT and LoRA fine-tuning
- 13 Fine-tuning tips
