Fine-tuning Optimizations - DoRA, NEFT, LoRA+, and Unsloth

Fine-tuning Optimizations - DoRA, NEFT, LoRA+, and Unsloth

Trelis Research via YouTube Direct link

NEFT - Adding Noise to Embeddings

5 of 14

5 of 14

NEFT - Adding Noise to Embeddings

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Fine-tuning Optimizations - DoRA, NEFT, LoRA+, and Unsloth

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Improving on LoRA
  2. 2 Video Overview
  3. 3 How does LoRA work?
  4. 4 Understanding DoRA
  5. 5 NEFT - Adding Noise to Embeddings
  6. 6 LoRA Plus
  7. 7 Unsloth for fine-tuning speedups
  8. 8 Comparing LoRA+, Unsloth, DoRA, NEFT
  9. 9 Notebook Setup and LoRA
  10. 10 DoRA Notebook Walk-through
  11. 11 NEFT Notebook Example
  12. 12 LoRA Plus
  13. 13 Unsloth
  14. 14 Final Recommendation

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.