Fine-Tuning LLM with QLoRA on Single GPU - Training Falcon-7b on ChatBot Support FAQ Dataset

Fine-Tuning LLM with QLoRA on Single GPU - Training Falcon-7b on ChatBot Support FAQ Dataset

Venelin Valkov via YouTube Direct link

- Conclusion

13 of 13

13 of 13

- Conclusion

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Fine-Tuning LLM with QLoRA on Single GPU - Training Falcon-7b on ChatBot Support FAQ Dataset

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Introduction
  2. 2 - Text Tutorial on MLExpert.io
  3. 3 - Falcon LLM
  4. 4 - Google Colab Setup
  5. 5 - Dataset
  6. 6 - Load Falcon 7b and QLoRA Adapter
  7. 7 - Try the Model Before Training
  8. 8 - HuggingFace Dataset
  9. 9 - Training
  10. 10 - Save the Trained Model
  11. 11 - Load the Trained Model
  12. 12 - Evaluation
  13. 13 - Conclusion

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.