Black Friday 2024: 25+ Ways to Save on Online Learning
Local LLM Fine-tuning on Mac (M1 16GB) Using QLoRA and MLX

Local LLM Fine-tuning on Mac (M1 16GB) Using QLoRA and MLX

Shaw Talebi via YouTube Direct link

GitHub Repo -

4 of 12
Previous
Next

4 of 12

GitHub Repo -

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Local LLM Fine-tuning on Mac (M1 16GB) Using QLoRA and MLX

Automatically move to the next video in the Classroom when playback concludes
  1. 1 Intro -
  2. 2 Motivation -
  3. 3 MLX -
  4. 4 GitHub Repo -
  5. 5 Setting up environment -
  6. 6 Example Code -
  7. 7 Inference with un-finetuned model -
  8. 8 Fine-tuning with QLoRA -
  9. 9 Aside: dataset formatting -
  10. 10 Running local training -
  11. 11 Inference with finetuned model -
  12. 12 Note on LoRA rank -

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.