Search 6,000+ CA Community College Courses
Making LLMs from Transformers - BERT and Encoder-based Models - Part 1

Making LLMs from Transformers - BERT and Encoder-based Models - Part 1

Donato Capitella via YouTube Direct link

- - Weight Update Strategies for Fine-tuning

6 of 9
Previous
Next

6 of 9

- - Weight Update Strategies for Fine-tuning

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Making LLMs from Transformers - BERT and Encoder-based Models - Part 1

Automatically move to the next video in the Classroom when playback concludes
  1. 1 - - Transformers Recap
  2. 2 - - Encoder vs Decoder
  3. 3 - - Pre-Training and Fine-tuning
  4. 4 - - BERT Pre-Training MLM, NSP
  5. 5 - - BERT Fine-tuning
  6. 6 - - Weight Update Strategies for Fine-tuning
  7. 7 - - BERT-based Models RoBERTa, DilstilBERT, AlBERT
  8. 8 - - LLM Benchmarks GLUE, SQuAD, MMLU, ...
  9. 9 - - Summary

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.