Completed
Introduction
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Pre-Training BERT from Scratch for Domain-Specific Knowledge Using PyTorch - Part 51
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 Downloading data sets
- 3 Tokenization
- 4 Tokenizer
- 5 Fast implementation
- 6 Fast tokenizer
- 7 Encoding
- 8 Training Data Set
- 9 Bird Model
- 10 Bird Model Configuration
- 11 Bird Model Pretraining
- 12 Masking Task
- 13 Training Arguments
- 14 Training Example
- 15 Training Results
- 16 Training Loss
- 17 Expert Model
