Understanding ChatGPT: From Machine Learning to Language Models
John Savill's Technical Training via YouTube
Overview
Syllabus
- Introduction
- History and training
- Machine learning
- Prediction
- More complex predictions
- Making any shape with enough curves combined
- How to get different curves from one curve
- Weights and bias
- Activation functions
- Back propagation and gradient descent
- Visualization of layers working together
- What is GPT
- Attention
- Tokens
- GPT-2
- GPT-3
- zero, one and few shot
- What was it trained on
- ChatGPT
- Closing thoughts
Taught by
John Savill's Technical Training