Dive into a comprehensive 36-minute video explanation of Transformer Neural Networks, the foundation of cutting-edge AI technologies like ChatGPT and Google Translate. Learn about word embedding, positional encoding, self-attention mechanisms, and the encoder-decoder architecture. Explore how Transformers are designed for parallel computing and understand the decoding process. Gain insights into additional components that can enhance Transformer performance. Supplementary links are provided for deeper understanding of related concepts such as backpropagation, SoftMax function, and cosine similarity.
Transformer Neural Networks, ChatGPT's Foundation, Clearly Explained
StatQuest with Josh Starmer via YouTube
Overview
Syllabus
Awesome song and introduction
Word Embedding
Positional Encoding
Self-Attention
Encoder and Decoder defined
Decoder Word Embedding
Decoder Positional Encoding
Transformers were designed for parallel computing
Decoder Self-Attention
Encoder-Decoder Attention
Decoding numbers into words
Decoding the second token
Extra stuff you can add to a Transformer
Taught by
StatQuest with Josh Starmer
Related Courses
-
Generative AI Language Modeling with Transformers
-
Decoder-Only Transformers, ChatGPT's Specific Transformer, Clearly Explained
-
Deep Dive into the Transformer Encoder Architecture
-
Sequence Models
4.8 -
Self - Cross, Hard - Soft Attention and the Transformer
-
Transformer Models: Understanding Their Architecture and Functionality - Part 3
