Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Natural Language Processing Evolution: From Word2Vec and RNNs to GPT - 50 Key Concepts

Neural Breakdown with AVB via YouTube

Overview

Explore a comprehensive 18-minute video journey through a decade of Natural Language Processing (NLP) evolution, examining 50 fundamental concepts from basic language modeling to cutting-edge large language models. Learn about the progression from early techniques like Word2Vec and Recurrent Neural Networks (RNNs) to advanced architectures including Transformers, BERT, and GPT-4. Understand key developments in tokenization, word embeddings, sequence-to-sequence models, attention mechanisms, and the latest innovations in human-aligned AI systems. Discover the challenges faced by previous architectures and how modern solutions address them, with detailed explanations supported by academic references and research papers. Divided into five focused chapters, the content progresses chronologically through NLP advancements, covering language modeling basics, encoder-decoder architectures, transformer models, large language models, and recent developments in human-AI alignment.

Syllabus

- Intro
- Basics of Language Modelling
- RNNs, Seq2Seq, Encoder-Decoders
- Understanding Transformers
- LLMs - BERT, GPT, XLNet, T5
- Human Alignment, ChatGPT, GPT4
- Outro

Taught by

Neural Breakdown with AVB

Reviews

Start your review of Natural Language Processing Evolution: From Word2Vec and RNNs to GPT - 50 Key Concepts

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.