Successes and Challenges in Neural Models for Speech and Language - Michael Collins
Institute for Advanced Study via YouTube
Overview
Syllabus
Intro
Problems in Speech and Natural Language
The First (Statistical) Revolution
The Second (Neural) Revolution
A Personal View: the Parsing Problem
Kernel Methods
Word Embeddings
Natural Language Syntax, and the Parsing Problem
Shift Actions
Predicting Actions
The Natural Questions Data
Transformers (continued)
Multi-Head Transformers
This Talk: Three Problems, Three Architectures
Taught by
Institute for Advanced Study