Graham Neubig Courses

Neural Nets for NLP 2017 - Convolutional Networks for Text

Comprehensive lecture on convolutional networks for text, covering bag-of-words, n-grams, applications, stacked and dilated convolutions, structured convolution, sentence pair modeling, and CNN visualization techniques.

• YouTube
• 1 hour 11 minutes
• On-Demand
• Free Video

Neural Nets for NLP - Class Introduction & Why Neural Nets?

Introduction to neural networks for NLP, covering tasks, challenges, and potential solutions. Explores basic concepts, algorithms, and implementations using examples like sentence classification and continuous bag of words models.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2017 - A Simple Exercise - Predicting the Next Word in a Sentence

Explore word prediction techniques, including skip-grams, CBOW, and advanced word vector methods. Learn to describe, count, predict, evaluate, and visualize word relationships in natural language processing.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

Neural Nets for NLP - Debugging Neural Nets

Learn techniques for identifying and resolving issues in neural networks for NLP, covering training and test-time problems, optimization strategies, and performance analysis.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

CMU Neural Nets for NLP - Distributional Semantics and Word Vectors

Explore distributional semantics and word vectors in NLP, covering techniques like skip-grams, CBOW, and advanced methods for creating and evaluating word embeddings.

• YouTube
• 1 hour 11 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2020 - Attention

Explore attention mechanisms in neural networks for NLP, covering types, improvements, and specialized varieties. Dive into the "Attention is All You Need" paper and its impact on the field.

• YouTube
• 1 hour 5 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2020: Conditioned Generation

Learn about encoder-decoder models, conditional generation, search techniques, and evaluation methods for neural networks in natural language processing.

• YouTube
• 1 hour 7 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2020 - Efficiency Tricks for Neural Nets

Efficiency techniques for neural networks in NLP, covering GPU training, parallel processing, and softmax approximations like negative sampling and hierarchical softmax.

• YouTube
• 1 hour 6 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2020 - Convolutional Neural Networks for Text

Comprehensive exploration of convolutional neural networks for text processing, covering key concepts, applications, and advanced techniques in natural language processing.

• YouTube
• 55 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2020 - Language Modeling, Efficiency/Training Tricks

Explore neural language models, optimization techniques, and evaluation metrics for NLP. Learn about feed-forward networks, overfitting prevention, and automatic optimization methods.

• YouTube
• 1 hour 19 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2019 - Advanced Search Algorithms

Explore advanced search algorithms for NLP, including beam search, A* search, and search with future costs. Learn techniques to improve efficiency and effectiveness in natural language processing tasks.

• YouTube
• 59 minutes
• On-Demand
• Free Video

Neural Nets for NLP - Multi-task, Multi-lingual Learning

Explore multi-task and multi-lingual learning in NLP, covering feature extraction, pre-training encoders, parameter adaptation, and structured prediction across languages.

• YouTube
• 57 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2019 - Models of Dialog

Learn about chat-based and task-based dialog models, covering generation, retrieval, and task completion approaches. Explore neural architectures, evaluation methods, and techniques for improving coherence and personality in dialog systems.

• YouTube
• 1 hour 5 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2019 - Document Level Models

Explore document-level NLP models, covering coreference resolution and discourse parsing techniques. Learn about entity representations, neural coreference, and hierarchical attention networks for discourse analysis.

• YouTube
• 51 minutes
• On-Demand
• Free Video

Neural Nets for NLP 2019 - Unsupervised and Semi-supervised Learning of Structure

Explore unsupervised and semi-supervised learning methods for NLP, covering feature and structure learning, design decisions, and practical examples in this advanced lecture.

• YouTube
• 1 hour 8 minutes
• On-Demand
• Free Video