Completed
Phone recognition on the TIMIT benchmark Mohamed, Dahl, & Hinton,
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Deep Learning Applications by Rina Panigrahy
Automatically move to the next video in the Classroom when playback concludes
- 1 Statistical Physics Methods in Machine Learning
- 2 Deep Learning Applications
- 3 Tutorial: Deep Learning
- 4 Outline
- 5 Learning an unknown function
- 6 Learning an unknown function: like curve fitting
- 7 Learning a function: why?
- 8 Learning a function: How
- 9 Linear Regression: Line fitting
- 10 Minimize errorloss in prediction
- 11 Loss measures error in prediction
- 12 Gradient descent
- 13 Learning a function: Linear Regression x
- 14 Gradient update: BackPropagation.
- 15 Stochastic Gradient Descent: gradients over a few examples at a time.
- 16 Learning a function: Sigmoid, sign
- 17 Sigmoid, RELU
- 18 Logistic regression uses logloss
- 19 Deep Network. Allows rich representation Can express any function/circuit
- 20 Neurons
- 21 Network of Neurons
- 22 Hierarchical representation of Objects
- 23 Training w: SGD to Minimize loss
- 24 Backpropagation: Gradient Descent for one example
- 25 Softmax for multiclass output: just like max
- 26 Convergence of Gradient Descent for Model training
- 27 Applications
- 28 MNIST
- 29 Convolution and Pooling
- 30 Gradient-Based Learning Applied to Document Recognition
- 31 Goal
- 32 ImageNet
- 33 ILSVRC
- 34 Architecture
- 35 RELU Nonlinearity
- 36 96 Convolutional Kernels
- 37 Phone recognition on the TIMIT benchmark Mohamed, Dahl, & Hinton,
- 38 Word error rates from MSR, IBM, & Google Hinton et. al. IEEE signal Processing Magazine, Nov 2012
- 39 Speech recognition
- 40 RNN
- 41 Videos/tutorials on Deep learning applications
- 42 Theoretical Understanding? - Deep Learning
- 43 Nonconvex Optimization
- 44 Low rank Approximation
- 45 No local minima in linear networks [Kawaguchi, NIPS 16, Ge et al, ICML 17]
- 46 Deep Learning
- 47 Does well experimentally
- 48 With simplifications, our target functions f are...
- 49 Overview of Results
- 50 Q&A
