This course extends our existing background in Deep Learning to state of the art techniques in audio, image and text modeling. We'll see how dilated convolutions can be used to model long term temporal dependencies efficiently using a model called WaveNet. We'll also see how to inspect the representations in deep networks using a deep generator network, leading to some of the strongest insights into deep networks and the representations they learn. We'll then switch gears to one of the most exciting directions in Deep Learning thus far: Reinforcement Learning. We'll take a brief tour of this fascinating topic and explore toolkits released by OpenAI, DeepMind, and Microsoft. Finally, we're teaming up with Google Brain's Magenta Lab for our last session on Music and Art Generation. We'll explore Magenta's libraries using RNNs and Reinforcement Learning to create generative and improvised music.
Overview
Syllabus
Session 1: WaveNet, Generative Audio
This session covers new work in generative modeling of images, sound, and text using masked and dilated convolution operations. We describe what these are and how they can be used to model various media types very efficiently. Session 2: Conditional Deep Generator Networks
This session covers an advanced technique for synthesizing objects resembling deep dream techniques. We show how this can be used to much more clearly understand the representations in deep networks. Session 3: Sketch To Photo, Neural Doodle
This session introduces one of the most advanced techniques in texture synthesis and artistic stylization called Neural Doodle. Session 4: To Be Determined
TBD
This session covers new work in generative modeling of images, sound, and text using masked and dilated convolution operations. We describe what these are and how they can be used to model various media types very efficiently. Session 2: Conditional Deep Generator Networks
This session covers an advanced technique for synthesizing objects resembling deep dream techniques. We show how this can be used to much more clearly understand the representations in deep networks. Session 3: Sketch To Photo, Neural Doodle
This session introduces one of the most advanced techniques in texture synthesis and artistic stylization called Neural Doodle. Session 4: To Be Determined
TBD
Taught by
Parag Mital
Related Courses
-
Creative Applications of Deep Learning with TensorFlow
4.7 -
Creative Applications of Deep Learning with TensorFlow II
4.7 -
Advanced Neural Network Techniques
-
Deep Learning with Keras and Tensorflow
-
AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning
-
Advanced Machine Learning and Deep Learning
Related articles
Reviews
5.0 rating, based on 1 Class Central review
-
This course lets you explore things like audio synthesis, music generation and natural language processing using the Tensorflow skills learned in the previous two courses. It is very open-ended. Parag and the Google Magenta team give some great overviews and then set you free to explore each space further. Highly recommended!
