Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Delft University of Technology

AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning

Delft University of Technology via edX

Overview

In this course you will learn the basics of several machine learning topics to help you solve real life challenges. Unsupervised learning techniques such as clustering and dimensionality reduction are useful to make sense of large and/or high dimensional datasets that are not annotated. Deep learning is a supervised learning technique that is useful to train neural networks to solve more complicated classification and regression tasks. Finally, reinforcement learning techniques can be used to train AI agents that interact with an environment.

Using hands-on and interactive exercises you will get insight into the fundamental algorithms and basic concepts of:

Clustering is used to identify similar data/objects and patterns from your engineering datasets. It is a technique that is especially useful if you don’t have labeled or annotated data. We explain various approaches to clustering and cover how similarity and dissimilarity measures are used.

Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset. We discuss feature selection and feature extraction techniques such as Principal Component Analysis (PCA), and how and when to apply it.

Deep Learning is a family of machine learning methods based on artificial neural networks. You will learn how to build and train deep neural networks consisting of fully connected neural networks of multiple hidden layers.

Reinforcement learning teaches an AI to interact with an environment. We cover basic reinforcement learning concepts and techniques, such as how to model the system using a Markov Decision Process, and how to train an optimal policy using tabular Q-learning using the Bellman equation.

This course is designed by a team of TU Delft machine learning experts from various backgrounds, highlighting the various topics from their individual perspectives.

Syllabus

Topic 1: Introduction

This is an introduction to the course with an overview of the topics.

Topic 2: Clustering

Clustering techniques are used to identify similar data/objects and patterns from your engineering datasets.

You will learn about the problem of clustering, the main classes of clustering techniques and how we can implement k-means and hierarchical clustering.

• Introduction to clustering

• Formalizing the problem of clustering

• Similarity and dissimilarity measures

• k-means clustering

• Hierarchical clustering

Topic 3: Dimensionality Reduction

Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset as much as possible.

You will learn what dimensionality reduction is, why it is needed and how to use it. You will learn about Principal Component Analysis dimensionality reduction technique and how and when to apply it.

• What is dimensionality reduction?

• Why dimensionality reduction techniques are used

• Feature selection vs. feature extraction techniques

• Principal component analysis feature-extraction technique

Topic 4: Introduction to Deep Learning

Deep learning is a broader family of machine learning methods based on artificial neural networks.

You will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about fully connected neural networks, some theoretical aspects of deep learning, the back-propagation algorithm, Adam, and much more.

• What neural networks are

• Architecture of fully connected neural networks

• Capabilities of neural networks

• The benefits of deep architectures

• Training deep neural networks with stochastic gradient descent and Adam

Topic 5: Introduction to Reinforcement Learning

Reinforcement learning teaches an AI to interact with an environment.

You will be introduced to basic reinforcement learning concepts and techniques, and how they could be applied in real world applications.

• How an AI interacts with the environmen

• The formalization of this as a Markov Decision Process

• An agent’s behavior as a policy

• The optimal policy found using tabular Q-learning

• Why tabular reinforcement learning does not scale well

• Neural networks for deep reinforcement learning to scale up to interesting applications

Taught by

Hongrui Wang, Amira Elnouty, Luca Laurenti, Wendelin Böhmer and Tom Viering

Reviews

Start your review of AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.