Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Shannon Entropy and Information Gain

Serrano.Academy via YouTube

Overview

Explore the concepts of Shannon Entropy and Information Gain in this 21-minute video from Serrano.Academy. Dive into probability theory and information theory through engaging examples, including ball-picking scenarios and games. Learn how to calculate probabilities, work with products, and handle multiple classes. Examine different sequences and compare naive approaches with more sophisticated methods. Gain a comprehensive understanding of these fundamental concepts in machine learning and data science, culminating in the general formula for Shannon Entropy and Information Gain.

Syllabus

Shannon Entropy and Information Gain
What ball will we pick?
Quiz
Question
Game
Probability of Winning
Products
What if there are more classes?
Sequence 2
Sequence 3
Naive Approach
Sequence 1
General Formula

Taught by

Serrano.Academy

Reviews

Start your review of Shannon Entropy and Information Gain

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.