Overview
Learn about Shannon Entropy, a key information theory metric for quantifying information in sequences, in this 23-minute video tutorial. Explore the concept of information, delve into the Shannon Entropy formula, and follow along with a Python implementation. Discover how to objectively compare datasets for information richness and apply this knowledge to various fields. Gain practical insights through a code walkthrough and access supplementary resources, including a blog post and GitHub repository with the complete code.
Syllabus
⦾ Introduction:
⦾ What is Information?:
⦾ Shannon Entropy Formula:
⦾ Code Walkthrough:
⦾ Conclusion:
Taught by
Yacine Mahdid