Article Source

• Entropy & Mutual Information in Machine Learning

Entropy & Mutual Information in Machine Learning

Abstract

Introducing the concepts of Entropy and Mutual Information, their estimation with the binning approach, and their use in Machine Learning for feature selection.