entropy
Entropy and Information Gain
Entropy: Entropy is used in the field of machine learning to measure the amount of uncertainty or randomness in a set of data and its usefulness in the decision-making process. In other words, entropy measures the impurity in a dataset. The higher the entropy value, the more impure the data.