Entropy EntropyConditional entropyEntropy H(X)=−∑knpk,log2(pk)H(X) = -\displaystyle\sum_{k}^{n} p_k \\, log_2(p_k) H(X)=−k∑npk,log2(pk) Conditional entropy Calculate conditional probabilities Calculate entropies of value of Y Calculate conditional entropy HY(X)=∑knHY=y(X),pkH_Y(X) = \displaystyle\sum_{k}^{n} H_{Y = y}(X) \\, p_k HY(X)=k∑nHY=y(X),pk