$$H[X] \equiv - \sum_{x \in \mathcal{X}} Pr(X=x) \log_2 Pr(X=x)$$