(i) | \begin{equation} \forall \, x \in \mathcal{X} : p(x ) : = \mathbb{P}(X = x) \end{equation} |
(ii) | \begin{equation} \forall \, y \in \mathcal{Y} : p(y) : = \mathbb{P}(Y = y) \end{equation} |
(iii) | \begin{equation} \forall \, x \in \mathcal{X}, y \in \mathcal{Y} : p(x, y) : = \mathbb{P}(X = x, Y = y) \end{equation} |
The mutual information of $(X, Y)$ in base $a$ is the D4767: Unsigned real number \begin{equation} I(X; Y) : = \sum_{x \in \mathcal{X}} \sum_{y \in \mathcal{Y}} p(x, y) \log_a \frac{p(x, y)}{p(x) p(y)} \end{equation}