The Ultimate Multinomial distribution Dog Breeds Information Guide and Reference

In probability theory, the multinomial distribution is a generalization of the binomial distribution. The binomial distribution is the probability distribution of the number of "successes" in n independent Bernoulli trials, with the same probability of "success" on each trial. Instead of each trial resulting in "success" or "failure", imagine that each trial results in one of some fixed finite number k of possible outcomes, with probabilities p₁, ..., p_k, and there are n independent trials. In effect, it is the probability distribution of a random vector

$(X_1,\dots,X_k)$

satisfying the constraint

$\sum_{i=1}^k X_i=n.$

The probabilities are given by

$P(X_1=x_1,\dots,X_k=x_k)={n! \over x_1!\cdots x_k!}p_1^{x_1}\cdots p_k^{x_k}$

for non-negative integers x₁, ..., x_k, if

$\sum_{i=1}^k x_i=n,$

and 0 otherwise.

Each of the k components separately has a binomial distribution with parameters n and p_i, for the appropriate value of the subscript i, and, because of the constraint that the sum of the components is n, they are negatively correlated.

The expected value is

$\operatorname{E}(X_i) = n p_i.$

The covariance matrix is as follows. Each diagonal entry is the variance of a binomially distributed random variable, and is therefore

$\operatorname{var}(X_i)=np_i(1-p_i).$

The off-diagonal entries are the covariances. These are

$\operatorname{cov}(X_i,X_j)=-np_i p_j$

for i, j distinct. This is a k × k nonnegative-definite matrix of rank k − 1.

The Dirichlet distribution is the conjugate prior of the multinomial in Bayesian statistics.

Multinomial distribution

See also