Calculation of Entropy

The entropy of an information source is only depending on the message's probability. It is required to know the probability of any possible message.

 <   ^   >