Survey Basic Terms

Alphabet []

An ordered set of symbols that can be sorted.

Code []

Specification that describes the relation between different set of symbols.

Coding []

Procedures applying a code.

Entropy []

Quantitative measure for information of an information source and required average code length.

Entropy Coding []

Procedure for coding of symbols with variable code length anti-proportionally to the probability of their occurrence.

Information []

Mathematical or technical measure for information.

Information Theory []

Theory to describe information as a mathematical or technical measure, founded by Claude Shannon.

Irrelevance Reduction []

Reduction of data volume by eliminating irrelevant parts of the contents.

Message []

The term message in information theory.

Probability []

Probabilities for messages or symbols provided by an information source.

Redundancy []

Part of data that does not contribute to information.

Redundancy Reduction []

Reduction of data volume by eliminating redundant parts of the contents.

Set of Symbols []

Total amount of symbols potentially used to create data.

Symbol []

Basic unit structuring data.

 <   ^   >