Data compression is a way to reduce or eliminate unwanted redundancy, while forward error correction is a way of adding desired redundancy for purposes of error detection and correction when communicating over a noisy channel of limited capacity.

- Redundancy (information theory)Lossless compression reduces bits by identifying and eliminating statistical redundancy.

- Data compression2 related topics

## Information theory

Scientific study of the quantification, storage, and communication of digital information.

Scientific study of the quantification, storage, and communication of digital information.

Important sub-fields of information theory include source coding, algorithmic complexity theory, algorithmic information theory and information-theoretic security.

the information entropy and redundancy of a source, and its relevance through the source coding theorem;

## Entropy (information theory)

Average level of "information", "surprise", or "uncertainty" inherent to the variable's possible outcomes.

Average level of "information", "surprise", or "uncertainty" inherent to the variable's possible outcomes.

Information theory is useful to calculate the smallest amount of information required to convey a message, as in data compression.

See also Redundancy (information theory).