Repetition, concepts and rules, particularly Grammar, are sources of redundancy in a message.
What are some examples of redundancy? A classic is repetition. In the following messageá
(Please view the example here in the graphic version)
What do you think the fifth letter is? There is not much information in that line but it is easily decoded as "A," thanks to the high factor of redundancy (repetition). On the other hand, what is the fifth letter in this line?
(Please view the example here in the graphic version)
It's not as easy, but there is more to gain in the line.
Another source of redundancy are rules. Try this oneá
(Please view the example here in the graphic version)
One important source of rules is GRAMMAR. Try this sentence:
You probably easily guessed the first word was "The." But think of all the three letter words you know. You ignored most of them because you know the rule in English..a word before the noun is usually a determiner.