Tell me more ×
Cognitive Sciences Stack Exchange is a question and answer site for practitioners, researchers, and students in cognitive science, psychology, neuroscience, and psychiatry. It's 100% free, no registration required.
up vote 5 down vote favorite
2

I read years ago in a pop science book that written and spoken language can be shown to have a high level of redundancy. The speculation was that this served to allow error correction because language is encountered in noisy environments and understanding has a high survival value. The figure I remember is that if 35% of the information remains an attentive listener or reader can still make out the message. This has become a cherished notion in my world view as an indicator that language and human endeavor contains complexity we are not consciously aware of.

I am looking for a knowledgeable confirmation of the idea that spoken or written language contains this redundancy. An impolite smack down due to unexamined confirmation bias is always welcome as well.

share|improve this question
1  
Our smack downs are always polite. ;) Interesting question. Do you recall the name of the popular text? – Chuck Sherrington Jan 29 at 5:35
I think it was called Rules of the Game. It was about self organizing systems. I have it buried in a box. Amazon has many books under that name, can't remember the authors name, couldn't find it. – timquinn Jan 29 at 6:27
It was "Laws of the Game : How the Principles of Nature Govern Chance" by Manfred Eigen and Ruthild Winkler. It is from 30 years ago, so the idea may have come from some other book I read at the time. – timquinn Jan 29 at 10:05
@timquinn Could you please add that extra relevant information into your question if it turns out to be the book you are talking about, also providing a link to it? Thank you. – Steven Jeuris♦ Jan 29 at 10:36
This relates to ambiguity in language (since redundancy often reduces ambiguity). Zipf suggested that the speaker wishes for an ambiguous language where they can use one sound to mean everything, and leave difficulty of disambiguation for the listener. The listener, on the other hand, wishes for a totally unambiguous language, so the difficulty of picking the right words is on the speaker, and the listener doesn't need to spend energy on disambiguation. I would expect redundancy to have similar driving forces. Here is the dual of your question. – Artem Kaznatcheev Feb 1 at 4:07
show 5 more comments

1 Answer

up vote 8 down vote accepted

It seems that for written English, the figure is 50%.

From pages 27 to 28 of The making of cognitive science: Essays in honor of George A. Miller (Cambridge: Cambridge University Press, 1988)

Estimates of redundancy. Shannon (1948, 1951) had himself estimated the redundancy of printed English to be about 50 percent. He had used a technique in which a subject was given a passage of text and then required to guess the next letter until the correct response (i.e., that corresponding to the original text) was given. Redundancy was calculated from the distribution of the numbers of guesses required. Garner and Carson (1960) [...] also estimated the redundancy of printed English to be about 50 percent. Newman and Gerstman (1952) [...] estimated redundancy to be 52 percent.

Uses of redundancy. [...] Chapanis (1954) and Miller and Friedman (1957) both showed that when text was mutilated by deleting different percentages of letters, subjects were able to restore the missing letters with a high degree of accuracy. Such restoration is possible because of redundancy, so these experiments showed that redundancy was useful to humans.

[...]

In summary, printed English is redundant, and thus constrained, both in letter sequences within words and in sequences of words themselves. This redundancy is known to humans, who can use it to reconstruct mutilated text and to recognize and learn words and sequences of words that reflect varying degrees of this constraint. [...]

From page 1086 of A new kind of science by Stephen Wolfram (Wolfram Media, Inc., 2002):

[...] English text typically remains intelligible until about half its characters have been deleted, indicating that it has a redundancy of around 0.5. Most other languages have slightly higher redundancies, making documents in those languages slightly longer than their counterparts in English.

share|improve this answer
1  
Holy wow, Shannon and Wolfram. Nice work. – timquinn Jan 29 at 11:23
I read a little about this experiment of Shannon's. Do you think it would hold up to present day standards? I am sure that Wolfram is referring to Shannon. I wonder if there is any current science on the subject. – timquinn Jan 29 at 11:27
1  
It would also be interesting to see whether any work is done on the redundancy of spoken English. It probably better reflects realistic scenarios in which the speculation makes sense (noisy environments). – Steven Jeuris♦ Jan 29 at 12:20
Yes, i agree, Steven. It would be more relevant to my question if the research involved spoken English. The Shannon experiment sounds more like solving a crossword puzzle, a very conscious act. – timquinn Jan 29 at 13:45
I am going to give Joel the green check. I am sure you have nailed the source of my initial exposure to this and I thank you for that. That it turns out to be Claude Shannon is very interesting because I realized that the notion has become a sort of received wisdom that has been repeated by a lot of pop and legitimate science writers. His work was about written language, though, so it does not actually support my long held belief in instantaneous error correction. I am going to formulate another question. – timquinn Jan 30 at 6:07
show 2 more comments

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.