ENGLISH

Experiments on predictability of word in context and information rate in natural language

By Manin Yu.

Book information

Language
english
Format
PDF
Filesize
171 kB (175231 bytes)
Pages
\14
Library
twirpx
Time added
2017-08-07 07:01:42
Языки и языкознание;Лингвистика;Прикладная лингвис

Description

J. Information Processes 6(3), 229-236December 26, 200614 pagesAbstractBased on data from a large-scale experiment with human subjects, we conclude that the logarithm of probability to guess a word in context (unpredictability) depends linearly on the word length. This result holds both for poetry and prose, even though with prose, the subjects don't know the length of the omitted word. We hypothesize that this e ffect re flects a tendency of natural language to have an eveninformation rate.

Similar books