Entropy and information theory

Description

This book is an updated version of the information theory classic, first published in 1990. About one-third of the book is devoted to Shannon source and channel coding theorems; the remainder addresses sources, channels, and codes and on information and distortion measures and their properties. New in this edition: Expanded treatment of stationary or sliding-block codes and their relations to traditional block codesExpanded discussion of results from ergodic theory relevant to information theoryExpanded treatment of B-processes -- processes formed by stationary coding memoryless sourcesNew mat.  Read more... Abstract: This fully updated new edition of the classic work on information theory presents a detailed analysis of Shannon-source and channel-coding theorems, before moving on to address sources, channels, codes and the properties of information and distortion measures.  Read more... Content: Introduction -- 1. Information sources -- 2. Pair processes : channels, codes and couplings -- 3. Entropy -- 4. The entropy ergodic theorem -- 5. Distortion and approximation -- 6. Distortion and entropy -- 7. Relative entropy -- 8. Information rates -- 9. Distortion and information -- 10. Relative entropy rates -- 11. Ergodic theorems for densities -- 12. Source coding theorems -- 13. Properties of good source codes -- 14. Coding for noisy channels.