Table of contents

This book is devoted to the theory of probabilistic information measures and their application to coding theorems for information sources and noisy channels. Th

First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in pr

A self-contained, graduate-level textbook that develops from scratch classical results as well as advances of the past decade.