Information Theory: A Tutorial Introduction

Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like '20 questions' before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal style, with a comprehensive glossary and tutorial appendices, this text is an ideal primer for novices who wish to learn the essential principles and applications of information theory.

James V. Stone is a Reader in the Psychology Department of the University of Sheffield. He is coauthor (with John P. Frisby) of the widely used text "Seeing: The Computational Approach to Biological Vision" (second edition, MIT Press, 2010), and author of "Independent Component Analysis: A Tutorial Introduction "(MIT Press, 2004).