An Introduction to Information Theory

This book covers topics on encoding and binary digits, entropy, language and meaning, efficient encoding and the noisy channel, and explores ways in which information theory applies to physics, cybernetics, psychology, and art.