Archive for Information Theory

A Mini-Introduction To Information Theory

Posted in The Universe and Stuff with tags , , , on June 5, 2018 by telescoper

The last link to an arXiv paper I posted here seems to have proved rather popular so here’s another that I think is well worth reading, this time by Ed Witten:

This article consists of a very short introduction to classical and quantum information theory. Basic properties of the classical Shannon entropy and the quantum von Neumann entropy are described, along with related concepts such as classical and quantum relative entropy, conditional entropy, and mutual information. A few more detailed topics are considered in the quantum case.

It’s not really `very short’ as it is nearly 40 pages long, but it does tackle a very big topic so I won’t quibble about that. You can download a PDF of the full paper here.

As always, comments are welcome through the comments box.