Mathematical physicist extraordinaire John Baez digs in to Shannon entropy and coding over at Azimuth:
So, I want to understand Shannon’s theorems and their proofs—especially because they clarify the relation between information and entropy, two concepts I’d like to be an expert on. It’s sort of embarrassing that I don’t already know this stuff! But I thought I’d post some preliminary remarks anyway, in case you too are trying to learn this stuff, or in case you can help me.
Continue reading “The link between information and entropy on Azimuth”
The Finch and Pea 