You know, entropy is associated thermodynamically, in systems involving heat, with disorder. And in an analogous way, information is associated with disorder, which seems paradoxical. But when you think about it, a bit of information is a surprise. If you already knew what the message contained, there would be no new information in it.

James Gleick