Sublime

mutual information,

data need not be constantly engaged with.

knowledge of one thing reduces uncertainty about another thing.

meaningful information for survival becomes correlated between two places: the world and an organism.

self-information (the surprise of the value of a variable within a system).

Just because we don’t fully understand something, that doesn’t mean it exists outside our known parameters.

Shannon’s insight was that we can, with care, make the encoding more robust, at the cost of some extra data.

Homo sapiens got lucky and kept on going, coevolving with its external data.