Models of the Mind

the visual system rapidly adapts its code to the motion information it’s currently getting. Specifically, to be an efficient encoder, a neuron should always fire at its peak firing rate for the fastest motion it sees and at its lowest for the slowest.

without regard to how understandable any part of them would be. It

Hopfield found that if the weights between the neurons in his network are just right the network as a whole can implement associative memory.

a reward you get immediately is worth more than a reward you get later. He

neuroscientists continue to spar and struggle over the neural code to this day.

The neuron needed just a small amount of time to monitor the range of speeds it was seeing and adapt its firing patterns accordingly.

In associative memory, a small input to the network reactivates an entire memory state.

a symbol’s information depend on the inverse of its probability.

the rarer a symbol’s use, the more information it contains.