Models of the Mind

To calculate the value at the next state, you simply assume that the best possible action is taken.

the motor cortex is a dynamical system – that the neurons within it interact in a way that makes them capable of producing complex patterns of activity over time. Because of these interactions between its neurons, the motor cortex has the ability to take in short, simple inputs, and produce elaborate and extended outputs in return.

the motor cortex is a dynamical system – that the neurons within it interact in a way that makes them capable of producing complex patterns of activity over time. Because of these interactions between its neurons, the motor cortex has the ability to take in short, simple inputs, and produce elaborate and extended outputs in return.

Now, instead of describing the activity during each movement as a pair of numbers we can describe it as a single number, which refers to where it falls on this line.

MacKay and McCulloch calculated an upper bound of 2,900 bits per second.

Hebbian learning, is succinctly described by the phrase ‘neurons that fire together wire together’.

When people are promised more reward in turn for remembering something, their working memory is better.

Rescorla and Wagner thus made their update in associative strength between one cue and a reward dependent not just on that cue’s current associative strength, but on the sum of the associative strengths of all cues present. If one of these associative strengths is high (for example if the buzzer is present), then the presence of the reward wouldn’t

Neurons in the striatum contribute to the production of behaviour by associating sensory inputs with actions or actions with other actions.

The burden is thus on areas downstream of the motor cortex to change the coordinate system: to take a set of desired locations external to the body and turn it into patterns of muscle activity.