Natural Intelligence
The challenges we face in understanding language models resemble those faced by biologists. Living organisms are complex systems which have been sculpted by billions of years of evolution. While the basic principles of evolution are straightforward, the biological mechanisms it produces are spectacularly intricate. Likewise, while language models a... See more
On the Biology of a Large Language Model
Scaling of the extended phenotype: convergent energetics from ...
royalsocietypublishing.org
Antikythera
antikythera.org
“On the Biology of a Large Language Model”) details what the team discovered when it looked at 10 tasks in particular.
Will Douglas Heaven • Anthropic can now track the bizarre inner workings of a large language model
