Why large language models struggle with long contexts
Chatbot Software Begins to Face Fundamental Limitations | Quanta Magazine
Anil Ananthaswamyquantamagazine.org
A very common trope is to treat LLMs as if they were intelligent agents going out in the world and doing things. That’s just a category mistake. A much better way of thinking about them is as a technology that allows humans to access information from many other humans and use that information to make decisions. We have been doing this for as long a... See more
Steven Johnson • Revenge of the Humanities
On the Biology of a Large Language Model
transformer-circuits.pub