Why large language models struggle with long contexts
A very common trope is to treat LLMs as if they were intelligent agents going out in the world and doing things. That’s just a category mistake. A much better way of thinking about them is as a technology that allows humans to access information from many other humans and use that information to make decisions. We have been doing this for as long... See more
Steven Johnson • Revenge of the Humanities

This is a great paper for understanding LLMs, especially for those of us who arent entrenched in it https://t.co/oYaxc3Xr7s