Language Is Our Latent Space
LLMs take advantage of the fact that language data comes in a sequential order. Each unit of information is in some way related to data earlier in a series.
Mustafa Suleyman • The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma
So far, there’s no evidence that large language models possess world models, even though some researchers and engineers believe they might naturally emerge over time. And it is this absence of grounded, rules-based modeling, Marcus recently argued, that explains why L.L.M.s often “hallucinate” in strange and unexpected ways: “What L.L.M.s do is to... See more
Just a moment...
These new types of AI, called Large Language Models (LLMs), are still doing prediction, but rather than predicting the demand for an Amazon order, they are analyzing a piece of text and predicting the next token, which is simply a word or part of a word. Ultimately, that is all ChatGPT does technically—act as a very elaborate autocomplete like you
... See moreEthan Mollick • Co-Intelligence
When we turn to an LLM to write for us, we are also inviting it to undertake the more fundamental task of articulation, and this is no small thing. Indeed, given the centrality of language to the human condition, we should wonder about the degree to which the outsourcing of the labor of articulation is the outsourcing of a fundamentally human... See more