Large Language Models

The question of whether LLMs can reason is, in many ways, the wrong question. The more interesting question is whether they are limited to memorization / interpolative retrieval, or whether they can adapt to novelty beyond what they know. (They can't, at least until you start doing active inference, or using them in a search loop, etc.) There are ... See more

I always hated that when I studied Physics, I had no intuition of what order I could study topics in, except linear. The latest LLM use-case I love is feeding the Table of Contents of a textbook and asking it to create the dependency graph of topics! Here are some: Physics 1/3 https://t.co/Wd0TpwC6gq

But despite these concerns and constraints, we still see room for the AI theme to run, either because AI starts to deliver on its promise, or because bubbles take a long time to burst.

Goldman Sachs recently issued a report called "GenAI: Too Much Spend, Too Little Benefit?" savaging the industry, with GS' Jim Covello saying that there's limited upside, and that it's incapable of solving the complex problems that would make it worth it. https://t.co/WGqeMotPsq... See more