Large Language Models

I always hated that when I studied Physics, I had no intuition of what order I could study topics in, except linear. The latest LLM use-case I love is feeding the Table of Contents of a textbook and asking it to create the dependency graph of topics! Here are some: Physics 1/3 https://t.co/Wd0TpwC6gq

Goldman Sachs recently issued a report called "GenAI: Too Much Spend, Too Little Benefit?" savaging the industry, with GS' Jim Covello saying that there's limited upside, and that it's incapable of solving the complex problems that would make it worth it. https://t.co/WGqeMotPsq... See more

The question of whether LLMs can reason is, in many ways, the wrong question. The more interesting question is whether they are limited to memorization / interpolative retrieval, or whether they can adapt to novelty beyond what they know. (They can't, at least until you start doing active inference, or using them in a search loop, etc.) There are ... See more