Saved by alex and
Why I Have Slightly Longer Timelines Than Some of My Guests
Really interesting new @gwern essay:
LLM Daydreaming - Proposal of how default mode networks for LLMs are an example of missing capabilities for search and novelty
Btw, I know it's a bit cringe to delight in, but if you had told 19 year old me that a Gwern essay would open like this, I woul... See more
LLMs struggle with challenges like the compositionality gap (Measuring and Narrowing the Compositionality Gap in Language Models by Ofir Press and colleagues; 2023). This means LLMs cannot connect inferences or adapt responses to new situations. Overcoming these obstacles requires augmenting LLMs with techniques that add true comprehension.
Ben Auffarth • Generative AI with LangChain: Build large language model (LLM) apps with Python, ChatGPT, and other LLMs
What can LLMs never do?
strangeloopcanon.com