Saved by Prashanth Narayan and
Deep Learning Is Hitting a Wall
LeCun points to four essential characteristics of human intelligence that current AI systems, including LLMs, can’t replicate: reasoning, planning, persistent memory, and understanding the physical world. He stresses that LLMs’ reliance on textual data severely limits their understanding of reality: “We’re easily fooled into thinking they are... See more
Azeem Azhar • 🧠 AI’s $100bn question: The scaling ceiling
So the pertinent question is not really whether current AI systems are like you and me (they are not) but what the limits of their abilities might be. AI sceptics have argued vehemently that LLMs are forever limited by the basic design choices of AI developers, and especially that they are trained to predict (or 'guess') the next token in a
... See moreChristopher Summerfield • These Strange New Minds
Over the past 2 and half years we’ve seen the rise of the LLM’s but one of the great contributers to LLM’s Yann LeCun believes that LLM’s are actually old news and that we’re now just making them marginally better and he’s much more focused on other things.
Firstly he thinks these models need to understand the physical world. Right now, LLMs are