LeCun points to four essential characteristics of human intelligence that current AI systems, including LLMs, can’t replicate: reasoning, planning, persistent memory, and understanding the physical world. He stresses that LLMs’ reliance on textual data severely limits their understanding of reality: “We’re easily fooled into thinking they are... See more

So the pertinent question is not really whether current AI systems are like you and me (they are not) but what the limits of their abilities might be. AI sceptics have argued vehemently that LLMs are forever limited by the basic design choices of AI developers, and especially that they are trained to predict (or 'guess') the next token in a

... See more

Even though his research laid the groundwork for L.L.M.s, Dr. LeCun argued that they were not the final answer to A.I. development. The problem with current systems, he said, is that they do not plan ahead. Trained solely on digital data, they do not have a way of understanding difficulties in the real world.