Deep Learning Is Hitting a Wall

LeCun points to four essential characteristics of human intelligence that current AI systems, including LLMs, can’t replicate: reasoning, planning, persistent memory, and understanding the physical world. He stresses that LLMs’ reliance on textual data severely limits their understanding of reality: “We’re easily fooled into thinking they are intel... See more

Although the practical success of neural networks is still undeniable, it must be observed that their most powerful applications are in domains where rules are set in advance and don’t change over time — where the goals are clearly defined. The way you win a game of chess or Go is fixed and unambiguous. Protein folding is constrained by the laws of... See more

Although the practical success of neural networks is still undeniable, it must be observed that their most powerful applications are in domains where rules are set in advance and don’t change over time — where the goals are clearly defined. The way you win a game of chess or Go is fixed and unambiguous. Protein folding is constrained by the laws of... See more