Deep Learning Is Hitting a Wall

The spectacular advances in generative AI led to an explosion of interest in connectionism and its latest incarnation, deep learning. The question of how AI’s emergent properties are related to symbolic computation or how symbolic regularities “emerge” from complex patterns is one of the hottest fields in AI research today and is not well understoo... See more

o, alternative pathways to building Type-2 reasoning-capable AI systems, likely using neurosymbolic approaches, have become much more attractive. People like Gary Marcus have argued for neurosymbolic approaches for decades. Such approaches combine the pattern recognition of neural nets, like LLMs, with symbolic reasoning’s logic and rules. Vinod Kh... See more