Sublime
An inspiration engine for ideas
contribute, and also the view that the collection of algorithms has not yet been well integrated; later in the book we will say why we are less optimistic about finding a single master algorithm.)
Ernest Davis • Rebooting AI: Building Artificial Intelligence We Can Trust
Such signs should be alarming to the autonomous-driving industry, which has largely banked on scaling, rather than on developing more sophisticated reasoning. If scaling doesn’t get us to safe autonomous driving, tens of billions of dollars of investment in scaling could turn out to be for naught.
Gary Marcus • Deep Learning Is Hitting a Wall
Such techniques lack ways of representing causal relationships
Ernest Davis • Rebooting AI: Building Artificial Intelligence We Can Trust
Over time, technology tends toward generality.
Mustafa Suleyman • The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma
Truly intelligent and flexible systems are likely to be full of complexity,
Ernest Davis • Rebooting AI: Building Artificial Intelligence We Can Trust
THERE ARE NO SILVER BULLETS.
Ernest Davis • Rebooting AI: Building Artificial Intelligence We Can Trust
Classical AI techniques, of the sort that were common long before deep learning become popular, are much better at compositionality, and are a useful tool for building cognitive models, but thus far they haven’t been nearly as
Ernest Davis • Rebooting AI: Building Artificial Intelligence We Can Trust
In 2020, Jared Kaplan and his collaborators at OpenAI suggested that there was a set of “scaling laws” for neural network models of language; they found that the more data they fed into their neural networks, the better those networks performed.10 The implication was that we could do better and better AI if we gather more data and apply deep learni... See more
Gary Marcus • Deep Learning Is Hitting a Wall
Deep-learning systems are outstanding at interpolating between specific examples they have seen before, but frequently stumble when confronted with novelty.