Scary Smart: Scary Smart: The Future of Artificial Intelligence and How You Can Save Our World

The underlying principle in our relationship with the machines is our desire to control them. This will surely lead them to mistrust us. We are starting with mistrust and our actions reflect that position.

if we build the right environment for the machines to learn in, they will learn the right ethics.

One scenario that is played out less often in sci-fi is where AI supports humanity but is on the wrong side – the aggressive nations or evil villains.

The Technology Development Curve represents the typical progress made for a new technology over time. It looks like a standard hockey stick chart, which is normally used to describe events that accelerate rapidly after a specific “breakout point”– only, with tech development, the handle of the stick is almost horizontal.

Intelligence is not a prerequisite to the formation of ethics and values.

if smart and kind can fit together in one human, then maybe they can serve as the example we want to set for how the machines should be.

AI will not replace humans, but the humans who use AI intelligently will replace those who don’t.

The second inevitable is that in the next few years, as we compete commercially and politically to create superior machine intelligence, AI will sooner or later become smarter than we are. That, too, is inevitable.

This need for specialization, the constrained bandwidth of our ability to communicate, our limited memory capacity and processing power, means even the smartest of minds is approaching the limits of human intelligence.