Ethical Issues In Advanced Artificial Intelligence

More subtly, it could result in a superintelligence realizing a state of affairs that we might now judge as desirable but which in fact turns out to be a false utopia, in which things essential to human flourishing have been irreversibly lost.

The overall risk seems to be minimized by implementing superintelligence, with great care, as soon as possible.