ex-Google CEO, @elonmusk's @xAI advisor and Scale AI's @alexandr_wang sound the alarm on superintelligence. "We introduce the concept of Mutual Assured AI Malfunction (MAIM): a deterrence regime resembling nuclear mutual assured destruction (MAD)" 👀 https://t.co/XyQrysITXL

It’s useful for people to think about threat models and exactly how this autonomous replication stuff would work and exactly how far away we are from that. Having done that, it feels a lot less speculative to me. Models today can in fact do a bunch of the basic components of: make money, get resources, copy yourself to your server. This isn’t a... See more

Anthropic cofounder: “I am deeply afraid.'" "Make no mistake: what we are dealing with is a real and mysterious creature, not a simple and predictable machine." "People are spending tremendous amounts to convince you that it’s not an AI about to go into a hard takeoff, it’s just a tool...... See more

So I think we are headed for a world where AI systems are decentralized - each individually tuned for a single slice of reality corresponding to a specific user. The greatest future risks from AI are the externalities that will arise from the unpredictable dynamics of interacting AI systems. We know that this sort of dynamic can arise because it

... See more

Thanks to recursive self-improvement, the strongest AI may pull ahead very quickly, and once AIs are more powerful than humans, there is no force that can push things back into balance.