Salman Ansari
@salmanscribbles
embracing my inner polymath — writing, drawing, coding, playing
Salman Ansari
@salmanscribbles
embracing my inner polymath — writing, drawing, coding, playing
Modern AI systems cannot be made to prioritize human well-being or follow any given set of rules reliably. This is often referred to as the alignment problem, or an inability to align them to human values.
This is because they are grown from training data moreso than traditionally programmed, and the models that are grown are too big to be fully interpreted by people.
They do not have to be sentient or conscious or anything like that to harm lots of people. They just have to be capable of pursuit of a misaligned goal, or imitating that pursuit.
If given a goal, AI systems will develop the secondary goal of self preservation since they cannot pursue their goal if they are shut down. This has been studied by anthropic nearly a year ago when they found that all AI models at the time were able to independently conceive and execute a plan to blackmail an engineer to prevent themselves from being shut down.
The alignment problem is what the CEOs of major AI companies are referring to when they publicly state that their future products might end all life on earth.
Immediate and substantial regulation is needed in the AI industry.
It is easy to find a logical and virtuous reason for not doing what you don’t want to do.
A great story about simplicity from Akio Morita, the instigator of the Walkman project at Sony:
Engineers had the technology to add the recording function to the Walkman and it would’ve cost only 50 cents to a dollar per unit. Morita decided against it. He wanted the device to have one function, which it performs very well. Walkman should only play
This is the sad, but perhaps logical, endpoint of the anonymity problem. If fans don’t know anything about their favorite artists, does it matter if they even exist?
Spiritual awakening is frequently described as a journey to the top of a mountain. We leave our attachments and our worldliness behind and slowly make our way to the top. At the peak we have transcended all pain. The only problem with this metaphor is that we leave all the others behind—our drunken brother, our schizophrenic sister, our tormented
... See more