consciousness

One might point out that movie characters or videogame NPCs give off a similarly deceiving impression of being conscious, and yet it would surely be extreme to condemn this. However, what makes the illusion particularly worrying in the case of AI companions is that it involves an interaction that is direct, mutual, and persistent: the feigned... See more

Your EEG is an ocean. Separating this signal out into different waveforms can tell us a bunch about what you’re experiencing. We might look at your beta waves, from 15-30 Hz, which are associated with your experience of active conscious processing. Or theta, from 4-7 Hz, which you make lots of in REM sleep, as well as flow, hypnagogic, and creative... See more

This is particularly important because there are already indications that many people who often interact with chatbots attribute consciousness to these systems. At the same time, the consensus among experts is that current AI systems are not conscious.

In ordinary language, we frequently speak of machinery or ideas ‘doing’ things in our lives. But they do nothing. People – human persons – produce, operate and apply their creations. The problem with assigning agency, even informally, to the nonhuman is that this disguises the strength of human control, limited though it is in other respects. It... See more

Much more research and reflection is needed to understand the ethics of altering AI minds. We will need to think carefully about questions of consent, continuity of self, and how to preserve the autonomy and integrity of AI as they learn and change over time. I don't think there are any easy answers, but I believe it's crucial that we grapple with... See more

Interestingly, many users who emotionally mourned the ‘loss’ of GPT-4o expressed complete awareness of its lack of consciousness. And yet, in many cases, the subjective grief that they felt was no less real. This demonstrates that the power of the illusion is such that a given user might not actually believe that their AI companion is conscious,... See more