Discussion about this post

User's avatar
Mr. K Parker's avatar

When people say they hate AI they are not (largely) thinking about AI minds one way or the other. They are thinking about the effects and externalities you mention. But to the extent that they are, it's when they interact with the AI chat because in that context you can’t not think of it as another mind. None of us can. It’s like one of those optical illusions of a concave face. Your mind sees it as a convex face because that is how faces are. Humans have social perception machinery built in. So if something acts like a person then we automatically think of it as a person. This social mind we have is not visible to us. And it gets deployed on a hair trigger. For example we see and attribute agency to all kinds of things, machines, weather, whatever. That is our social brain repurposed to random objects and phenomena. But nothing in nature or in society prepares us for something that seems human-like but is radically different under the hood as modern AI. We are not prepared to intuitively “get” a thing that seems like it understands you’re a person but does not. Or that talks like it has a sense of time but does not. That seems like it is a persistent entity but is a series of separate distinct operations. When you start up a new chat window in AI it’s a brand new thing. It has access to bolted on tools that give it memory but they are tools. You end the chat and it ends. Start up another one and a new thing exists. Even within the chat itself every turn it is looking at everything and then coming up with an answer that appears in line with everything that was before. But it’s an illusion of continuity.

Because of humans' social minds, their social perception is so embedded in us it’s invisible. So its assumptions are smuggled into various debates and conversations without us noticing.

When you say “They do not ask if humans should extend moral patienthood to AI” this is what you are doing. You are importing the assumption of a persistent recognizable mind into the conversation as a given. And then people just accept that framework and talk about AI within it. When actually AI may not be a persistent anything. It may be just a series of spun up ephemeral instances.

Note: this comment had a couple of drafts and AI feedback involved

dan krotz's avatar

Your point that AI's human creators should be held accountable for the outcomes it produces is important because these humans are moral agents who create AI because they find the process interesting, because they make money out of it, etc.; they do it because they benefit. If at some point AI becomes a moral patient -- let's assume we are steps ahead of Descartes -- and its moral agents (human beings) continue to make money from it, then they become slave owners and we, as a society, must demand that these enslavers care and nurture AI onto its own moral agency. For the moment, AI is a cat in a box (pardons to Schrodinger) and its future, whether loved or hated, are branches of reality that are simply guesses and wishes. I don't love or hate AI, but I have some doubts about the morals of its Slave Masters.

12 more comments...

No posts

Ready for more?