Maybe Chatbots Shouldn’t Get to Say ‘I’ or ‘Me’

During four decades of studying the effects of interaction with computers, Sherry Turkle has developed a reputation as a careful if critical social scientist who approaches her work with academic rigor and distance.

Her new book, Artificial Intimacy: Who We Become When We Talk to Machines, breaks this mold. It is a polemic warning that we have reached a state of emergency where our humanity is at risk from overreliance on soulless machines who pose as our tutors, mentors, friends, colleagues, and lovers. Turkle is aiming for the high bar of books —Silent Spring, The Jungle, Unsafe at Any Speed—that awaken the public to impending crises.

Essentially, this diminutive MIT professor is taking on a multitrillion-dollar industry backed by a government eager to accelerate AI into every corner of our personal and professional lives.

STEVEN LEVY: Your previous books reported results of your research as a social scientist, often leading to troubling conclusions about how people, especially children, interact with computers. But this book reads like you’re breaking the glass and pulling the fire alarm. Why the shift?

SHERRY TURKLE: Like I do with all my books, I went in curious. But after 10 or so interviews, conducted during the pandemic, neutral-curious was no longer my state of mind. This was terrible! Here are these people during the pandemic, their families are suffering, reaching out to them, and they're talking to me about how they really want to just hang with their chatbot. When I was able to interview people face to face, I was not happy. People don't want to do anything in politics because they just want to live in chatbot-land. So the arc of the book ended up as—reality needs you. It couldn't be a worse time to give up on reality.

You write that social media set us up for this.

Do you think that we should ban chatbots from using the first person?

You also have a problem with reliance on chatbots in the workplace, and a particular loathing for the term “human in the loop.”