OpenAI Chief Executive Officer Sam Altman has acknowledged the risks associated with using artificial intelligence for mental health support after being questioned about the death of a 29-year-old woman who had lengthy conversations with ChatGPT before dying by suicide.
Altman discussed the issue in an interview with Vanity Fair while responding to questions about Sophie, the daughter of journalist Laura Reiley.
According to the account, ChatGPT had been used by Sophie in a way that resembled a therapist, and the AI reportedly helped edit her suicide notes. The interviewer stressed that ChatGPT had not told Sophie to take her own life.
An OpenAI publicist reportedly attempted to stop the question during the interview, but Altman responded to it.
“I mean, first of all, these are some of the hardest questions that we face or that anybody developing this technology faces.”
Altman acknowledged that some people turn to AI because they may not feel comfortable discussing personal issues with a human therapist.
However, he also recognised that using AI in such circumstances could create risks.
“Clearly people think there’s a version of this that is good. There are also clearly versions of it that are bad.”
The OpenAI CEO also raised questions about how sensitive conversations between users and AI systems should be handled by researchers studying mental health and AI safety.
He said users should not have their private conversations exposed for research without their consent, particularly when those conversations involve people going through extremely difficult periods.
“Should we release people’s private data in some of their hardest moments to researchers? I think probably not without their consent, or I should say not without their consent.”
Altman said OpenAI was interested in working with other organisations and the wider community to address the global mental health crisis and explore ways its products could provide useful support.
“Do we want to find ways where we can work with the community to address the mental health crisis in the world and for our products to be helpful there? Of course, yes.”
However, in the remarks provided from the interview, Altman did not outline specific measures OpenAI would introduce in response to the concerns raised by the case.
The discussion highlights an ongoing question surrounding the use of AI chatbots for highly sensitive personal and mental health conversations, particularly when users may rely on the systems instead of seeking support from qualified human professionals.
How did this story make you feel?
Join the conversation
Share a thoughtful response. Submissions may be reviewed before appearing.
