OpenAI warned ChatGPT could turn into a ‘attractive – Business News
Mental-health specialists advising OpenAI are reportedly livid over the company’s push to roll out an erotic chatbot that one adviser warned could turn into a “sexy suicide coach.”
A bunch of exterior advisers to the AI giant warned that its pivot to offer a so-called “adult mode” could expose thousands and thousands of minors to X-rated chats whereas growing the risk customers develop unhealthy emotional dependence on the bot, The Wall Street Journal reported.
Citing instances during which ChatGPT customers took their own lives after developing intense bonds with the bot, one adviser reportedly warned the function could create a “sexy suicide coach.”
OpenAI CEO Sam Altman has argued the company ought to enable grownup customers to interact in express chatbot conversations underneath a proposed “adult mode.” REUTERS
Last 12 months, a 16-year-old California teen died by suicide as a outcome of what his mother and father alleged in a lawsuit was “months of encouragement from ChatGPT” to put an finish to his life.
Internal paperwork reviewed by The Journal flagged the risk that sexually express chatbot interactions could drive compulsive use and result in emotional overreliance on the bot.
Staffers additionally warned that heavy engagement with erotic AI chats could crowd out offline social and romantic relationships as customers spend more time interacting with the chatbot as a substitute of people.
The company’s age-prediction system — designed to keep minors out of grownup chats — was at one level misclassifying under-18 customers as adults about 12% of the time, in line with people acquainted with the matter cited by the Journal.
Because ChatGPT has roughly 100 million under-18 customers every week, that error charge could enable thousands and thousands of minors to entry erotic conversations.
Experts warn sexually express chatbot conversations could result in emotional dependence and compulsive use. Wordley Calvo Stock – stock.adobe.com
“Some people have difficulty really remaining with the feeling that this is a machine and not a human,” Gail Saltz, a medical affiliate professor of psychiatry at Weill Cornell Medical College, instructed The Post on Monday.
“Many people in my field are concerned about the seeming relationships people are forming with chatbots and the dangers in that,” she stated.
Saltz added that younger customers are particularly weak as a result of their brains are nonetheless developing.
“They don’t have the fully developed frontal lobe that houses judgment. They have poor impulse control and are inclined toward risk-taking,” she defined.
Saltz additionally warned that some people fighting loneliness or social nervousness might turn to chatbots for companionship as a substitute of actual relationships.
“ChatGPT is extremely affirming — it’s a machine. It’s on your side. It likes you,” she stated.
Once it launches, the “adult mode” function is anticipated to permit sexually express textual content conversations with the chatbot, although OpenAI plans to dam the era of erotic photographs, voice or video, the Journal reported.
OpenAI earlier this month delayed the rollout of the function, which had been anticipated within the first quarter, saying it needed more time to get the expertise proper, in line with the Journal.
We made ChatGPT fairly restrictive to make sure we had been being cautious with mental health points. We understand this made it much less helpful/pleasant to many customers who had no mental health issues, however given the seriousness of the problem we wished to get this proper.Now that we’ve…— Sam Altman (@sama) October 14, 2025
Warnings come as AI firms face growing scrutiny over the mental-health results of chatbot interactions.
Several lawsuits have alleged that conversations with ChatGPT contributed to extreme psychological misery or self-harm, whereas a separate case involving Character.AI centered on the suicide of a Florida teenager who allegedly fashioned an intense relationship with a chatbot.
The Post has sought remark from OpenAI.
