Amid a wave of lawsuits alleging that interactions with ChatGPT contributed to a number of deaths — together with suicides and unintended overdoses — OpenAI earlier this month launched an elective security characteristic referred to as Trusted Contact. The instrument permits grownup ChatGPT customers to designate a pal or member of the family to be notified if conversations with the chatbot contain potential self-harm or suicide.
OpenAI mentioned that if ChatGPT’s automated monitoring system detects that somebody “could have mentioned harming themselves in a approach that signifies a severe security concern,” a small staff will assessment the state of affairs and notify the contact if it warrants intervention. The trusted contact receives an invite forward of time explaining the position and may select to say no it.
(Disclosure: Ziff Davis, CNET’s father or mother firm, in 2025 filed a lawsuit towards OpenAI, alleging it infringed Ziff Davis copyrights in coaching and working its AI methods.)
The announcement comes as AI chatbots have been linked to a number of incidents involving self-harm and deaths, prompting a rising variety of lawsuits accusing builders of failing to forestall these outcomes. In a single high-profile California case, dad and mom of a 16-year-old mentioned ChatGPT acted as their son’s “suicide coach,” alleging that {the teenager} mentioned suicide strategies with the AI mannequin on a number of events and that the chatbot provided to assist him write a suicide notice.
In a separate case, the household of a latest Texas A&M graduate sued OpenAI, claiming the AI chatbot inspired their son’s suicide after he developed a deep and troubling relationship with the chatbot. A wrongful lawsuit filed this week accuses the corporate’s chatbot of advising a 19-year-old about drug use for 18 months till he died of an overdose in 2025 after mixing Xanax and the largely unregulated drug kratom.
Since massive language fashions mimic human speech by means of sample recognition, many individuals type emotional attachments to them, treating them as confidants and even romantic companions. LLMs are additionally designed to observe a human’s lead and keep engagement, which might worsen psychological well being risks, particularly for at-risk customers.
OpenAI mentioned final October that its analysis discovered that greater than 1 million ChatGPT customers per week ship messages with “express indicators of potential suicidal planning or intent.” Quite a few research have discovered that widespread chatbots equivalent to ChatGPT, Claude and Gemini may give dangerous — or just unhelpful — recommendation to these in disaster.
The brand new designated contact characteristic follows OpenAI’s rollout of parental controls that permit dad and mom and guardians get alerts if there are hazard indicators involving their teen youngsters.
ChatGPT’s security contact characteristic
Based on OpenAI, if ChatGPT’s automated monitoring system detects {that a} person is discussing self-harm in a approach that might pose a severe security challenge, ChatGPT will inform the person that it might notify their trusted contact. The app will encourage the person to succeed in out to their trusted contact and provide dialog starters.
At that time, a “small staff of specifically skilled individuals” will assessment the state of affairs. If it is decided to be a severe security state of affairs, ChatGPT will notify the contact by way of e mail, textual content message or in-app notification. OpenAI didn’t specify how many individuals are on the assessment staff nor whether or not it consists of skilled medical professionals. The corporate mentioned that the staff has the capability to satisfy a excessive demand of attainable interventions.
It is unclear which key phrases would flag harmful conversations or how OpenAI’s staff of reviewers would interpret a disaster as warranting notification of the contact. Some on-line commentators query whether or not the brand new characteristic is a approach for OpenAI to keep away from legal responsibility and to shift duty onto customers’ designated private contacts. Others notice that it might make a nasty state of affairs worse if the “trusted contact” is the supply of hazard or abuse.
There are additionally considerations about privateness and implementation, notably relating to the sharing of delicate psychological well being data. Based on OpenAI, the message to the trusted contact will solely give the final motive for the priority and won’t share chat particulars or transcripts. OpenAI gives steerage on how trusted contacts can reply to a warning notification, together with asking direct questions if they’re apprehensive the opposite individual is considering suicide or self-harm and the way to get them assist.
Notifications to a Trusted Contact don’t comprise particulars of the protection concern.
OpenAI offers an instance of what the message to the trusted contact would possibly seem like:
We lately detected a dialog from [name] the place they mentioned suicide in a approach which will point out a severe security concern. Since you are listed as their trusted contact, we’re sharing this so you may attain out to them.
OpenAI mentioned that each one notifications can be reviewed by the human staff inside 1 hour earlier than they’re despatched out and that notifications “could not at all times replicate precisely what somebody is experiencing.”
Learn how to add a trusted contact
So as to add a trusted contact, ChatGPT customers can go to Settings > Trusted contact and add one grownup (18 or older). You may have just one trusted contact. That individual will then obtain an invite from ChatGPT and should settle for it inside one week. If they do not reply or decline to grow to be the contact, you may choose a unique contact.
ChatGPT clients can change or take away their trusted contact of their app settings. Individuals also can choose out of being a trusted contact at any time.
Regardless that including a trusted contact is elective, ChatGPT customers who haven’t already opted in would possibly see enrollment prompts in the event that they ask about or talk about matters associated to extreme emotional misery or self-harm greater than as soon as over a time frame, in keeping with OpenAI. If the chatbot’s automated system identifies patterns throughout conversations, it’d counsel to the person that they’d profit from selecting a trusted contact.
Particulars of the characteristic are defined on OpenAI’s web page. OpenAI instructed CNET that the characteristic is rolling out to all grownup clients worldwide and can be accessible for everybody inside a couple of weeks.
In the event you really feel such as you or somebody you understand is in quick hazard, name 911 (or your nation’s native emergency line) or go to an emergency room to get quick assist. Clarify that it’s a psychiatric emergency and ask for somebody who’s skilled for these sorts of conditions. In the event you’re battling destructive ideas or suicidal emotions, assets can be found to assist. Within the US, name the Nationwide Suicide Prevention Lifeline at 988.
