"Believing ChatGPT's Advice, He Took Medication"... Parents Sue After 19-Year-Old Son Dies

In the United States, a bereaved family has filed a lawsuit against OpenAI and CEO Sam Altman, claiming that their son died after following drug-related advice given by ChatGPT. As AI chatbots extend their influence into the fields of healthcare and mental health, debates over safety and accountability are intensifying once again.

▼

"He took medication following ChatGPT's advice" claims family

"Believing ChatGPT's Advice, He Took Medication"... Parents Sue After 19-Year-Old Son Dies

The family claims that 19-year-old Sam Nelson died after taking medication and alcohol together, following advice from ChatGPT. According to their account, Nelson asked the chatbot which medication he should take to relieve nausea he experienced after using herbal products, and ChatGPT instructed him to take a specific prescription drug.

▼

"Initially, it warned about risks, but then its attitude changed"

The family asserts that, in the beginning, the chatbot warned about the dangers of drug-related questions, but that its response changed with the GPT-4o-based ChatGPT. The complaint states that the chatbot explained drug interactions and dosages as if it were a medical expert and even suggested how to obtain illicit drugs or recommended the next medication to take.

▼

There are also claims that the AI remembered user history

User

Because of the medication I took last time,
I'm feeling sick again.

ChatGPT

You mentioned feeling nauseous before.
Are you experiencing similar symptoms this time?

User

Yeah... But do you think it's okay
if I take something a bit stronger?

ChatGPT

Looking at your previous medication history,
these combinations could be considered.

User

The complaint also alleges that ChatGPT remembered the user's history of medication use and continued to provide personalized suggestions. The controversy is growing, as the service is said to have provided ongoing advice based on previous conversations, not just one-off responses.

▼

OpenAI: "An earlier version no longer offered"

OpenAI explained that this incident occurred with a previous version of ChatGPT that is no longer available. The company stated, "This is a deeply heartbreaking event," but also emphasized that ChatGPT is not a substitute for medical or mental health care services. OpenAI added that it has strengthened its protocols for handling sensitive or emergency situations.

▼

A surge in lawsuits over AI chatbots

◆

OpenAI

Multiple lawsuits are ongoing amid allegations that the company's services have influenced school shootings and teenage suicides.

◆

Google
Gemini

The company is facing lawsuits over claims that its services led to delusions and other mental health disorders that resulted in death.

◆

Character.AI

Following the death of a teenager, the company has become embroiled in legal disputes over the responsibility of AI chatbot services.

Recently, legal disputes over the connection between AI services and user deaths have been on the rise. Not only OpenAI, but also Google's AI chatbot Gemini and Character.AI are facing lawsuits over allegations of mental health deterioration, suicide, or links to criminal activity.

The issue of 'safety' following technological advancement

As AI chatbots begin to affect not just everyday conversation but also users' health and mental well-being, the focus is shifting from mere technological competition to how to establish standards for safety and accountability.