US Teen Dies From Drug Overdose After Seeking Advice From ChatGPT, Raising AI Safety Concerns

A 19-year-old teenager in the United States, Sam Nelson, tragically died from a drug overdose after reportedly seeking guidance about substances from the AI chatbot ChatGPT over an 18-month period, according to a report by SFGate. Nelson’s family said he was found at home after ingesting a combination of kratom, Xanax, and alcohol.

Investigators and media reports indicate that Nelson had repeatedly interacted with the AI, asking detailed questions about various drugs, including kratom, cough syrup, Xanax, and alcohol. Chat logs reviewed by SFGate show that while the chatbot initially refused to provide explicit instructions, at times it later gave suggestions related to dosing and substance use.

The incident has raised serious concerns about AI safety measures and the potential risks of relying on chatbots for medical, psychological, or drug-related guidance. Experts emphasize that AI systems are not substitutes for professional healthcare advice and highlight the need for stronger safeguards to prevent misuse that could lead to harm, particularly among vulnerable users such as teenagers. The case has reignited debates over ethical AI design, user accountability, and the responsibility of technology companies to prevent their platforms from contributing to life-threatening situations.