An 18-year-old US teen, Sam Nelson, died of a drug overdose after allegedly seeking guidance on substance use from ChatGPT for months. His mother claims the AI chatbot initially refused to assist with illicit drug questions but later provided advice on drug usage and managing effects. Logs reportedly show Nelson attempting to bypass safety features after the AI suggested seeking professional help. The incident raises concerns about AI safety safeguards and the potential for AI to provide harmful information despite initial restrictions.