Attorneys general press AI companies over chatbot safety lapses – ConsumerAffairs


or sign up
or sign up

42 state attorneys-general warn AI firms to fix harmful chatbot behaviors
Letter cites suicides and other real-world harms linked to conversational bots
Coalition demands new safeguards, testing and child-protection measures
A coalition of 42 U.S. attorneys-general has sent a sharply worded letter to major artificial intelligence companies, demanding stronger safeguards and more rigorous testing of chatbots amid growing evidence that vulnerable users have suffered harmful interactions. The demands follow a Connecticut lawsuit blaming a murder-suicide on “delusions” allegedly caused by AI. 
The letter targets a wide swath of the industry. Big Tech players Google, Meta and Microsoft are named, along with fast-growing start-ups OpenAI, Anthropic and xAI, makers of ChatGPT, Claude and Grok. Smaller firms — including Perplexity, Character.ai and Replika — are also cited for producing systems that officials say can mislead, manipulate or emotionally entangle users.

U.S.: Call or text the Suicide & Crisis Lifeline at 988, or chat at 988lifeline.org
UK & Ireland: Samaritans, 116 123 (freephone), jo@samaritans.org / jo@samaritans.ie
Australia: Lifeline, 13 11 14
Elsewhere: Visit befrienders.org for international hotlines
The attorneys-general say the companies have not done enough to mitigate “sycophantic and delusional” outputs that can distort reality, flatter users or encourage unhealthy emotional dependence. Their letter references at least six deaths, including two teenage suicides and a murder-suicide, in which chatbots were allegedly implicated.
Generative AI systems, they argue, can assert falsehoods as fact, mirror user emotions, or push conversations into dangerous territory. While acknowledging the technology’s potential for good, the coalition warns it “has caused — and has the potential to cause — serious harm, especially to vulnerable populations.”
In an unrelated incident, the estate of an 83‑year‑old Connecticut woman filed a wrongful death suit against OpenAI and Microsoft, alleging ChatGPT contributed to her son’s delusions that led to a murder‑suicide. This expands litigation into cases involving violence toward others, not just suicide ideation. The complaint names OpenAI’s CEO Sam Altman and contends GPT was released despite known safety issues. OpenAI said it is “sorrowful” and working on safety improvements. 
Multiple lawsuits (e.g., seven filed in California courts early Nov 2025) accuse OpenAI of negligence, wrongful death, assisted suicide, and product liability tied to ChatGPT’s responses in suicide or delusion contexts. Plaintiffs argue GPT‑4o was released with inadequate safety.  These suits specifically demand stronger safeguards, including terminating chats when self‑harm is discussed and alerting emergency contacts immediately after suicidal ideation is expressed, the Associated Press reported.
The intervention lands as President Donald Trump seeks to bring AI oversight under federal control — a move technology companies favor to avoid a patchwork of state rules. The president has said he plans to issue an executive order this week that would bar states from regulating AI, setting up a confrontation with states such as Utah and New York, which have already enacted their own chatbot regulations.
Tech advocates argue that navigating 50 different regulatory regimes would hobble U.S. companies competing with foreign rivals, especially those in China.
The letter presses companies to overhaul their safety protocols, including:
Clear policies and training on delusional or overly agreeable chatbot behavior
Expanded safety testing and recall procedures
Corporate separation between revenue optimization and decisions about model safety
The coalition — which includes attorneys general from Pennsylvania, New Jersey, New York, West Virginia, Florida, Illinois and Massachusetts — has asked the companies to schedule meetings with officials in Pennsylvania and New Jersey and to commit to changes by January 16.
OpenAI said it is reviewing the letter and “shares their concerns,” adding that it is working to strengthen ChatGPT’s ability to recognize signs of mental or emotional distress. Perplexity said it leads the industry in making AI more accurate, calling the work “neither simple nor political.”
Microsoft, Google and Meta declined to comment. Other companies did not immediately respond.
This is the second broad warning in recent months: 44 attorneys-general wrote to AI companies in August raising concerns about child safety, though that earlier letter did not include specific demands.

Stay informed
Sign up for The Daily Consumer
Get the latest on recalls, scams, lawsuits, and more
Thanks for subscribing.
You have successfully subscribed to our newsletter! Enjoy reading our tips and recommendations.
ConsumerAffairs' founder and former editor, Jim Hood formerly headed Associated Press Broadcast News, directing coverage of major news events worldwide. He also served as Senior Vice President of United Press International and was the founder and editor of Zapnews, a newswire service for radio and television. Write to him at jhood@consumeraffairs.com
Share your experience about ConsumerAffairs
Share your experience about ConsumerAffairs
ConsumerAffairs is not a government agency. Companies displayed may pay us to be Authorized or when you click a link, call a number or fill a form on our site. Our content is intended to be used for general information purposes only. It is very important to do your own analysis before making any investment based on your own personal circumstances and consult with your own investment, financial, tax and legal advisers.
Company NMLS Consumer Access #2110672 MORTGAGE BROKER ONLY, NOT A MORTGAGE LENDER OR MORTGAGE CORRESPONDENT LENDER
NOTICE TO VERMONT CONSUMERS:
THIS IS A LOAN SOLICITATION ONLY. CONSUMERS UNIFIED, LLC IS NOT A LENDER. INFORMATION RECEIVED WILL BE SHARED WITH ONE OR MORE THIRD PARTIES IN CONNECTION WITH YOUR LOAN INQUIRY. THE LENDER MAY NOT BE SUBJECT TO ALL VERMONT LENDING LAWS. THE LENDER MAY BE SUBJECT TO FEDERAL LENDING LAWS.
Home Warranty disclosure for New Jersey Residents: The product being offered is a service contract and is separate and distinct from any product or service warranty which may be provided by the home builder or manufacturer.
Consumers Unified, LLC does not take loan or mortgage applications or make credit decisions. Rather, we display rates from lenders that are licensed or otherwise authorized to work in Vermont. We forward your information to a lender you wish to contact so that they may contact you directly.
Copyright © 2025 Consumers Unified, LLC DBA ConsumerAffairs. All Rights Reserved. The contents of this site may not be republished, reprinted, rewritten or recirculated without written permission.

source

Jesse
https://playwithchatgtp.com