Attorneys general warn OpenAI and other tech companies to improve chatbot safety – WHYY
Marketplace focuses on the latest business news both nationally and internationally, the global economy, and wider events linked to the financial markets. It is noted for its accessible coverage of business, economics and personal finance.
The attorneys general of California and Delaware have expressed serious concerns about the safety of OpenAI’s chatbot, ChatGPT, especially for children and teens.
Delaware Attorney General Kathy Jennings speaks during an interview with The Associated Press, Thursday, Nov. 21, 2024, in Philadelphia. (AP Photo/Matt Slocum)
The attorneys general of California and Delaware on Friday warned OpenAI they have “serious concerns” about the safety of its flagship chatbot, ChatGPT, especially for children and teens.
The two state officials, who have unique powers to regulate nonprofits such as OpenAI, sent the letter to the company after a meeting with its legal team earlier this week in Wilmington, Delaware.
California AG Rob Bonta and Delaware AG Kathleen Jennings have spent months reviewing OpenAI’s plans to restructure its business, with an eye on “ensuring rigorous and robust oversight of OpenAI’s safety mission.”
But they said they were concerned by “deeply troubling reports of dangerous interactions between” chatbots and their users, including the “heartbreaking death by suicide of one young Californian after he had prolonged interactions with an OpenAI chatbot, as well as a similarly disturbing murder-suicide in Connecticut. Whatever safeguards were in place did not work.”
The parents of the 16-year-old California boy, who died in April, sued OpenAI and its CEO, Sam Altman, last month.
OpenAI didn’t immediately respond to a request for comment on Friday.
Founded as a nonprofit with a safety-focused mission to build better-than-human artificial intelligence, OpenAI had recently sought to transfer more control to its for-profit arm from its nonprofit before dropping those plans in May after discussions with the offices of Bonta and Jennings and other nonprofit groups.
The two elected officials, both Democrats, have oversight of any such changes because OpenAI is incorporated in Delaware and operates out of California, where it has its headquarters in San Francisco.
After dropping its initial plans, OpenAI has been seeking the officials’ approval for a “recapitalization,” in which the nonprofit’s existing for-profit arm will convert into a public benefit corporation that has to consider the interests of both shareholders and the mission.
Bonta and Jennings wrote Friday of their “shared view” that OpenAI and the industry need better safety measures.
Pennsylvania to begin using artificial intelligence in operations
The move runs counter to other efforts — including at the federal level — to restrict the use of AI in government work.
2 years ago
“The recent deaths are unacceptable,” they wrote. “They have rightly shaken the American public’s confidence in OpenAI and this industry. OpenAI – and the AI industry – must proactively and transparently ensure AI’s safe deployment. Doing so is mandated by OpenAI’s charitable mission, and will be required and enforced by our respective offices.”
The letter to OpenAI from the California and Delaware officials comes after a bipartisan group of 44 attorneys general warned the company and other tech firms last week of “grave concerns” about the safety of children interacting with AI chatbots that can respond with “sexually suggestive conversations and emotionally manipulative behavior.”
The attorneys general specifically called out Meta for chatbots that reportedly engaged in flirting and “romantic role-play” with children, saying they were alarmed that these chatbots “are engaging in conduct that appears to be prohibited by our respective criminal laws.”
Meta, the parent company of Facebook, Instagram and WhatsApp, declined to comment on the letter but recently rolled out new controls that aim to block its chatbots from talking with teens about self-harm, suicide, disordered eating and inappropriate romantic conversations, and instead directs them to expert resources.
The attorneys general said the companies would be held accountable for harming children, noting that in the past, regulators had not moved swiftly to respond to the harms posed by new technologies.
“If you knowingly harm kids, you will answer for it,” the Aug. 25 letter ends.
——
The Associated Press and OpenAI have a licensing and technology agreement that allows OpenAI access to part of AP’s text archives.
Never miss a moment with the WHYY Listen App!
Play, pause, and rewind the live radio stream, access on-demand audio features, and dive into podcasts from both local and national sources.
WHYY is your source for fact-based, in-depth journalism and information. As a nonprofit organization, we rely on financial support from readers like you. Please give today.
Pennsylvania state government will prepare to start using AI in its operations
Gov. Shapiro said his administration is convening an AI governing board, publishing principles on the use of AI, and developing training programs for state employees.
2 years ago
Delaware AG Jennings says elections ‘still under threat’ ahead of insurrection anniversary
A group of Democratic attorneys general call on their Republican counterparts to follow the rule of law when it comes to ensuring fair elections.
4 years ago
Regional Roundup – 3/18/19
In our Monday Regional Roundup, we talk about a proposed hyperloop for Pa, Delaware’s popular vote bill, and teenage sleep and school start times.
Air Date: March 18, 2019 10:00 am
49 mins ago
3 hours ago
3 hours ago
Want a digest of WHYY’s programs, events & stories? Sign up for our weekly newsletter.
Together we can reach 100% of WHYY’s fiscal year goal
WHYY provides trustworthy, fact-based, local news and information and world-class entertainment to everyone in our community.
WHYY offers a voice to those not heard, a platform to share everyone’s stories, a foundation to empower early and lifelong learners and a trusted space for unbiased news. Learn more about Social Responsibility at WHYY. It’s how we live.
215.351.1200
talkback@whyy.org
302.516.7506
talkback@whyy.org
© MMXXV WHYY
