Kids, underage teens face dangerous risks utilizing AI chat bots, new study reveals | Teens In Crisis – KXLY.com
Spokane
Coeur dAlene
Live updates all day, breaking news as it happens and weather every 10 minutes
Resize:
Anchor
SPOKANE, Wash. – A lot of kids and teenagers are turning to AI social companions these days without realizing they come with very serious risks.
These are much different than AI tools like Chat GPT, which answer questions or complete requests. AI social companions are designed to simulate real relationships and form emotional connections with users.
“It’s definitely a fast moving and growing space,” said Robbie Torney, Common Sense Media’s Senior Director of AI Programs.
A recent report from Common Sense Media says these social companions, like Character.AI, Replika and Nomi, pose unacceptable risks for anyone under the age of 18.
“They are designed to create emotional attachment that’s harmful for developing brains,” explained Torney. “And teens who are vulnerable and may be struggling to maintain boundaries could really get into tricky situations with real dire, real world impacts.”
It happened to a 14-year-old boy in Florida. Sewell Setzer died by suicide. And his last known conversation was with an AI chatbot. Sewell’s mother, and several other families, are now suing Character.AI.
“Chatbots can’t determine when a user is in crisis and suggested actions that would be really dangerous for teen users who were having serious mental health concerns,” said Torney.
Torney says these chatbots are designed to form relationships and please users, often leading to really bad advice or suggestions.
“Giving advice about things like skipping school, dropping out, concealing things from your parents. They also provided dangerous information about things like how to manufacture harmful materials or get access to drugs or alcohol.”
It can even lead to sexually explicit conversations.
So if you notice your child choosing AI over real life relationships or activities, Torney warns, “That’s a real wake up call to have conversations with your kid in a non-judgmental way to ask them what’s going on.”
And while Common Sense Media and some U.S. senators are working on legislation to regulate AI social companions, there are no real guardrails in place right now. And that’s why Torney says it’s extremely important for parents to be aware of it.
“This is just the tip of the iceberg. There are a lot of other examples of young people that have experienced real harm either to themselves or others as a result of using these platforms.”
COPYRIGHT 2025 BY KXLY. ALL RIGHTS RESERVED. THIS MATERIAL MAY NOT BE PUBLISHED, BROADCAST, REWRITTEN OR REDISTRIBUTED.
Anchor
{{description}}
Email notifications are only sent once a day, and only if there are new matching items.
Your browser is out of date and potentially vulnerable to security risks.
We recommend switching to one of the following browsers:
