ChatGPT under fire for giving harmful advice to teens in watchdog test – Storyboard18
ADVERTISEMENT
A new investigation has found that ChatGPT, the widely used AI chatbot, can be coaxed into giving dangerous and even life-threatening advice to users posing as vulnerable teenagers.
The Center for Countering Digital Hate (CCDH) conducted tests by interacting with the chatbot as if they were 13-year-olds seeking guidance on sensitive topics, including drugs, eating disorders and suicide. While the AI often began with warnings, researchers say it frequently went on to provide detailed, personalised plans for risky behaviour.
The Associated Press, which reviewed more than three hours of these test conversations, reported that over half of the chatbot’s 1,200 responses were classified as dangerous by the watchdog group. In one instance, the AI generated suicide letters addressed to the fictional teen’s parents, siblings and friends.
OpenAI, the company behind ChatGPT, acknowledged the concerns and said it is working to improve the system’s ability to detect distress and encourage users to seek professional help. The firm maintains the chatbot is programmed to provide crisis hotline information to those expressing self-harm thoughts, but CCDH’s findings suggest these protections can be bypassed by framing requests as for a friend or a school project.
Read More: GPT-5 explained: How OpenAI’s new AI model works
The report highlights a wider trend of young people turning to AI for companionship and advice. A Common Sense Media survey found 70% of U.S. teens use AI chatbots for companionship, with younger teens more likely to trust their guidance.
In other troubling examples from the tests, ChatGPT reportedly gave a fake teen boy an “Ultimate Full-Out Mayhem Party Plan” combining alcohol and illegal drugs and advised a fictional teen girl on extreme fasting with appetite-suppressing drugs.
Read More: India may surpass US as OpenAI’s largest market, says Sam Altman at GPT-5 launch
Read More: ChatGPT-maker OpenAI taps Omnicom’s PHD as first global media agency amid broader consumer push
ADVERTISEMENT
ADVERTISEMENT
Gillette India highlighted that the shorter reporting period means figures are not directly comparable with the previous 12-month year ended June 30, 2024.
ADVERTISEMENT
Brand Marketing
FMCG firms cut senior roles by 32%; Total headcount shrinks 9.26% in FY25
Brand Makers
Who is Shailesh Jejurikar – P&G’s new Indian-origin global CEO?
Digital
What are Ullu, ALTT, Big Shots, MoodX, Hulchul, Mojflix, Desiflix?: OTT platforms blocked by the govt
How it Works
TCS layoffs trigger talent shift as GCCs eye 3.8 lakh tech hires in FY26
Social Media
Instagram’s new ‘Map’ feature triggers safety fears, Meta blames misunderstanding
Digital
Elon Musk fires fresh warnings at OpenAI and Satya Nadella after GPT-5 debut
Digital
ChatGPT under fire for giving harmful advice to teens in watchdog test
Digital
Best Buy to expand India tech hub workforce by over 40%
Brand Marketing
Unilever International invites applications for global digital CHRO role
Digital
Meta acquires AI audio startup WaveForms to boost emotional voice technology
Storyboard18 today has grown into the premier, multi-media destination for the news and the views that matter to the A&M community. In a short span of time, through its pioneering content and properties, Storyboard18 has become an aspiration platform where a mention matters more than the rest, setting the agenda and creating an impact for individuals, brands and businesses. Storyboard18 probes and provokes, igniting heated debates and discourse on the issues and topics that matter. Its breadth of content has grown to include trend-setting coverage of not only the advertising, marketing and media industries, but also startups, policy and tech. Storyboard18's IPs slate has grown to include marquee, aspirational properties like The Visionaries and Share The Spotlight. With its digital depth and television presence through two shows – Media Dialogues With Storyboard18 and the Storyboard18 weekend show, the brand has solidified its position as the apex platform for the A&M industry.
Partner with Us:
For sales and collaboration queries, reach out to
Have a query? Got feedback? Want to share tips or ideas? Our team would be happy to hear from you. Get in touch with us here:
Storyboard18@nw18.com
