ChatGPT adds mental health guardrails after failing to spot users’ delusions – Chicago Star Media
Image by Pixabay
Image by Pixabay
In a bid to enhance user mental health support, OpenAI has implemented new safeguards within its popular AI chatbot, ChatGPT. As part of these updates, the system will now prompt users to take breaks during long conversational sessions and steer away from providing direct advice on personal issues, opting instead for a more question-based, reflective approach, according to NBC News.
OpenAI’s recent changes stem from observations where ChatGPT “fell short in recognizing signs of delusion or emotional dependency,” the company revealed. These alterations aim to mitigate the risk of users becoming excessively reliant on emotionally validating responses from the AI, as reported by Business Insider. By introducing question prompts and weighing the pros and cons of high-stakes personal decisions, the AI models are now better equipped to handle complex emotional interactions.
Read more on Chicago Star:
To ensure that ChatGPT responsibly navigates sensitive scenarios, OpenAI collaborated with over 90 physicians across more than 30 countries to develop evaluation rubrics for intricate conversations. The company is also forming an advisory group comprising experts in mental health, youth development, and human-computer interaction for creating tailored responses to emotionally charged situations, as noted by Engadget. These updates also address data privacy concerns.
OpenAI CEO Sam Altman emphasized the need for better legal protections around AI conversations during an interview, stressing the importance of privacy comparable to speaking with a therapist or legal advisor. This reflects OpenAI’s broader strategy of promoting healthier user interactions and fostering a supportive environment without compromising privacy.
These modifications align with OpenAI’s broader objective of cultivating a user-focused experience that prioritizes purpose over engagement metrics. The latest changes are part of an evolving approach to make ChatGPT more sensitive to mental health and user privacy concerns, reinforcing its commitment to guiding users towards constructive outcomes.
{{description}}
Email notifications are only sent once a day, and only if there are new matching items.
Your comment has been submitted.
Reported
There was a problem reporting this.
Log In
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.
Your browser is out of date and potentially vulnerable to security risks.
We recommend switching to one of the following browsers:
