Can AI destroy humanity? ChatGPT maker OpenAI forms team to study risks | Mint – Mint
ChatGPT maker OpenAI is creating a team to study the catastrophic risks posed by the ‘frontier A’I’ models created by the company. The new team called Preparedness will look at some serious threats posed by artificial intelligence technologies including Chemical, biological, radiological, and nuclear (CBRN) threats.
In a blogpost about the new initiative, OpenAI wrote, “To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.”
“We believe that frontier AI models, which will exceed the capabilities currently present in the most advanced existing models, have the potential to benefit all of humanity. But they also pose increasingly severe risks.” the Sam Altman led company noted.
OpenAI noted that the company is aiming to minimize the risks posed by AI models as they continue to improve with the new ‘Preparedness’ team that will led by Aleksander Madry, Director of Massachusetts Institute of Technology’s Center for Deployable Machine Learning and will now be on leave to join OpenAI, Forbes reported.
The new team will “tightly connect capability assessment, evaluations, and internal red teaming for frontier models, from the models we develop in the near future to those with AGI-level capabilities.”
Moreover, the Preparedness team will also track, evaluate, forecast and prepare against catastrophic risks spanning multiple categories like individualized persuasion, cybersecurity, chemical, biological, radiological, and nuclear (CBRN) threats, autonomous replication and adaptation (ARA).
The mission of the Preparedness team will also involve developing a Risk-Informed Development Policy (RDP) which will detail OpenAI’s approach to developing future AI models, taking protective measures and establishing a government structure for accountability and oversight.
Moreover, OpenAI has also launched an AI Preparedness Challenge to give ideas on catastrophic misuse prevention. The company is willing to offer $25,000 in API credits to the top 10 submissions.
“Exciting news! Mint is now on WhatsApp Channels 🚀 Subscribe today by clicking the link and stay updated with the latest financial insights!” Click here!
Download the Mint app and read premium stories
Log in to our website to save your bookmarks. It’ll just take a moment.
You are just one step away from creating your watchlist!
Oops! Looks like you have exceeded the limit to bookmark the image. Remove some to bookmark this image.
Your session has expired, please login again.
You are now subscribed to our newsletters. In case you can’t find any email from our side, please check the spam folder.
This is a subscriber only feature Subscribe Now to get daily updates on WhatsApp