British officials say AI chatbots could carry cyber risks – Reuters
AI (Artificial Intelligence) letters are placed on computer motherboard in this illustration taken, June 23, 2023. REUTERS/Dado Ruvic/Illustration/File Photo Acquire Licensing Rights
Aug 30 (Reuters) – British officials are warning organisations about integrating artificial intelligence-driven chatbots into their businesses, saying that research has increasingly shown that they can be tricked into performing harmful tasks.
In a pair of blog posts published Wednesday, Britain's National Cyber Security Centre (NCSC) said that experts had not yet got to grips with the potential security problems tied to algorithms that can generate human-sounding interactions – dubbed large language models, or LLMs.
The AI-powered tools are seeing early use as chatbots that some envision displacing not just internet searches but also customer service work and sales calls.
The NCSC said that could carry risks, particularly if such models were plugged into other elements organisation's business processes. Academics and researchers have repeatedly found ways to subvert chatbots by feeding them rogue commands or fool them into circumventing their own built-in guardrails.
For example, an AI-powered chatbot deployed by a bank might be tricked into making an unauthorized transaction if a hacker structured their query just right.
"Organisations building services that use LLMs need to be careful, in the same way they would be if they were using a product or code library that was in beta," the NCSC said in one its blog posts, referring to experimental software releases.
"They might not let that product be involved in making transactions on the customer's behalf, and hopefully wouldn't fully trust it. Similar caution should apply to LLMs."
Authorities across the world are grappling with the rise of LLMs, such as OpenAI's ChatGPT, which businesses are incorporating into a wide range of services, including sales and customer care. The security implications of AI are also still coming into focus, with authorities in the U.S. and Canada saying they have seen hackers embrace the technology.
A recent Reuters/Ipsos poll found many corporate employees were using tools like ChatGPT to help with basic tasks, such as drafting emails, summarising documents and doing preliminary research.
Some 10% of those polled said their bosses explicitly banned external AI tools, while a quarter did not know if their company permitted use of the technology.
Oseloka Obiora, chief technology officer at cybersecurity firm RiverSafe, said the race to integrate AI into business practices would have "disastrous consequences" if business leaders failed to introduce the necessary checks.
"Instead of jumping into bed with the latest AI trends, senior executives should think again," he said. "Assess the benefits and risks as well as implementing the necessary cyber protection to ensure the organisation is safe from harm."
Reporting by Raphael Satter; Editing by Alex Richardson
Our Standards: The Thomson Reuters Trust Principles.
Thomson Reuters
Reporter covering cybersecurity, surveillance, and disinformation for Reuters. Work has included investigations into state-sponsored espionage, deepfake-driven propaganda, and mercenary hacking.
The surprise launch of the latest high-end smartphone from Chinese tech giant Huawei Technologies (HWT.UL) has triggered an international guessing game over what is inside it.
Reuters, the news and media division of Thomson Reuters, is the world’s largest multimedia news provider, reaching billions of people worldwide every day. Reuters provides business, financial, national and international news to professionals via desktop terminals, the world's media organizations, industry events and directly to consumers.
Build the strongest argument relying on authoritative content, attorney-editor expertise, and industry defining technology.
The most comprehensive solution to manage all your complex and ever-expanding tax and compliance needs.
The industry leader for online information for tax, accounting and finance professionals.
Access unmatched financial data, news and content in a highly-customised workflow experience on desktop, web and mobile.
Browse an unrivalled portfolio of real-time and historical market data and insights from worldwide sources and experts.
Screen for heightened risk individual and entities globally to help uncover hidden risks in business relationships and human networks.
All quotes delayed a minimum of 15 minutes. See here for a complete list of exchanges and delays.
© 2023 Reuters. All rights reserved
