How to protect against and benefit from generative AI hallucinations – MarTech
mt logo
MarTech » Marketing artificial intelligence (AI) »
Opinions expressed in this article are those of the sponsor. MarTech neither confirms nor disputes any of the conclusions presented below.
MarTechBot:
As marketers start using ChatGPT, Google’s Bard, Microsoft’s Bing Chat, Meta AI or their own large language models (LLM), they must concern themselves with “hallucinations” and how to prevent them.
IBM provides the following definition for hallucinations: “AI hallucination is a phenomenon wherein a large language model—often a generative AI chatbot or computer vision tool—perceives patterns or objects that are nonexistent or imperceptible to human observers, creating outputs that are nonsensical or altogether inaccurate.
“Generally, if a user makes a request of a generative AI tool, they desire an output that appropriately addresses the prompt (i.e., a correct answer to a question). However, sometimes AI algorithms produce outputs that are not based on training data, are incorrectly decoded by the transformer, or do not follow any identifiable pattern. In other words, it ‘hallucinates’ the response.”
Suresh Venkatasubramanian, a professor at Brown University who helped co-author the White House’s Blueprint for an AI Bill of Rights, said in a CNN blog post that the problem is that LLMs are simply trained to “produce a plausible-sounding answer” to user prompts.
“So, in that sense, any plausible-sounding answer, whether accurate or factual or made up or not, is a reasonable answer, and that’s what it produces. There is no knowledge of truth there.”
He said that a better behavioral analogy than hallucinating or lying, which carries connotations of something being wrong or having ill-intent, would be comparing these computer outputs to how his young son would tell stories at age four.
“You only have to say, ‘And then what happened?’ and he would just continue producing more stories,” Venkatasubramanian added. “And he would just go on and on.”
If hallucinations were “black swan” events – rarely occurring – they would be something marketers should be aware of but not necessarily pay much attention to.
However, according to studies from Vectara, chatbots fabricate details in at least 3% of interactions – and as much as 27%, despite measures taken to avoid such occurrences.
“We gave the system 10 to 20 facts and asked for a summary of those facts,” Amr Awadallah, Vectara’s chief executive and a former Google executive, said in an Investis Digital blog post. “It is a fundamental problem that the system can still introduce errors.”
According to the researchers, hallucination rates may be higher when chatbots perform other tasks (beyond mere summarization).
Despite the potential challenges posed by hallucinations, generative AI offers plenty of advantages. To reduce the possibility of hallucinations, we recommend:
However, as dangerous as they can potentially be, hallucinations can have some value, according to FiscalNote’s Tim Hwang.
In a Brandtimes blog post, Hwang said: “LLMs are bad at everything we expect computers to be good at,” he says. “And LLMs are good at everything we expect computers to be bad at.”
He further explained, “So using AI as a search tool isn’t really a great idea, but ‘storytelling, creativity, aesthetics – these are all things that the technology is fundamentally really, really good at.’”
Since brand identity is basically what people think about a brand, hallucinations should be considered a feature, not a bug, according to Hwang, who added that it’s possible to ask AI to hallucinate its own interface.
So, a marketer can provide the LLM with any arbitrary set of objects and tell it to do things you wouldn’t usually be able to measure, or it would be costly to measure through other means – effectively prompting the LLM to hallucinate.
An example the blog post mentioned is assigning objects with a specific score based on the degree to which they align with the brand, then giving AI a score and asking for consumers who are more likely to become lifelong consumers of the brand based on that score.
“Hallucinations really are, in some ways, the foundational element of what we want out of these technologies,” Hwang said. “I think rather than rejecting them, rather than fearing them, I think it’s manipulating these hallucinations that will create the biggest benefit for people in the ad and marketing space.”
A recent application of hallucinations is exemplified by the “Insights Machine,” a platform that empowers brands to create AI personas based on detailed target audience demographics. These AI personas interact as genuine individuals, offering diverse responses and viewpoints.
While AI personas may occasionally deliver unexpected or hallucinatory responses, they primarily serve as catalysts for creativity and inspiration among marketers. The responsibility for interpreting and utilizing these responses rests with humans, underscoring the foundational role of hallucinations in these transformative technologies.
As AI takes center stage in marketing, it is subject to machine error. That fallibility can only be checked by humans—a perpetual irony in the AI marketing age.
Pini Yakuel, co-founder and CEO of Optimove, wrote this article.
Related stories
New on MarTech
About the author
Related topics
Get the daily newsletter digital marketers rely on.
See terms.
Discover time-saving technologies and actionable tactics that can help you overcome crucial marketing challenges.
Online March 19-20, 2024: MarTech spring
Online Sept. 24-25, 2024: MarTech fall
Learn actionable search marketing tactics that can help you drive more traffic, leads, and revenue.
Start training now:: SMX Advanced
November 14-15, 2022: SMX Next
March 8-9, 2022: Master Classes
Why we care about AI in marketing
Welcome to MarTechBot
Using AI to improve customer experience and customer journey orchestration
Leverage AI-driven SEO to Increase Traffic, Revenue and Online Reputation
AI-Forward Marketing: Your Roadmap to Revenue Growth in 2024
Power Up Your Marketing Programs with Google Analytics 4 and Salesforce Marketing Cloud
Identity Resolution Platforms: A Marketer’s Guide
Email Marketing Platforms: A Marketer’s Guide
Customer Data Platforms: A Marketer’s Guide
Nailing Speed to Lead
Meet your new AI-powered marketing assistant!
Get the must-read newsletter for marketers.
Topics
Our events
About
Follow us
© 2024 Third Door Media, Inc. All rights reserved.
Third Door Media, Inc. is a publisher and marketing solutions provider incorporated in Delaware, USA, with an address 88 Schoolhouse Road, PO Box 3103, Edgartown, MA 02539. Third Door Media operates business-to-business media properties and produces events. It is the publisher of MarTech.org, the leading marketing technology digital publication.