Even Google Insiders Are Questioning Bard AI Chatbot’s Usefulness – Yahoo Finance
(Bloomberg) — For months, Alphabet Inc.’s Google and Discord Inc. have run an invitation-only chat for heavy users of Bard, Google’s artificial intelligence-powered chatbot. Google product managers, designers and engineers are using the forum to openly debate the AI tool's effectiveness and utility, with some questioning whether the enormous resources going into development are worth it.
Most Read from Bloomberg
Israel Latest: Hamas Leaders Targeted as Ground War Looms
Apollo CEO Marc Rowan Demands UPenn Leaders Quit Over ‘Antisemitism’
Goldman Sues Malaysia as 1MDB Settlement Dispute Escalates
IMF Caught Off Guard as China Strikes Sri Lanka Debt Deal
House Republicans Pick Scalise as Speaker Nominee in Trump Snub
“My rule of thumb is not to trust LLM output unless I can independently verify it,” Dominik Rabiej, a senior product manager for Bard, wrote in the Discord chat in July, referring to large language models — the AI systems trained on massive amounts of text that form the building blocks of chatbots like Bard and OpenAI Inc.’s ChatGPT. “Would love to get it to a point that you can, but it isn’t there yet.”
“The biggest challenge I’m still thinking of: what are LLMs truly useful for, in terms of helpfulness?” said Googler Cathy Pearl, a user experience lead for Bard, in August. “Like really making a difference. TBD!”
Ever since Google released Bard, its answer to OpenAI’s popular ChatGPT bot, in March, it has added a steady stream of new features to the product, including the capability for the AI tool to analyze photos and generate responses to queries in dozens of languages. Last month, Google unveiled its most ambitious update yet: connecting Bard to its most popular services, such as Gmail, Maps, Docs and YouTube. The company rolled out the app integrations, starting in English, on Sept. 19.
But as Google has further integrated Bard into its core products, the company has also been beset with complaints about the tool generating made-up facts and giving potentially dangerous advice. The same day the company introduced app extensions, it also announced a Google search button on Bard to help people double-check the tool’s AI-generated responses for factuality against results from its search engine.
Other experts have raised concerns about the working conditions of the thousands of low-paid contractors training Bard, based on what the workers say are convoluted instructions that they’re asked to complete in minutes. Inside and outside the company, the internet-search giant has been criticized for providing low-quality information in a race to keep up with the competition, while brushing aside ethical concerns.
For Google, ensuring the success of its Bard AI chatbot is of utmost importance. The company is far and away the leader in search, its financial lifeblood that generates about 80% of parent company Alphabet’s revenue. But as generative AI has exploded onto the scene, Google’s search dominance has been challenged, with some predicting that the new and buzzy tools from OpenAI and other startups could upend Google’s powerful position in the market.
Two participants on Google’s Bard community on chat platform Discord shared details of discussions in the server with Bloomberg from July to October. Dozens of messages reviewed by Bloomberg provide a unique window into how Bard is being used and critiqued by those who know it best, and show that even the company leaders tasked with developing the chatbot feel conflicted about the tool’s potential. Expounding on his answer about “not trusting” responses generated by large language models, Rabiej suggested limiting people’s use of Bard to “creative / brainstorming applications.” Using Bard for coding was a good option too, Rabiej said, “since you inevitably verify if the code works!”
The debate about Bard’s limitations and potential on Google’s Discord channel is a “routine and unsurprising” part of product development, Google said in a statement. “Since launching Bard as an experiment, we’ve been eager to hear people’s feedback on what they like and how we can further improve the experience,” said Jennifer Rodstrom, a Google spokesperson. “Our discussion channel with people who use Discord is one of the many ways we do that.” The company added that it launched the Discord server as an invitation-based community ahead of making it more widely accessible.At Bard’s launch, the company was upfront about its limitations, including about the possibility for the AI tool to generate convincing-sounding lies. Anytime someone uses Bard, Google includes a disclaimer on the tool that states: “Bard may display inaccurate or offensive information that doesn’t represent Google’s views.” Company representatives have also said that Google carried out adversarial testing — meant to probe how it would respond to potential bad actors — internally before Bard was rolled out, and that the company expects to learn more as the public continues to use it. Read More: Google’s AI Bot Trained by ‘Scared, Stressed, Underpaid’ Workers
The Discord server was started back in July, when thousands of invites were sent out to frequent users of Bard outside the company. “Share thoughts and ideas directly with the team behind Bard, get early notifications about product updates, and connect with other AI enthusiasts,” the invitation, sent on July 10, said. The server description calls the channel the “official” community for Bard users, and Bard’s senior product director, Jack Krawczyk, sent a selfie video to the community as the tool launched in Europe.
Discord didn’t respond to a request for comment about the chat.
Almost 9,000 people are currently members of the online community, and a few of the chat’s moderators are employees of Discord. Most discussions revolve around cheerleading Bard and AI; some users made fantastical, and likely misguided, claims about the tool’s capabilities, including that they had built a quantum chess computer using Bard or that they could use the bot to trawl the web for data on baseball betting odds and run complex simulations. (Google employees chimed in on the Discord chat to say that Bard didn’t have those capabilities.)
Daniel Griffin, a recent Ph.D. graduate from University of California at Berkeley who studies web search and joined the Discord group in September, said it isn’t uncommon for open source software and small search engine tools to have informal chats for enthusiasts. But Griffin, who has written critically about how Google shapes the public’s interpretations of its products, said he felt “uncomfortable” that the chat was somewhat secretive.
The Bard Discord chat may just be a “non-disclosed, massively-scaled and long-lasting focus group or a community of AI enthusiasts, but the power of Google and the importance of open discussion of these new tools gave me pause,” he added, noting that the company’s other community-feedback efforts, like the Google Search Liaison, were more open to the public.
Over in the Bard forum, users brought up other thorny Google-related issues, giving insight into how the tech giant works hard to mitigate public criticism. In mid-July, a member of the group raised the subject of Project Nimbus, a $1.2 billion contract for Google and Amazon.com Inc. to supply Israel’s military with artificial intelligence tools, according to a Bloomberg review of the messages. The member had raised concerns about Google’s role in enabling lethal uses of AI, and was swiftly banned from the group, with the moderators telling users they must avoid “politics, religion, or other sensitive topics” in the chat.
That same month, another user questioned why Google had relied on “underpaid and overworked contractors” in order to refine Bard’s responses. Though the company has publicly stated that it isn’t only relying on contractors to improve the AI powering Bard, and that there are a number of other methods for improving its accuracy and quality, Tris Warkentin, a Bard director of product management, responded by emphasizing the importance of human input to train Bard’s algorithms.
“Human refinement is critical so that Bard can be a product for everyone; the alternative is that users have no ability to guide the product’s functionality, which would be a huge mistake in my opinion,” Warkentin wrote in the chat. “We don’t need an ‘ivory tower’ product — we need something that can work for everyone!”
People also exchanged views about the consequences of the enormous costs needed to maintain large language models. “Is any work being done on reducing the staggering resource costs of LLMs?” asked one user in the Discord server. “Particularly the water usage per query, and the massive need for GPUs (which require extensive mining to produce)?”
“I kind of look at it like chip design… or supercomputers,” Pearl, the Bard user experience lead, responded. “I believe we will continue to find ways to get the same behavior with less resources.”
Concerns about Bard’s accuracy have also abounded in the chat. Warkentin, the product manager, stressed in a discussion about Bard’s fabrications that Google had made strides since the AI tool was released. “We are very focused on reducing hallucination and increasing factuality; it’s one of our key success metrics,” he said. “We’ve improved quite a bit since launch, but it’s ongoing work, so please keep trying and sending us feedback when something is not right!”
In late September, the official Bard account on Discord posted a question-and-answer summary of an “office hours” event, which aimed to address the community’s questions about Bard’s newly announced integrations with Google apps. In response to a question about whether there was any chance of Bard deviating from reality while summarizing emails, the official Bard account said: “We’ve done our best to make sure this happens as little as possible. But since Bard is still learning and growing, it could happen.” People should check the sources Bard uses, and refer back to them, the account said. “If Bard does hallucinate with any of the integrations, please let us know in the bug reports channel!”
Rabiej, the Bard product manager, also underlined the importance of the AI tool’s new “Double-check the responses” button. “It’ll highlight stuff that is probably not correct in orange,” he said in October. He also reiterated that Bard doesn’t have any true understanding of the text it ingests, but that the tool simply responds with more text, depending on a user’s prompts: “Remember, Bard, as any large language model, is generative — it is not looking up stuff and summarizing it for you, it is generating text.”
Other employees voiced ambivalence about generative artificial intelligence more broadly. “Taking a step back from my generally negative outtake on the impact that Gen AI could have, I do think education is one of the most interesting and possible highest ‘do good areas’ for this tech,” said James, a user experience designer for Bard, in the Discord community.
Institutions from higher and lower education might use the technology to “help create richer experiences for students by having almost 24/7 access to support on different subjects,” James said, “once the general scare of it is over.”
Most Read from Bloomberg Businessweek
The War in Israel Shows How Social Media’s Idealistic Era Has Ended
The K-Pop Mogul Behind BTS Is Building the Next BTS
Business Schools Aim to Build Entrepreneurs With Expanded Programs
Worst US Bond Selloff Since 1787 Marks End of Free-Money Era
Has Bob Iger Lost the Magic?
©2023 Bloomberg L.P.
Google, Amazon and Cloudflare have all recently been victims of attacks just weeks just weeks after casino operators MGM Resorts (MGM) and Caesars Entertainment (CZR) were targeted.
Microsoft and Alphabet's Google introduced new AI Initiatives to help organizations in the health care industry improve their use of data and access to information.
Bloomberg Google's AI Dilemma – Bard's Promise Versus Ethical Concerns Alphabet Inc (NASDAQ: GOOG) (NASDAQ: GOOGL) Google and Discord Inc have been hosting an exclusive chat for avid users of Bard, Google's AI-powered chatbot. Integrating Bard into core Google services like Gmail, Maps, Docs, and YouTube has not been without challenges. Ransom Rebels! MGM Hackers Waited For Days Before Issuing Financial Demands MGM Resorts International's (NYSE: MGM) Chief Executive Officer, Bill Hornbuckle, rep
Cathie Wood’s investing philosophy is based on unwavering conviction in a portfolio heavily favoring high-growth names with disruptive qualities. But against an economic backdrop of soaring inflation and high interest rates, that strategy wilted during 2021 and 2022. However, Wood’s Ark Invest’s flagship ARKK fund appears to have got its mojo back this year, and looking ahead to the post-high rate landscape, that is something Wood expects will continue. “The fear of rising interest rates hurt ou
The U.S. Space Force has paused the use of web-based generative artificial intelligence tools like ChatGPT for its workforce over data security concerns, according to a memo seen by Reuters. A memo dated Sept. 29 and addressed to Guardians, the name Space Force calls its workforce, prohibits personnel from using such AI tools including large-language models on government computers until they receive formal approval by the force's Chief Technology and Innovation Office. It said the temporary ban was "due to data aggregation risks."
Cramer in 2021 said he sold most of his bitcoin holdings.
Hacktivist groups say they are hitting Israeli targets online amid the war in Israel and Gaza, disrupting and defacing websites like the Jerusalem Post. The conflict between Israel and its Arab neighbors routinely attracts both intense global interest and politically minded hackers – dubbed hacktivists – who piggyback on the fighting, either to support their favored side or simply get attention. "There are dozens of victims per day, claimed by both pre-established and new (hacktivist) groups," cyber intelligence firm Recorded Future said.
The Google Pixel 7a is now available for just $399 this Amazon Prime Day.
(Bloomberg) — Intel Corp. Chief Executive Officer Pat Gelsinger has embarked on one of the largest factory-building sprees in chip-industry history, part of an audacious plan to revitalize the Silicon Valley pioneer. But he’s missing a key ingredient: enough paying customers. Most Read from BloombergIsrael Latest: Hamas Leaders Targeted as Ground War LoomsApollo CEO Marc Rowan Demands UPenn Leaders Quit Over ‘Antisemitism’Goldman Sues Malaysia as 1MDB Settlement Dispute EscalatesIMF Caught Off
Samsung said its September quarter operating profit fell 78% but the drop wasn't as sharp as in previous quarters. Micron and Intel could benefit from signs of a chip recovery.
Software growth stocks outperformed in the first half of 2023. But will the artificial intelligence-driven rally be sustainable for software stocks?
BlackBerry (BB) unveils its latest UEM to manage, monitor, and secure organizations end-user devices.
Although it is quite a quiet week earnings-wise with big lenders yet to kick off bank earnings and the third quarter earnings season on Friday, things are never dull in the tech universe. Microsoft Corporation (NASDAQ: MSFT) and Alphabet Inc (NASDAQ: GOOG)(NASDAQ: GOOGL)-owned Google introduced new AI initiatives to support the healthcare industry and Google made another step to towards a password-free future it announced back in May. Google Is Getting Ready To Make Passwords History On Tuesday,
Google's Pixel 8 and Pixel 8 Pro bring new generative AI features to the company's smartphones.
Here are the best speaker deals we could find for October Prime Day 2023.
These are the best deals on headphones and earbuds that you can get for October Prime Day this year.
Amid hype over artificial intelligence and ChatGPT, the best AI stocks generate sales or get a strategic edge from the fast maturing technology.
These are the best deals on TVs and media streamers that you can buy for October Prime Day this year.
T-Mobile holds an edge in 5G wireless spectrum but will its market share gains vs. rivals continue? A big stock buyback is underway.
Samsung Galaxy S23 devices have dropped to record-low prices during Amazon's October Prime day event. The Galaxy S23 Ultra with 256GB of storage is $250 off at $950.
