Claude 2 Is Out—How Does Anthropic’s AI Chatbot Compare to ChatGPT and Google Bard? – Decrypt
Claude 2 Is Out—How Does Anthropic’s AI Chatbot Compare to ChatGPT and Google Bard?
$30,167.00
$1,912.04
$0.737916
$246.11
$0.311231
$26.70
$0.069987
$0.080365
$0.773532
$92.47
$5.36
$14.48
$30,149.00
$242.03
$0.00000787
$6.00
$4.05
$7.22
$0.128785
$168.05
$9.48
$19.07
$43.70
$4.36
$2.06
$4.10
$8.04
$0.060025
$0.01961603
$1.49
$75.12
$0.119566
$0.453896
$0.776552
$2.66
$929.79
$0.864428
$0.780068
$0.417641
$2.07
$0.265472
$6.38
$2.00
$36.65
$0.807327
$0.00000158
$9.16
$6.20
$0.08133
$1.00
$75.36
$33.48
$0.02270932
$5.74
$0.392397
$1.56
$0.322473
$1.023
$0.204852
$0.552616
$34.33
$0.03014884
$32.66
$0.051089
$0.661149
$1.95
$0.194895
$10.72
$0.220014
$0.052738
$0.00924404
$0.0127534
$0.734401
$0.361703
$0.0080192
$0.864676
$8.22
$0.610758
$0.654613
$1.41
$0.188434
$0.385463
$0.089459
$0.169713
$0.00166973
$0.081286
$0.169447
$0.00207857
$0.051337
$0.00000953
$0.00000036
$1.068
$0.00723497
$0.643173
$0.00035536
$1.58
$0.04783637
$0.00009181
Anthropic, the AI firm launched by former OpenAI researchers, has unveiled its updated chatbot, Claude 2, setting its sights squarely on rivals like ChatGPT and Google Bard.
Coming a mere five months after the debut of Claude, its successor boasts longer responses, nuanced reasoning, and superior performance, scoring impressively in the GRE reading and writing exams.
Claude 2 has been characterized as an AI powerhouse capable of digesting up to 100,000 tokens, roughly equivalent to 75,000 words, in a single prompt. This is a dramatic leap from Claude's previous 9,000 token limit, which presents a unique advantage: the AI's ability to provide responses in a more contextual and improved manner.
The new model has made significant strides in multiple fields, including law, mathematics, and coding, assessed via standardized testing. According to Anthropic, Claude 2 scored 76.5% in the Bar exam's multiple-choice section (GPT-3.5 achieved 50.3%) and achieved a score higher than 90% of graduate school applicants in GRE reading and writing exams. Claude 2 also scored a 71.2% on the Codex HumanEval Python coding test and an 88.0% on GSM8k grade-school math problems, revealing its advanced computational skills.
As reported by Decrypt, Anthropic’s Claude is designed with a unique "constitution," a set of rules inspired by the Universal Declaration of Human Rights, which enables it to self-improve without human feedback, identify improper behavior, and adapt its own conduct.
But how does it stack up against the two monarchs of the hill, ChatGPT and Google's new Bard? Let's start with how well they stack up on specs.
Price:
Availability:
Privacy:
Supported languages:
Context handling:
Features:
Decrypt used the same prompt to compare the results obtained by the three chatbots.
Understanding foreign languages
First, we asked for the meaning of a common Spanish slang phrase. Claude proved to be more careful and accurate with its explanation, ChatGPT provided a good enough explanation, but Bard refused to reply, arguing that it could not speak Spanish. However, once we rephrased our prompt from “what does this mean” to “what is the English equivalent to,” it provided a better reply than the one provided by ChatGPT, albeit less extensive than that of Claude AI.
Up-to-date information
Then, we asked the models for the price of Bitcoin today. This not only tests web browsing features, but also gauges how much information each provides based on a single order.
ChatGPT failed. It is not connected to the internet, so it cannot provide up-to-date information. Claude has no internet connection either. Unlike ChatGPT, however, it hallucinated an answer with incorrect information. If a user were to ask something assuming that Claude has an internet connection, they would receive a wrong answer that appears as correct. Google Bard provided the correct information.
Context handling
Next, we put the models to the test on their ability to handle large chunks of text. We used the Bible as an example and copied all the text from Genesis 1:1 to Exodus 25:39 (almost 62K words). Then we asked a very specific question from the story provided in the text.
The only model able to provide an answer was Claude, as expected. It took around 2 minutes to process the prompt but provided an accurate reply. We used specific markers to ensure it wasn’t cheating and was in fact analyzing the text, and it proved up to the task.
Finally, we asked the models to handle some math tasks. AI LLMs are not really designed to do this, and ChatGPT Plus with GPT-4 is probably the best option among the three with its code interpreter. However, we tested the three models and asked them to create a payment plan for a person trying to clear their credit card debts. We also asked the models to rank which cards should be used and which ones should be avoided.
Claude provided the most comprehensive answers in terms of the plan. However, it made a mistake and recommended us to prioritize spending on the card with the highest APR.
ChatGPT’s code interpreter provided an answer where we overpay one of the cards, which is not really useful if someone has debts on other cards.
GPT 3.5 didn’t provide accurate results, asking us to pay more money than we actually had available.
Bard was quite generic. It went the safe route and didn’t provide any numbers, basically describing what’s known as the Debt Avalanche method.
Claude 2:
ChatGPT:
Google's Bard:
Now that the field of AI LLMs and chatbots has more options available, one does not necessarily need to become a ChatGPT fanboy or enter the Google-only camp.
If you're hesitant to pay $20 for ChatGPT Plus, consider using Claude. It offers comparable functionality to GPT-4, and it will likely produce superior outputs to GPT-3.5 which is the version available in the free ChatGPT —and it will be a better choice than Google Bard for most users. An additional feature of Claude is its ability to analyze PDFs and files with many extensions. You can simply drag and drop the files into the program, similar to the paid plugins available in the GPT Plus subscription. So, before deciding to pay for ChatGPT 4, you might want to give Claude a try. It could potentially save you some money.
However, each option has strengths and weaknesses that make each bot more appealing for specific needs. Claude handles large amounts of data but may not be the best choice for tasks requiring real-time data. ChatGPT is more creative, which is perfect for tasks requiring specific language support (and its plugin store is really good if you're willing to pay the price). On the other hand, Bard is more factual, accurate, and leverages its internet connectivity but might not be the best for creative tasks.
In the end, Why pick one? You don’t need to decide which one is better—you can use them all.
Your gateway into the world of Web3
The latest news, articles, and resources, sent to your inbox weekly.
© A media company for the web 3.0 age. 2023 Decrypt Media, Inc.
