GPT-4 wins chatbot lawyer contest – but is still not as good as humans – New Scientist

Advertisement
Explore by section
Explore by subject
Explore our products and services
Several AI chatbots were tested to see how well they could perform legal reasoning and tasks used by human lawyers in everyday practice – GPT-4 performed the best, but still wasn’t great
By Jeremy Hsu
5 September 2023

AI is increasingly being used by lawyers, but chatbots still don’t do that well at everyday legal tasks
WESTOCK PRODUCTIONS/Shutterstock
Compared with other AI chatbots, GPT-4 performs best on a test of legal reasoning – but it still falls short of the knowledge required for human lawyers. Early attempts to use AI chatbots in courtrooms have sometimes proven disastrous, and this finding adds to evidence that AI isn’t ready to handle the complexities of real-world legal arguments.
Artificial intelligence researchers and lawyers worked together to design LegalBench, which evaluates how well AI chatbots …
Advertisement
To continue reading, subscribe today with our introductory offers
No commitment, cancel anytime*
Offer ends 14th June 2023.
*Cancel anytime within 14 days of payment to receive a refund on unserved issues.
Inclusive of applicable taxes (VAT)
Existing subscribers
Advertisement
Explore the latest news, articles and features
News
Subscriber-only
Analysis
Free
News
Subscriber-only
Culture
Subscriber-only
Trending New Scientist articles
1
2
3
4
5
6
7
8
9
10
Advertisement
Download the app

source