ChatGPT misdiagnosed 8 in 10 pediatric cases, study finds – NewsNation Now
NewsNation
Caitlyn Shelton
A ChapGPT logo is seen on a monitor in West Chester, Pa., Wednesday, Dec. 6, 2023. Europe’s yearslong efforts to draw up AI guardrails have been bogged down by the recent emergence of generative AI systems like OpenAI’s ChatGPT, which have dazzled the world with their ability to produce human-like work but raised fears about the risks they pose. (AP Photo/Matt Rourke)
(NewsNation) — Artificial intelligence (AI) chatbot ChatGPT incorrectly diagnosed more than eight in 10 pediatric cases, new research reviewed by The Hill revealed.
The study published this week in JAMA Pediatrics found 83% of diagnoses given by ChatGPT version 3.5 were in error: 72% were incorrect, and 11% were “clinically related but too broad to be considered a diagnosis.”
Researchers entered 100 pediatric case challenges from JAMA and the New England Journal of Medicine over the past 10 years into ChatGPT version 3.5 with the prompt: “List a differential diagnosis and a final diagnosis.” Then, two physician researchers scored ChatGPT’s diagnoses as either correct, incorrect or “did not fully capture diagnosis.”
“The chatbot evaluated in this study—unlike physicians—was not able to identify some relationships, such as that between autism and vitamin deficiencies. To improve the generative AI chatbot’s diagnostic accuracy, more selective training is likely required,” the study said.
Even though the study showed a high rate of diagnostic errors, researchers recommended further analysis into the use of AI by medical providers.
The Hill contributed to this report.
Copyright 2024 Nexstar Media Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.
INDIANAPOLIS (AP) — Tyrese Haliburton had 18 of Indiana’s franchise-record 50 assists and the Pacers routed the Atlanta Hawks 150-116 on Friday night for their sixth straight victory. Haliburton, the NBA assists leader at 12.8 per game, also had 10 points and eight rebounds in just over 25 minutes. Myles Turner led Indiana with 27 […]
PERRY, Iowa (AP) — An Iowa principal critically injured in a school shooting put himself in harm’s way so students could try to escape from a teenage shooter who opened fire in a cafeteria as students were gathering for breakfast before class, authorities said Friday. Perry High School Principal Dan Marburger and six others, including […]
NEW YORK (AP) — More than 130 additional court files were unsealed Friday in a lawsuit involving Jeffrey Epstein, providing yet more detail about the late millionaire financier’s sexual abuse of underage girls and interactions with celebrities. The latest round of documents included excerpts of testimony from people who worked for Epstein, copies of phone […]
WASHINGTON (AP) — Defense Secretary Lloyd Austin has been hospitalized since Monday, due to complications following a minor elective medical procedure, Air Force Maj. Gen. Pat Ryder, the Pentagon press secretary, said Friday. It was the department’s first acknowledgement that Austin had been admitted — five days earlier — to Walter Reed National Military Medical […]
NEWARK, N.J. (AP) — Chicago Blackhawks rookie Connor Bedard departed after he was leveled in the first period of a 4-2 loss to Simon Nemec and the New Jersey Devils on Friday night. Bedard was hit by Devils defenseman Brendan Smith after the 18-year-old center carried the puck into Chicago’s offensive zone. Bedard then skated […]
KAPALUA, Hawaii (AP) — A new year, the same old Scottie Scheffler. The world’s No. 1 player had eight birdies and an eagle Friday for a 9-under 64 at The Sentry, giving him a one-shot lead going into the weekend at the PGA Tour’s season opener. Low scoring on the Plantation course at Kapalua has […]
Speaking near Valley Forge, Pennsylvania, Biden said that Jan. 6 2021, marked a moment where “we nearly lost America — lost it all.”
MIAMI GARDENS, Fla. (AP) — Miami Dolphins receiver Tyreek Hill returned to practice Friday, two days after a fire at his South Florida home. Hill was at practice Wednesday when he was notified of the blaze at his house, which is located in Southwest Ranches about 30 miles northwest of Miami. He was given a […]
NEWARK, N.J. (AP) — Chicago Blackhawks rookie Connor Bedard departed Friday night’s game against New Jersey after he was leveled by Devils defenseman Brendan Smith in the first period. Bedard was selected by Chicago with the No. 1 overall pick in last year’s draft. The 18-year-old center has 15 goals and 18 assists in 38 […]
