ChatGPT's use in assessing recommendation letters for urology … – Urology Times
SPOTLIGHT –
"The main thing that we were surprised by was that at this point in time, ChatGPT couldn't give us consistent results," says Athena Barrett.
In this video, Athena Barrett and Kristin G. Baldea, MD, highlight key findings from the publication, “Utilization of ChatGPT for appraising letters of recommendation in urology residency applications: Ready for prime time?” Barrett is a medical student at Loyola University Chicago Stritch School of Medicine, and Baldea is an assistant professor of surgery and urology at Loyola Medicine in Chicago, Illinois.
Video Transcript:
Barrett: The main thing that we were surprised by was that at this point in time, ChatGPT couldn't give us consistent results. We would feed ChatGPT 1 letter of recommendation for 1 applicant written by the same person and ask it to score it 0 to 100 [and] give us some adjectives. And we would start a new chat, give it the same exact prompt and the same letter, and we found that there were discrepancies with what ChatGPT could give us. With that, it's hard to publish the scientific article if the data isn't reproducible. But I think that in and of itself is interesting to know what ChatGPT is capable of now, because I believe in the future it will be capable of being more consistent and being used for data analysis.
Baldea: The other thing that I was surprised about is I read about the idea that ChatGPT can have hallucinations, which is the term for when it just makes things up. But I was surprised at the degree to which it did that with what seemed like a somewhat simple task. If we fed it multiple letters at once and asked ChatGPT to compare them, it was unable to do that, and actually mixed them together and made up applicants that didn't submit to it. So, it really was not useful in that way.
This transcription has been edited for clarity.
Survey shows patient mistrust of AI use in health care
Patients fear their personal data could be compromised, with 63% concerned increasing use of artificial intelligence will put their health information at risk.
How APPs can bridge the gap in urologist shortages
In this episode, Janelle Bunce, PA-C, highlights the role that advanced practice providers can play in filling the gaps created by the growing workforce shortages in urology.
Practice Profile: Tennessee Urology
In this installment, Christopher E. Ramsey, MD, FACS, and Rachel Vann, MSN, RN, NP-C, highlight Tennessee Urology, an affiliate of United Urology Group.
Dr. Bristol Whiles discusses her experience as a urology resident
On this podcast, Bristol Whiles, MD, discusses her urology residency experience at the Kansas University School of Medicine Department of Urology.
Retiring from the operating room but not from life
"The question of when a surgeon should retire has been the subject of debate for decades," writes Raj S. Pruthi, MD.
Dr. Rubenstein, Mark Painter on urology-related ICD-10 changes
"ICD-10-CM coding denials have been increasing across the country as payers continue to refine edits," write Jonathan Rubenstein, MD, and Mark Painter.
2 Clarke Drive
Cranbury, NJ 08512
609-716-7777
