Experts on what ChatGPT reveals about urology residency … – Urology Times

“What we did learn and what reinforced our beliefs [is] that [the] current way of writing reference letters is not great,” says Larissa Bresler, MD, DABMA.
In this video, Larissa Bresler, MD, DABMA, and Kristin G. Baldea, MD, highlight key findings from the publication, “Utilization of ChatGPT for appraising letters of recommendation in urology residency applications: Ready for prime time?” Bresler is an associate professor of urology, obstetrics and gynecology at Loyola Medicine in Chicago, Illinois, and the chief diversity officer and diversity & inclusion committee chair for the American Urological Association. Baldea is an assistant professor of surgery and urology at Loyola Medicine in Chicago, Illinois.

Video Transcript:
Bresler: Well, I think we all agree that Chat is not ready for primetime. At one point, the ACGME floated using it for application review and scoring. Our study as well as some industry reports outside of medicine show that it's not ready for primetime. The computing resources and the evolution of this artificial intelligence is not at the point where it's safe to use for letters of reference or for application sorting at this particular juncture. What we did learn and what reinforced our beliefs [is] that [the] current way of writing reference letters is not great. The template letters all tend to clump students in top 25%, and the narrative letters are simply not helpful. I would say 3/4 of them recount a person's CV, which is already included in applications, and the other 25% is superlative. It has these exaggerated adjectives, which Chat picked up on. And there is a repeat use of adjectives for students, which are also not helpful. So, this study shows us 2 things. One, please don't use Chat just yet. And 2, we need to find a better way of writing reference letters that is actually helpful to program directors and committees, like Dr. Baldea reads probably 1000s of pages of reference letters. We have to train the letter writers how to do it, and also for us how to understand it.
Baldea: This is all in the setting of losing abilities to differentiate applications, with step 1 going pass/fail, which in general is a positive thing for many reasons, but it doesn't help us to differentiate applications. Then on top of it, many medical schools are also going pass/fail, or taking away ranking systems, leaving the AOA designation, so it does get harder and harder to differentiate applicants. The thought is that program directors are putting more weight on letters of recommendation, while at the same time, they're also very difficult to interpret.
This transcription has been edited for clarity.
Private equity acquisition is linked with lower MIPS scores for urologists
“As private equity firms increasingly engage in urology, key stakeholders, including policymakers and urologists, need to ensure that the quality of care is not compromised with the structural changes implemented after acquisition," write the authors.
How APPs can bridge the gap in urologist shortages
In this episode, Janelle Bunce, PA-C, highlights the role that advanced practice providers can play in filling the gaps created by the growing workforce shortages in urology.
Survey shows patient mistrust of AI use in health care
Patients fear their personal data could be compromised, with 63% concerned increasing use of artificial intelligence will put their health information at risk.
Dr. Bristol Whiles discusses her experience as a urology resident
On this podcast, Bristol Whiles, MD, discusses her urology residency experience at the Kansas University School of Medicine Department of Urology.
Practice Profile: Tennessee Urology
In this installment, Christopher E. Ramsey, MD, FACS, and Rachel Vann, MSN, RN, NP-C, highlight Tennessee Urology, an affiliate of United Urology Group.
Check your beneficiary designations annually
"Make the proper beneficiary designation adjustments when warranted and review these annually with your adviser to ensure they remain up-to-date and make financial sense given your current situation," writes Jeff Witz, CFP.
2 Clarke Drive
Cranbury, NJ 08512