Can AI Boost Accuracy of Doctors' Diagnoses?
By Dennis Thompson HealthDay Reporter
FRIDAY, Nov. 15, 2024 -- AI can’t yet help doctors improve their ability to diagnose complex conditions, a sobering new study has found.
Doctors had about the same diagnostic accuracy whether or not they were using ChatGPT Plus, according to results published recently in the journal JAMA Network Open.
However, the AI outperformed doctors when allowed to diagnose on its own, the researchers noted.
“Our study shows that AI alone can be an effective and powerful tool for diagnosis,” said researcher Dr. Andrew Parsons, who oversees the teaching of clinical skills to medical students at the University of Virginia School of Medicine.
“We were surprised to find that adding a human physician to the mix actually reduced diagnostic accuracy though improved efficiency,” Parsons said. “These results likely mean that we need formal training in how best to use AI.”
For the study, researchers provided 50 doctors with case studies based on real-life patients. These cases included details about medical history, physical exams and lab test results.
The doctors were randomly assigned to two groups -- one that diagnosed the patients’ conditions based solely on the info available and standard reference materials, and another that used ChatGPT Plus to help inform their diagnosis.
Doctors using ChatGPT returned an accurate diagnosis about 76% of the time, compared with about 74% for those not aided by AI, results show.
The ChatGPT group did come to their diagnoses slightly faster -- about 8.6 minutes compared to 9.4 minutes for those without AI help, researchers found.
When ChatGPT Plus was given the case studies on its own, it achieved an accuracy of more than 92%.
However, researchers caution that the AI would likely fare less well in real life, when diagnosing patients on the fly versus evaluating case studies.
More study is needed to assess the ability of AI to diagnose medical problems, particularly in terms of the downstream effects of diagnoses and the treatment decisions that result from them, researchers said.
“As AI becomes more embedded in healthcare, it's essential to understand how we can leverage these tools to improve patient care and the physician experience,” Parsons said. “This study suggests there is much work to be done in terms of optimizing our partnership with AI in the clinical environment.”
Sources
- University of Virginia, news release, Nov. 13, 2024
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2025 HealthDay. All rights reserved.
Posted November 2024
Read this next
Burnout and Stress Continue to Plague the Nursing Profession
WEDNESDAY, April 30, 2025 -- The nursing workforce remains under immense pressure due to stress, burnout, and persistent short staffing, according to a report released by Cross...
Milwaukee Closes More Schools to Address Lead Crisis
WEDNESDAY, April 30, 2025 — Milwaukee will temporarily close two more elementary schools as it works to tackle a lead crisis in its public school buildings. The school...
New HHS Ad Campaign Urges Americans to 'Take Back Your Health'
WEDNESDAY, April 30, 2025 — U.S. Health and Human Services Secretary Robert F. Kennedy Jr. is preparing to launch a multimillion-dollar public health campaign, according to...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.