AI Shows Good Clinical Knowledge, Reasoning for Eye Issues
By Lori Solomon HealthDay Reporter
FRIDAY, April 26, 2024 -- Large language models (LLMs) are approaching expert-level knowledge and reasoning skills in ophthalmology, according to a study published online April 17 in PLOS Digital Health.
Arun James Thirunavukarasu, M.B., B.Chir., from University of Oxford in the United Kingdom, and colleagues evaluated the clinical potential of state-of-the-art LLMs in ophthalmology. Responses to 87 questions were compared for GPT-3.5, GPT-4, PaLM 2, LLaMA, expert ophthalmologists, and doctors in training.
The researchers found that the performance of GPT-4 (69 percent) was superior to performance of GPT-3.5 (48 percent), LLaMA (32 percent), and PaLM 2 (56 percent) and compared favorably with expert ophthalmologists (median, 76 percent), ophthalmology trainees (median, 59 percent), and unspecialized junior doctors (median, 43 percent). Low agreement between LLMs and doctors was due to idiosyncratic differences in knowledge and reasoning, with overall consistency across individuals and type. Grading ophthalmologists preferred GPT-4 responses over GPT-3.5 due to higher accuracy and relevance.
"LLMs are approaching expert-level ophthalmological knowledge and reasoning, and may be useful for providing eye-related advice where access to health care professionals is limited," the authors write. "Further research is required to explore potential avenues of clinical deployment."
One author disclosed a patent on a deep learning system to detect retinal disease.
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted April 2024
Read this next
Survival Possible for Some With TBI for Whom Treatment Was Withdrawn
MONDAY, May 13, 2024 -- A substantial proportion of patients with traumatic brain injury (TBI) who undergo withdrawal of life-sustaining treatment (WLST) could have survived and...
Study Identifies Factors Associated With Hydroxychloroquine Retinopathy
MONDAY, May 13, 2024 -- Factors associated with an increased risk for hydroxychloroquine retinopathy have been identified and include female sex, older age, and chronic kidney...
Adding Cardiovascular Biomarkers to Established Risk Factors Increases Risk Prediction
MONDAY, May 13, 2024 -- The addition of cardiovascular biomarkers to established risk factors leads to a small improvement in risk prediction of cardiovascular disease, according...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.