AI Shows Good Clinical Knowledge, Reasoning for Eye Issues
By Lori Solomon HealthDay Reporter
FRIDAY, April 26, 2024 -- Large language models (LLMs) are approaching expert-level knowledge and reasoning skills in ophthalmology, according to a study published online April 17 in PLOS Digital Health.
Arun James Thirunavukarasu, M.B., B.Chir., from University of Oxford in the United Kingdom, and colleagues evaluated the clinical potential of state-of-the-art LLMs in ophthalmology. Responses to 87 questions were compared for GPT-3.5, GPT-4, PaLM 2, LLaMA, expert ophthalmologists, and doctors in training.
The researchers found that the performance of GPT-4 (69 percent) was superior to performance of GPT-3.5 (48 percent), LLaMA (32 percent), and PaLM 2 (56 percent) and compared favorably with expert ophthalmologists (median, 76 percent), ophthalmology trainees (median, 59 percent), and unspecialized junior doctors (median, 43 percent). Low agreement between LLMs and doctors was due to idiosyncratic differences in knowledge and reasoning, with overall consistency across individuals and type. Grading ophthalmologists preferred GPT-4 responses over GPT-3.5 due to higher accuracy and relevance.
"LLMs are approaching expert-level ophthalmological knowledge and reasoning, and may be useful for providing eye-related advice where access to health care professionals is limited," the authors write. "Further research is required to explore potential avenues of clinical deployment."
One author disclosed a patent on a deep learning system to detect retinal disease.
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted April 2024
Read this next
Novel Genetic Loci ID'd for Hypertension in European Ancestry
TUESDAY, May 7, 2024 -- A total of 113 novel genetic loci have been identified in the largest single-stage common variant genome-wide association study of blood pressure (BP)...
Early Neurodevelopmental Assessments Can ID Cerebral Palsy
TUESDAY, May 7, 2024 -- Early neurodevelopmental assessments can predict cerebral palsy and its severity, according to a study published online May 6 in JAMA Network Open to...
Time-Restricted Eating + High-Intensity Training Aids Women With Obesity, Inactivity
TUESDAY, May 7, 2024 -- Combining time-restricted eating (TRE) with high-intensity functional training (HIFT) may have superior effects on body composition, lipid profile, and...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.