Doctors Still Beat AI in Offering Accurate Medical Advice: Study
By Ernie Mundell HealthDay Reporter
WEDNESDAY, April 3, 2024 -- It might be too soon to rely solely on machine learning for health advice, a new study finds.
After pitting the latest AI against actual human physicians, the doctors easily won, reports a team led by Dr. Andrei Brateanu, of the Cleveland Clinic Foundation.
For now anyway, "AI tools should not be seen as substitutes for medical professionals," he said. "Instead, they can be considered as additional resources that, when combined with human expertise, can enhance the overall quality of information provided."
As the researchers noted, consumers can already harness the power of web searches or AI programs like ChatGPT-4 or Google Bard whenever they have medical questions.
But how accurate are the answers?
To find out, Brateanu's team posed 56 common medical questions to either ChatGPT-4 and Bard. They then had two physicians review the answers for accuracy (a third doctor was brought in to settle things when the two doctors disagreed).
Of the two AI programs, Bard seemed to outperform ChatGPT, although both had relatively low levels of accuracy, the study found.
For example, the physicians found 53.6% of Bard's answers accurate, 17.8% inaccurate and 28.6% partially accurate.
ChatGPT performed worse: Just 28.6% of answers were accurate, 28.6% inaccurate, and 42.8% were partially accurate but incomplete, the researchers said.
They reported the findings recently in the American Journal of Preventive Medicine.
The bottom line, according to Brateanu: AI programs "can offer medical information that may look very accurate and convincing, when in fact it may be occasionally inaccurate."
"The fact that both models produced responses with inaccuracies or omitted crucial information highlights the ongoing challenge of developing AI tools that can provide dependable medical advice," he added in a journal news release.
His advice? Head to AI for medical information, but always run it by your doctor afterwards.
"As we incorporate AI technology into healthcare, it's crucial to ensure that the essence of healthcare continues to be fundamentally human," Brateanu said.
Sources
- American Journal of Preventive Medicine, news release, April 1, 2024
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted April 2024
Read this next
Early Hints at a Gene Therapy Cure for Herpes
WEDNESDAY, May 15, 2024 -- An experimental gene therapy could one day provide a first-ever cure for genital and oral herpes, researchers report. The gene therapy removed 90% or...
U.S. Drowning Deaths Rising Again After Years of Decline
TUESDAY, May 14, 2024 (HeathDay News) -- Following decades of declines, drowning deaths are once again climbing in the United States, new government data shows. More than 4,500...
Summer of 2023 Was Hottest in 2,000 Years
TUESDAY, May 14, 2024 -- High temperatures across the Northern Hemisphere last summer were scorching and frequent enough to make it the hottest summer in two millennia, new...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.
