ChatGPT Shows Poor Performance in Answering Drug-Related Questions
By Lori Solomon HealthDay Reporter
TUESDAY, Dec. 12, 2023 -- ChatGPT provided no response or incomplete or wrong answers to nearly three-quarters of drug-related questions reviewed by pharmacists, according to a study presented at the American Society of Health-System Pharmacists Midyear Clinical Meeting, held from Dec. 3 to 7 in Anaheim, California.
Sara Grossman, Pharm.D., from Long Island University in New York, and colleagues asked the publicly available, free version of ChatGPT 39 questions that had been posed to a drug information service. Two investigators compared ChatGPT responses to benchmark responses based on a literature search.
Of the 39 questions, the researchers reported that ChatGPT provided responses for 72 percent. Just over one-third of ChatGPT responses (36 percent) were accurate and complete and had no irrelevant information, whereas 64 percent had inaccurate or incomplete responses. One-third of the complex questions and 23 percent of the noncomplex questions were answered in a satisfactory manner.
"Health care professionals and patients should be cautious about using ChatGPT as an authoritative source for medication-related information," Grossman said in a statement. "Anyone who uses ChatGPT for medication-related information should verify the information using trusted sources."
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted December 2023
Read this next
Coworker, Organizational Support Increase Nurses' Intent to Stay at Job
TUESDAY, June 4, 2024 -- Coworker and employer support are strong predictors that nurses plan to stay in their jobs, according to a study published online May 31 in...
First-Line Biparametric MRI Less Cost-Effective Than PSA for Prostate Cancer Screening
MONDAY, June 3, 2024 -- From an economic perspective, first-line prostate-specific antigen (PSA) testing is favored over biparametric magnetic resonance imaging (bpMRI) for...
9.6 Percent of Medical Visits Took Place Via Telehealth in 2021
MONDAY, June 3, 2024 -- In 2021, 9.6 percent of medical visits took place via telehealth, with a higher percentage seen for mental health visits, according to a research letter...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.