ChatGPT Shows Poor Performance in Answering Drug-Related Questions
By Lori Solomon HealthDay Reporter
TUESDAY, Dec. 12, 2023 -- ChatGPT provided no response or incomplete or wrong answers to nearly three-quarters of drug-related questions reviewed by pharmacists, according to a study presented at the American Society of Health-System Pharmacists Midyear Clinical Meeting, held from Dec. 3 to 7 in Anaheim, California.
Sara Grossman, Pharm.D., from Long Island University in New York, and colleagues asked the publicly available, free version of ChatGPT 39 questions that had been posed to a drug information service. Two investigators compared ChatGPT responses to benchmark responses based on a literature search.
Of the 39 questions, the researchers reported that ChatGPT provided responses for 72 percent. Just over one-third of ChatGPT responses (36 percent) were accurate and complete and had no irrelevant information, whereas 64 percent had inaccurate or incomplete responses. One-third of the complex questions and 23 percent of the noncomplex questions were answered in a satisfactory manner.
"Health care professionals and patients should be cautious about using ChatGPT as an authoritative source for medication-related information," Grossman said in a statement. "Anyone who uses ChatGPT for medication-related information should verify the information using trusted sources."
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted December 2023
Read this next
Text Messages + Financial Incentives Boost Weight Loss at 12 Months
WEDNESDAY, May 15, 2024 -- Among men with obesity, an intervention with text messaging plus financial incentive significantly improves weight loss compared with a control group...
AACR Delivers Report on Disparities in Cancer Progress
WEDNESDAY, May 15, 2024 -- In its biennial Cancer Disparities Progress Report published today, the American Association for Cancer Research presents the latest statistics on...
High Telehealth Use Tied to Increased Health Care Utilization, Cost
TUESDAY, May 14, 2024 -- Higher telehealth use in a hospital service area is tied to increased health care utilization and cost, according to a study published online May 13...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.