AI Chatbots Can Generate Quality, Empathetic, Readable Responses
By Elana Gotkine HealthDay Reporter
FRIDAY, May 17, 2024 -- For patient questions about cancer, artificial intelligence (AI) chatbots can generate quality, empathetic, and readable responses, according to a study published online May 16 in JAMA Oncology.
David Chen, from the Princess Margaret Hospital Cancer Centre in Toronto, and colleagues examined the competency of AI chatbots (GPT-3.5 [chatbot 1], GPT-4 [chatbot 2], and Claude AI [chatbot 3]) to generate high-quality, empathetic, and readable responses to questions about cancer. AI chatbot responses were compared to responses from six verified oncologists for 200 patient questions about cancer from a public online forum.
The researchers found that compared with physician responses, responses generated by chatbot 3, which was the best-performing AI chatbot, were consistently rated higher in overall measures of quality, empathy, and readability. There was no significant difference noted between the mean Flesch-Kincaid Grade Level of physician responses and chatbot 3 responses (mean, 10.11 versus 10.31); however, the grade level was lower than that seen for chatbot 1 and chatbot 2 (mean, 12.33 and 11.32).
"Further research is required to investigate the implementation of AI chatbots into clinical workflows with consideration of chatbot scope, data security, and content accuracy in the age of digital health care," the authors write.
One author disclosed ties to AstraZeneca Canada.
Abstract/Full Text (subscription or payment may be required)
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2025 HealthDay. All rights reserved.
Posted May 2024
Read this next
Declining Childhood Vaccination May Increase Risk for Vaccine-Preventable Infections
WEDNESDAY, April 30, 2025 -- Declining childhood vaccination rates may increase outbreaks of eliminated vaccine-preventable infections within the United States, leading to a...
AACR: Incidence-Based Mortality Dropping for Young Women With Breast Cancer
TUESDAY, April 29, 2025 -- Incidence-based mortality (IBM) declined from 2010 to 2020 among women aged 20 to 49 years diagnosed with breast cancer, according to a study presented...
AACR: Nonsurgical Treatment Feasible for Mismatch Repair-Deficient Tumors
TUESDAY, April 29, 2025 -- A neoadjuvant programmed cell death 1 (PD-1) blockade enables nonoperative management among patients with early-stage mismatch repair-deficient (dMMR)...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.