AI Can Identify Guardian Authorship of Messages in Teen Patient Portal
By Elana Gotkine HealthDay Reporter
FRIDAY, June 28, 2024 -- Large language model (LLM)-based classifiers can accurately detect guardian authorship of messages sent from an adolescent patient portal, according to a research letter published online June 25 in JAMA Network Open.
April S. Liang, M.D., from the Stanford University School of Medicine in Palo Alto, California, and colleagues examined the ability of a LLM to detect guardian authorship of messages originating from adolescent patient portals. Messages from adolescent patient portal accounts at Stanford Children's Health were sampled and manually reviewed for authorship. Two prompts were iteratively engineered on a random subset of 20 messages until perfect performance was achieved: one focusing on authorship identification (single task) and one that generated response to the message and identified authorship (multitask). Both prompts were tested on remaining messages.
Of the 2,088 test messages, 71.8 and 28.2 percent were labeled as parent- or guardian-authored and patient-authored, respectively. The researchers found that the single-task LLM achieved sensitivity and specificity of 98.1 and 88.4 percent, respectively, while the multitask LLM achieved sensitivity and specificity of 98.3 and 88.9 percent, respectively. This corresponded to a positive predictive value and negative predictive value above 95 percent for multitask LLM. Statistically identical performance was seen for the single-task and multitask classifiers.
"Ultimately, reliable identification of nonpatient-authored messages has implications beyond adolescent medicine. Among adults, care partners commonly access patient portals using the patient's credentials, especially relevant for geriatric patients or individuals with developmental differences," the authors write. "Our results found that this study's LLM has potential in improving safeguards for patient confidentiality."
One author disclosed ties to nference.
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2025 HealthDay. All rights reserved.
Posted June 2024
Read this next
Persistent, New Mucus Plugs Associated With Faster Decline in FEV1 in COPD
WEDNESDAY, May 21, 2025 -- For patients with chronic obstructive pulmonary disease (COPD), persistent and newly formed mucus plugs are associated with a faster decrease in forced...
Combinations of Chronic, Physical Illnesses Up the Risk of Subsequent Depression
WEDNESDAY, May 21, 2025 -- Certain groups of physical multimorbidity may be associated with a higher risk of subsequent depression, according to a study published online May 13...
Adding Team Therapist Reduces Burnout for Critical Care Nurses
TUESDAY, May 20, 2025 -- For nurses in critical care areas, adding a team therapist can reduce burnout and improve resilience, according to a study presented at the American...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.