Large Language Model Good for Chest Radiography
Medically reviewed by Drugs.com.
By Elana Gotkine HealthDay Reporter
TUESDAY, Oct. 17, 2023 -- Outputs of the large language model (LLM) Vicuna-13B show moderate-to-substantial agreement with existing labelers for 13 findings on chest radiography reports, according to a study published online Oct. 10 in Radiology.
Pritam Mukherjee, Ph.D., from the National Institutes of Health (NIH) Clinical Center in Bethesda, Maryland, and colleagues examined the feasibility of using an alternative LLM, Vicuna-13B, which can be run locally for labeling radiography reports, in a retrospective study that included chest radiography reports from the MIMIC-CXR and NIH data sets. Reports were assessed for 13 findings.
A total of 3,269 reports from the MIMIC-CXR and 25,596 from the NIH dataset were included in the analysis. The researchers found that the Vicuna outputs with prompt 2 showed moderate-to-substantial agreement with the labelers on the MIMIC-CXR (κ median, 0.57 with CheXpert and 0.64 with CheXbert) and NIH (κ median, 0.52 with CheXpert and 0.55 with CheXbert) datasets on average. On nine of 11 findings, Vicuna with prompt 2 performed at par with both labelers (median area under the receiver operating characteristic curve, 0.84).
"This proof-of-concept study showed that it may be feasible to use publicly available large language models, such as Vicuna-13B, run locally in a privacy-preserving manner, without any additional training or fine-tuning, to label radiology reports and that the performance may be comparable to other commonly used tools, such as CheXpert and CheXbert, particularly when binary labels for each finding are desired," the authors write.
One author disclosed ties to industry.
Editorial (subscription or payment may be required)
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted October 2023
Read this next
First Responders With More Debris Exposure Have Higher Risk of Early Dementia
FRIDAY, June 14, 2024 -- More severe exposure to dust or debris among World Trade Center (WTC) responders is significantly associated with a higher risk of dementia at <65...
1990 to 2019 Saw Increase in Life Expectancy in Seniors With T1DM
FRIDAY, June 14, 2024 -- From 1990 to 2019, there was an increase in life expectancy in older people with type 1 diabetes mellitus (T1DM), according to a study published online...
Second Tumors Are Rare After Chimeric Antigen Receptor T-Cell Therapy
FRIDAY, June 14, 2024 -- Second tumors are rarely seen after chimeric antigen receptor (CAR) T-cell therapy, according to a study published in the June 13 issue of the New England...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.