Skip to main content

No Universally Effective Model-Updating Approach Available in ICU Setting

Medically reviewed by Drugs.com.

By Elana Gotkine HealthDay Reporter

TUESDAY, Oct. 10, 2023 -- In a simulated intensive care unit setting, there is no universally effective model-updating approach that maintains model performance, according to a study published online Oct. 10 in Annals of Internal Medicine.

Using data for 130,000 critical care admissions across two health systems, Akhil Vaid, M.D., from the Icahn School of Medicine at Mount Sinai in New York City, and colleagues estimated changes in predictive model performance with the use of three common scenarios: model retraining, sequential implementation of one model after another, and intervening in response to a model when models are implemented simultaneously.

The researchers found that in scenario 1, a mortality prediction model lost 9 to 39 percent specificity after retraining once at fixed 90 percent sensitivity, and in scenario 2, a mortality prediction model lost 8 to 15 percent specificity when created after implementation of an acute kidney injury (AKI) prediction model. Models for AKI and mortality prediction implemented simultaneously in scenario 3 led to reduced effective accuracy of the other by 1 to 28 percent.

"We found that implementation of predictive models into clinical workflows has the potential to reduce adverse outcomes," the authors write. "However, because these changes are subsequently captured within the electronic health record, this reduction also disrupts the relationship between the severity of initial presentation and the likelihood of an adverse outcome that predictive models learn to establish."

Abstract/Full Text (subscription or payment may be required)

Editorial (subscription or payment may be required)

Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

© 2024 HealthDay. All rights reserved.

Posted October 2023

Read this next

Researchers Compare Race-Based, Race-Neutral Lung Function Equations

TUESDAY, May 21, 2024 -- The use of race-based and race-neutral equations for lung-function testing generate similarly accurate predictions of respiratory outcomes, but differ in...

Survival Benefit for Cancer Trial Participants Does Not Persist in Adjusted Analyses

TUESDAY, May 21, 2024 -- In studies using designs addressing sources of bias and confounding, there is no evidence of a survival benefit for cancer trial participants, according...

Genital Talc Use Positively Linked to Ovarian Cancer

TUESDAY, May 21, 2024 -- There is a positive association between use of intimate care products, including genital talc, and ovarian cancer, according to a study published online...

More news resources

Subscribe to our newsletter

Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.