A pretrain-finetune approach for improving model generalizability in outcome prediction of acute respiratory distress syndrome patients
Copyright © 2024 Elsevier B.V. All rights reserved..
BACKGROUND: Early prediction of acute respiratory distress syndrome (ARDS) of critically ill patients in intensive care units (ICUs) has been intensively studied in the past years. Yet a prediction model trained on data from one hospital might not be well generalized to other hospitals. It is therefore essential to develop an accurate and generalizable ARDS prediction model adaptive to different hospital or medical centers.
METHODS: We analyzed electronic medical records of 200,859 and 50,920 hospitalized patients within 24 h after being diagnosed with ARDS from the Philips eICU Institute (eICU-CRD) and the Medical Information Mart for Intensive Care (MIMIC-IV) dataset, respectively. Patients were sorted into three groups, including rapid death, long stay, and recovery, based on their condition or outcome between 24 and 72 h after ARDS diagnosis. To improve prediction performance and generalizability, a "pretrain-finetune" approach was applied, where we pretrained models on the eICU-CRD dataset and performed model finetuning using only a part (35%) of the MIMIC-IV dataset, and then tested the finetuned models on the remaining data from the MIMIC-IV dataset. Well-known machine-learning algorithms, including logistic regression, random forest, extreme gradient boosting, and multilayer perceptron neural networks, were employed to predict ARDS outcomes. Prediction performance was evaluated using the area under the receiver-operating characteristic curve (AUC).
RESULTS: Results show that, in general, multilayer perceptron neural networks outperformed the other models. The use of pretrain-finetune yielded improved performance in predicting ARDS outcomes achieving a micro-AUC of 0.870 for the MIMIC-IV dataset, an improvement of 0.046 over the pretrain model.
CONCLUSIONS: The proposed pretrain-finetune approach can effectively improve model generalizability from one to another dataset in ARDS prediction.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:186 |
|---|---|
| Enthalten in: |
International journal of medical informatics - 186(2024) vom: 01. Apr., Seite 105397 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Lin, Songlu [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Acute respiratory distress syndrome (ARDS) |
|---|
| Anmerkungen: |
Date Completed 22.04.2024 Date Revised 22.04.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.ijmedinf.2024.105397 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM369975685 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM369975685 | ||
| 003 | DE-627 | ||
| 005 | 20240422232248.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240322s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.ijmedinf.2024.105397 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1383.xml |
| 035 | |a (DE-627)NLM369975685 | ||
| 035 | |a (NLM)38507979 | ||
| 035 | |a (PII)S1386-5056(24)00060-1 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Lin, Songlu |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A pretrain-finetune approach for improving model generalizability in outcome prediction of acute respiratory distress syndrome patients |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 22.04.2024 | ||
| 500 | |a Date Revised 22.04.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 Elsevier B.V. All rights reserved. | ||
| 520 | |a BACKGROUND: Early prediction of acute respiratory distress syndrome (ARDS) of critically ill patients in intensive care units (ICUs) has been intensively studied in the past years. Yet a prediction model trained on data from one hospital might not be well generalized to other hospitals. It is therefore essential to develop an accurate and generalizable ARDS prediction model adaptive to different hospital or medical centers | ||
| 520 | |a METHODS: We analyzed electronic medical records of 200,859 and 50,920 hospitalized patients within 24 h after being diagnosed with ARDS from the Philips eICU Institute (eICU-CRD) and the Medical Information Mart for Intensive Care (MIMIC-IV) dataset, respectively. Patients were sorted into three groups, including rapid death, long stay, and recovery, based on their condition or outcome between 24 and 72 h after ARDS diagnosis. To improve prediction performance and generalizability, a "pretrain-finetune" approach was applied, where we pretrained models on the eICU-CRD dataset and performed model finetuning using only a part (35%) of the MIMIC-IV dataset, and then tested the finetuned models on the remaining data from the MIMIC-IV dataset. Well-known machine-learning algorithms, including logistic regression, random forest, extreme gradient boosting, and multilayer perceptron neural networks, were employed to predict ARDS outcomes. Prediction performance was evaluated using the area under the receiver-operating characteristic curve (AUC) | ||
| 520 | |a RESULTS: Results show that, in general, multilayer perceptron neural networks outperformed the other models. The use of pretrain-finetune yielded improved performance in predicting ARDS outcomes achieving a micro-AUC of 0.870 for the MIMIC-IV dataset, an improvement of 0.046 over the pretrain model | ||
| 520 | |a CONCLUSIONS: The proposed pretrain-finetune approach can effectively improve model generalizability from one to another dataset in ARDS prediction | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Intensive care | |
| 650 | 4 | |a Model generalizability | |
| 650 | 4 | |a Neural networks | |
| 650 | 4 | |a Prediction | |
| 650 | 4 | |a Pretrain-finetune | |
| 650 | 4 | |a acute respiratory distress syndrome (ARDS) | |
| 700 | 1 | |a Yang, Meicheng |e verfasserin |4 aut | |
| 700 | 1 | |a Liu, Chengyu |e verfasserin |4 aut | |
| 700 | 1 | |a Wang, Zhihong |e verfasserin |4 aut | |
| 700 | 1 | |a Long, Xi |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t International journal of medical informatics |d 1998 |g 186(2024) vom: 01. Apr., Seite 105397 |w (DE-627)NLM092193730 |x 1872-8243 |7 nnns |
| 773 | 1 | 8 | |g volume:186 |g year:2024 |g day:01 |g month:04 |g pages:105397 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.ijmedinf.2024.105397 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 186 |j 2024 |b 01 |c 04 |h 105397 | ||