Machine learning models for predicting unscheduled return visits of patients with abdominal pain at emergency department and validation during COVID-19 pandemic : A retrospective cohort study
Copyright © 2024 the Author(s). Published by Wolters Kluwer Health, Inc..
Machine learning (ML) models for predicting 72-hour unscheduled return visits (URVs) for patients with abdominal pain in the emergency department (ED) were developed in a previous study. This study refined the data to adjust previous prediction models and evaluated the model performance in future data validation during the COVID-19 era. We aimed to evaluate the practicality of the ML models and compare the URVs before and during the COVID-19 pandemic. We used electronic health records from Chang Gung Memorial Hospital from 2018 to 2019 as a training dataset, and various machine learning models, including logistic regression (LR), random forest (RF), extreme gradient boosting (XGB), and voting classifier (VC) were developed and subsequently used to validate against the 2020 to 2021 data. The models highlighted several determinants for 72-hour URVs, including patient age, prior ER visits, specific vital signs, and medical interventions. The LR, XGB, and VC models exhibited the same AUC of 0.71 in the testing set, whereas the VC model displayed a higher F1 score (0.21). The XGB model demonstrated the highest specificity (0.99) and precision (0.64) but the lowest sensitivity (0.01). Among these models, the VC model showed the most favorable, balanced, and comprehensive performance. Despite the promising results, the study illuminated challenges in predictive modeling, such as the unforeseen influences of global events, such as the COVID-19 pandemic. These findings not only highlight the significant potential of machine learning in augmenting emergency care but also underline the importance of iterative refinement in response to changing real-world conditions.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:103 |
|---|---|
| Enthalten in: |
Medicine - 103(2024), 8 vom: 23. Feb., Seite e37220 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Hsu, Chun-Chuan [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 26.02.2024 Date Revised 26.02.2024 published: Print Citation Status MEDLINE |
|---|
| doi: |
10.1097/MD.0000000000037220 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM368845168 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM368845168 | ||
| 003 | DE-627 | ||
| 005 | 20240229155617.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240229s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1097/MD.0000000000037220 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1306.xml |
| 035 | |a (DE-627)NLM368845168 | ||
| 035 | |a (NLM)38394532 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Hsu, Chun-Chuan |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Machine learning models for predicting unscheduled return visits of patients with abdominal pain at emergency department and validation during COVID-19 pandemic |b A retrospective cohort study |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 26.02.2024 | ||
| 500 | |a Date Revised 26.02.2024 | ||
| 500 | |a published: Print | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 the Author(s). Published by Wolters Kluwer Health, Inc. | ||
| 520 | |a Machine learning (ML) models for predicting 72-hour unscheduled return visits (URVs) for patients with abdominal pain in the emergency department (ED) were developed in a previous study. This study refined the data to adjust previous prediction models and evaluated the model performance in future data validation during the COVID-19 era. We aimed to evaluate the practicality of the ML models and compare the URVs before and during the COVID-19 pandemic. We used electronic health records from Chang Gung Memorial Hospital from 2018 to 2019 as a training dataset, and various machine learning models, including logistic regression (LR), random forest (RF), extreme gradient boosting (XGB), and voting classifier (VC) were developed and subsequently used to validate against the 2020 to 2021 data. The models highlighted several determinants for 72-hour URVs, including patient age, prior ER visits, specific vital signs, and medical interventions. The LR, XGB, and VC models exhibited the same AUC of 0.71 in the testing set, whereas the VC model displayed a higher F1 score (0.21). The XGB model demonstrated the highest specificity (0.99) and precision (0.64) but the lowest sensitivity (0.01). Among these models, the VC model showed the most favorable, balanced, and comprehensive performance. Despite the promising results, the study illuminated challenges in predictive modeling, such as the unforeseen influences of global events, such as the COVID-19 pandemic. These findings not only highlight the significant potential of machine learning in augmenting emergency care but also underline the importance of iterative refinement in response to changing real-world conditions | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Chu, Cheng-C J |e verfasserin |4 aut | |
| 700 | 1 | |a Ng, Chip-Jin |e verfasserin |4 aut | |
| 700 | 1 | |a Lin, Ching-Heng |e verfasserin |4 aut | |
| 700 | 1 | |a Lo, Hsiang-Yun |e verfasserin |4 aut | |
| 700 | 1 | |a Chen, Shou-Yen |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medicine |d 1945 |g 103(2024), 8 vom: 23. Feb., Seite e37220 |w (DE-627)NLM000020737 |x 1536-5964 |7 nnns |
| 773 | 1 | 8 | |g volume:103 |g year:2024 |g number:8 |g day:23 |g month:02 |g pages:e37220 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1097/MD.0000000000037220 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 103 |j 2024 |e 8 |b 23 |c 02 |h e37220 | ||