External validation of a predictive model for reintubation after cardiac surgery : A retrospective, observational study
Published by Elsevier Inc..
STUDY OBJECTIVE: Explore validation of a model to predict patients' risk of failing extubation, to help providers make informed, data-driven decisions regarding the optimal timing of extubation.
DESIGN: We performed temporal, geographic, and domain validations of a model for the risk of reintubation after cardiac surgery by assessing its performance on data sets from three academic medical centers, with temporal validation using data from the institution where the model was developed.
SETTING: Three academic medical centers in the United States.
PATIENTS: Adult patients arriving in the cardiac intensive care unit with an endotracheal tube in place after cardiac surgery.
INTERVENTIONS: Receiver operating characteristic (ROC) curves and concordance statistics were used as measures of discriminative ability, and calibration curves and Brier scores were used to assess the model's predictive ability.
MEASUREMENTS: Temporal validation was performed in 1642 patients with a reintubation rate of 4.8%, with the model demonstrating strong discrimination (optimism-corrected c-statistic 0.77) and low predictive error (Brier score 0.044) but poor model precision and recall (Optimal F1 score 0.29). Combined domain and geographic validation were performed in 2041 patients with a reintubation rate of 1.5%. The model displayed solid discriminative ability (optimism-corrected c-statistic = 0.73) and low predictive error (Brier score = 0.0149) but low precision and recall (Optimal F1 score = 0.13). Geographic validation was performed in 2489 patients with a reintubation rate of 1.6%, with the model displaying good discrimination (optimism-corrected c-statistic = 0.71) and predictive error (Brier score = 0.0152) but poor precision and recall (Optimal F1 score = 0.13).
MAIN RESULTS: The reintubation model displayed strong discriminative ability and low predictive error within each validation cohort.
CONCLUSIONS: Future work is needed to explore how to optimize models before local implementation.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:92 |
|---|---|
| Enthalten in: |
Journal of clinical anesthesia - 92(2024) vom: 15. Feb., Seite 111295 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Freundlich, Robert E [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Cardiac surgery |
|---|
| Anmerkungen: |
Date Completed 27.11.2023 Date Revised 18.02.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.jclinane.2023.111295 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM363759913 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM363759913 | ||
| 003 | DE-627 | ||
| 005 | 20240218231901.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.jclinane.2023.111295 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1298.xml |
| 035 | |a (DE-627)NLM363759913 | ||
| 035 | |a (NLM)37883900 | ||
| 035 | |a (PII)S0952-8180(23)00245-3 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Freundlich, Robert E |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a External validation of a predictive model for reintubation after cardiac surgery |b A retrospective, observational study |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 27.11.2023 | ||
| 500 | |a Date Revised 18.02.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Published by Elsevier Inc. | ||
| 520 | |a STUDY OBJECTIVE: Explore validation of a model to predict patients' risk of failing extubation, to help providers make informed, data-driven decisions regarding the optimal timing of extubation | ||
| 520 | |a DESIGN: We performed temporal, geographic, and domain validations of a model for the risk of reintubation after cardiac surgery by assessing its performance on data sets from three academic medical centers, with temporal validation using data from the institution where the model was developed | ||
| 520 | |a SETTING: Three academic medical centers in the United States | ||
| 520 | |a PATIENTS: Adult patients arriving in the cardiac intensive care unit with an endotracheal tube in place after cardiac surgery | ||
| 520 | |a INTERVENTIONS: Receiver operating characteristic (ROC) curves and concordance statistics were used as measures of discriminative ability, and calibration curves and Brier scores were used to assess the model's predictive ability | ||
| 520 | |a MEASUREMENTS: Temporal validation was performed in 1642 patients with a reintubation rate of 4.8%, with the model demonstrating strong discrimination (optimism-corrected c-statistic 0.77) and low predictive error (Brier score 0.044) but poor model precision and recall (Optimal F1 score 0.29). Combined domain and geographic validation were performed in 2041 patients with a reintubation rate of 1.5%. The model displayed solid discriminative ability (optimism-corrected c-statistic = 0.73) and low predictive error (Brier score = 0.0149) but low precision and recall (Optimal F1 score = 0.13). Geographic validation was performed in 2489 patients with a reintubation rate of 1.6%, with the model displaying good discrimination (optimism-corrected c-statistic = 0.71) and predictive error (Brier score = 0.0152) but poor precision and recall (Optimal F1 score = 0.13) | ||
| 520 | |a MAIN RESULTS: The reintubation model displayed strong discriminative ability and low predictive error within each validation cohort | ||
| 520 | |a CONCLUSIONS: Future work is needed to explore how to optimize models before local implementation | ||
| 650 | 4 | |a Observational Study | |
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, N.I.H., Extramural | |
| 650 | 4 | |a Cardiac surgery | |
| 650 | 4 | |a External validation | |
| 650 | 4 | |a Model validation | |
| 650 | 4 | |a Predictive modeling | |
| 650 | 4 | |a Reintubation | |
| 700 | 1 | |a Clifton, Jacob C |e verfasserin |4 aut | |
| 700 | 1 | |a Epstein, Richard H |e verfasserin |4 aut | |
| 700 | 1 | |a Pandharipande, Pratik P |e verfasserin |4 aut | |
| 700 | 1 | |a Grogan, Tristan R |e verfasserin |4 aut | |
| 700 | 1 | |a Moore, Ryan P |e verfasserin |4 aut | |
| 700 | 1 | |a Byrne, Daniel W |e verfasserin |4 aut | |
| 700 | 1 | |a Fabbro, Michael |e verfasserin |4 aut | |
| 700 | 1 | |a Hofer, Ira S |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of clinical anesthesia |d 1996 |g 92(2024) vom: 15. Feb., Seite 111295 |w (DE-627)NLM013003399 |x 1873-4529 |7 nnns |
| 773 | 1 | 8 | |g volume:92 |g year:2024 |g day:15 |g month:02 |g pages:111295 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.jclinane.2023.111295 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 92 |j 2024 |b 15 |c 02 |h 111295 | ||