External validation of the RSNA 2020 pulmonary embolism detection challenge winning deep learning algorithm
Copyright © 2024 Elsevier B.V. All rights reserved..
PURPOSE: To evaluate the diagnostic performance and generalizability of the winning DL algorithm of the RSNA 2020 PE detection challenge to a local population using CTPA data from two hospitals.
MATERIALS AND METHODS: Consecutive CTPA images from patients referred for suspected PE were retrospectively analysed. The winning RSNA 2020 DL algorithm was retrained on the RSNA-STR Pulmonary Embolism CT (RSPECT) dataset. The algorithm was tested in hospital A on multidetector CT (MDCT) images of 238 patients and in hospital B on spectral detector CT (SDCT) and virtual monochromatic images (VMI) of 114 patients. The output of the DL algorithm was compared with a reference standard, which included a consensus reading by at least two experienced cardiothoracic radiologists for both hospitals. Areas under the receiver operating characteristic curve (AUCs) were calculated. Sensitivity and specificity were determined using the maximum Youden index.
RESULTS: According to the reference standard, PE was present in 73 patients (30.7%) in hospital A and 33 patients (29.0%) in hospital B. For the DL algorithm the AUC was 0.96 (95% CI 0.92-0.98) in hospital A, 0.89 (95% CI 0.81-0.94) for conventional reconstruction in hospital B and 0.87 (95% CI 0.80-0.93) for VMI.
CONCLUSION: The RSNA 2020 pulmonary embolism detection on CTPA challenge winning DL algorithm, retrained on the RSPECT dataset, showed high diagnostic accuracy on MDCT images. A somewhat lower performance was observed on SDCT images, which suggest additional training on novel CT technology may improve generalizability of this DL algorithm.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:173 |
|---|---|
| Enthalten in: |
European journal of radiology - 173(2024) vom: 29. März, Seite 111361 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Langius-Wiffen, Eline [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Artificial Intelligence |
|---|
| Anmerkungen: |
Date Completed 11.03.2024 Date Revised 11.03.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.ejrad.2024.111361 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM368913880 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM368913880 | ||
| 003 | DE-627 | ||
| 005 | 20240311232428.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240229s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.ejrad.2024.111361 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1323.xml |
| 035 | |a (DE-627)NLM368913880 | ||
| 035 | |a (NLM)38401407 | ||
| 035 | |a (PII)S0720-048X(24)00077-9 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Langius-Wiffen, Eline |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a External validation of the RSNA 2020 pulmonary embolism detection challenge winning deep learning algorithm |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 11.03.2024 | ||
| 500 | |a Date Revised 11.03.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 Elsevier B.V. All rights reserved. | ||
| 520 | |a PURPOSE: To evaluate the diagnostic performance and generalizability of the winning DL algorithm of the RSNA 2020 PE detection challenge to a local population using CTPA data from two hospitals | ||
| 520 | |a MATERIALS AND METHODS: Consecutive CTPA images from patients referred for suspected PE were retrospectively analysed. The winning RSNA 2020 DL algorithm was retrained on the RSNA-STR Pulmonary Embolism CT (RSPECT) dataset. The algorithm was tested in hospital A on multidetector CT (MDCT) images of 238 patients and in hospital B on spectral detector CT (SDCT) and virtual monochromatic images (VMI) of 114 patients. The output of the DL algorithm was compared with a reference standard, which included a consensus reading by at least two experienced cardiothoracic radiologists for both hospitals. Areas under the receiver operating characteristic curve (AUCs) were calculated. Sensitivity and specificity were determined using the maximum Youden index | ||
| 520 | |a RESULTS: According to the reference standard, PE was present in 73 patients (30.7%) in hospital A and 33 patients (29.0%) in hospital B. For the DL algorithm the AUC was 0.96 (95% CI 0.92-0.98) in hospital A, 0.89 (95% CI 0.81-0.94) for conventional reconstruction in hospital B and 0.87 (95% CI 0.80-0.93) for VMI | ||
| 520 | |a CONCLUSION: The RSNA 2020 pulmonary embolism detection on CTPA challenge winning DL algorithm, retrained on the RSPECT dataset, showed high diagnostic accuracy on MDCT images. A somewhat lower performance was observed on SDCT images, which suggest additional training on novel CT technology may improve generalizability of this DL algorithm | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Artificial Intelligence | |
| 650 | 4 | |a CT-Angiography | |
| 650 | 4 | |a Embolism/Thrombosis | |
| 650 | 4 | |a Pulmonary Arteries | |
| 650 | 4 | |a Thorax | |
| 700 | 1 | |a Slotman, Derk J |e verfasserin |4 aut | |
| 700 | 1 | |a Groeneveld, Jorik |e verfasserin |4 aut | |
| 700 | 1 | |a Ac van Osch, Jochen |e verfasserin |4 aut | |
| 700 | 1 | |a Nijholt, Ingrid M |e verfasserin |4 aut | |
| 700 | 1 | |a de Boer, Erwin |e verfasserin |4 aut | |
| 700 | 1 | |a Nijboer-Oosterveld, Jacqueline |e verfasserin |4 aut | |
| 700 | 1 | |a Veldhuis, Wouter B |e verfasserin |4 aut | |
| 700 | 1 | |a de Jong, Pim A |e verfasserin |4 aut | |
| 700 | 1 | |a Boomsma, Martijn F |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t European journal of radiology |d 1993 |g 173(2024) vom: 29. März, Seite 111361 |w (DE-627)NLM012952397 |x 1872-7727 |7 nnns |
| 773 | 1 | 8 | |g volume:173 |g year:2024 |g day:29 |g month:03 |g pages:111361 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.ejrad.2024.111361 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 173 |j 2024 |b 29 |c 03 |h 111361 | ||