Assistance from Automated ASPECTS Software Improves Reader Performance
Copyright © 2021 Elsevier Inc. All rights reserved..
PURPOSE: To compare physicians' ability to read Alberta Stroke Program Early CT Score (ASPECTS) in patients with a large vessel occlusion within 6 hours of symptom onset when assisted by a machine learning-based automatic software tool, compared with their unassisted score.
MATERIALS AND METHODS: 50 baseline CT scans selected from two prior studies (CRISP and GAMES-RP) were read by 3 experienced neuroradiologists who were provided access to a follow-up MRI. The average ASPECT score of these reads was used as the reference standard. Two additional neuroradiologists and 6 non-neuroradiologist readers then read the scans both with and without assistance from the software reader-augmentation program and reader improvement was determined. The primary hypothesis was that the agreement between typical readers and the consensus of 3 expert neuroradiologists would be improved with software augmented vs. unassisted reads. Agreement was based on the percentage of the individual ASPECT regions (50 cases, 10 regions each; N=500) where agreement was achieved.
RESULTS: Typical non-neuroradiologist readers agreed with the expert consensus read in 72% of the 500 ASPECTS regions, evaluated without software assistance. The automated software alone agreed in 77%. When the typical readers read the scan in conjunction with the software, agreement improved to 78% (P<0.0001, test of proportions). The software program alone achieved correlations for total ASPECT scores that were similar to the expert readers who had access to the follow-up MRI scan to help enhance the quality of their reads.
CONCLUSION: Typical readers had statistically significant improvement in their scoring of scans when the scan was read in conjunction with the automated software, achieving agreement rates that were comparable to neuroradiologists.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:30 |
|---|---|
| Enthalten in: |
Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association - 30(2021), 7 vom: 15. Juli, Seite 105829 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Delio, Philip R [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Alberta stroke CT |
|---|
| Anmerkungen: |
Date Completed 16.06.2021 Date Revised 16.06.2021 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.jstrokecerebrovasdis.2021.105829 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM325413185 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM325413185 | ||
| 003 | DE-627 | ||
| 005 | 20231225192402.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.jstrokecerebrovasdis.2021.105829 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1084.xml |
| 035 | |a (DE-627)NLM325413185 | ||
| 035 | |a (NLM)33989968 | ||
| 035 | |a (PII)S1052-3057(21)00232-9 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Delio, Philip R |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Assistance from Automated ASPECTS Software Improves Reader Performance |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 16.06.2021 | ||
| 500 | |a Date Revised 16.06.2021 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2021 Elsevier Inc. All rights reserved. | ||
| 520 | |a PURPOSE: To compare physicians' ability to read Alberta Stroke Program Early CT Score (ASPECTS) in patients with a large vessel occlusion within 6 hours of symptom onset when assisted by a machine learning-based automatic software tool, compared with their unassisted score | ||
| 520 | |a MATERIALS AND METHODS: 50 baseline CT scans selected from two prior studies (CRISP and GAMES-RP) were read by 3 experienced neuroradiologists who were provided access to a follow-up MRI. The average ASPECT score of these reads was used as the reference standard. Two additional neuroradiologists and 6 non-neuroradiologist readers then read the scans both with and without assistance from the software reader-augmentation program and reader improvement was determined. The primary hypothesis was that the agreement between typical readers and the consensus of 3 expert neuroradiologists would be improved with software augmented vs. unassisted reads. Agreement was based on the percentage of the individual ASPECT regions (50 cases, 10 regions each; N=500) where agreement was achieved | ||
| 520 | |a RESULTS: Typical non-neuroradiologist readers agreed with the expert consensus read in 72% of the 500 ASPECTS regions, evaluated without software assistance. The automated software alone agreed in 77%. When the typical readers read the scan in conjunction with the software, agreement improved to 78% (P<0.0001, test of proportions). The software program alone achieved correlations for total ASPECT scores that were similar to the expert readers who had access to the follow-up MRI scan to help enhance the quality of their reads | ||
| 520 | |a CONCLUSION: Typical readers had statistically significant improvement in their scoring of scans when the scan was read in conjunction with the automated software, achieving agreement rates that were comparable to neuroradiologists | ||
| 650 | 4 | |a Comparative Study | |
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Alberta stroke CT | |
| 650 | 4 | |a Machine learning | |
| 650 | 4 | |a Radiology | |
| 650 | 4 | |a Stroke | |
| 700 | 1 | |a Wong, Matthew L |e verfasserin |4 aut | |
| 700 | 1 | |a Tsai, Jenny P |e verfasserin |4 aut | |
| 700 | 1 | |a Hinson, H E |e verfasserin |4 aut | |
| 700 | 1 | |a McMenamy, John |e verfasserin |4 aut | |
| 700 | 1 | |a Le, Thang Q |e verfasserin |4 aut | |
| 700 | 1 | |a Prabhu, Divya |e verfasserin |4 aut | |
| 700 | 1 | |a Mann, Barry S |e verfasserin |4 aut | |
| 700 | 1 | |a Copeland, Karen |e verfasserin |4 aut | |
| 700 | 1 | |a Kwok, Keith |e verfasserin |4 aut | |
| 700 | 1 | |a Haerian, Hafez |e verfasserin |4 aut | |
| 700 | 1 | |a Lansberg, Maarten J |e verfasserin |4 aut | |
| 700 | 1 | |a Heit, Jeremy J |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association |d 1991 |g 30(2021), 7 vom: 15. Juli, Seite 105829 |w (DE-627)NLM090676726 |x 1532-8511 |7 nnns |
| 773 | 1 | 8 | |g volume:30 |g year:2021 |g number:7 |g day:15 |g month:07 |g pages:105829 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.jstrokecerebrovasdis.2021.105829 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 30 |j 2021 |e 7 |b 15 |c 07 |h 105829 | ||