Targeted Training Reduces Search Errors but Not Classification Errors for Hepatic Metastasis Detection at Contrast-Enhanced CT
Copyright © 2024 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved..
RATIONALE AND OBJECTIVES: Methods are needed to improve the detection of hepatic metastases. Errors occur in both lesion detection (search) and decisions of benign versus malignant (classification). Our purpose was to evaluate a training program to reduce search errors and classification errors in the detection of hepatic metastases in contrast-enhanced abdominal computed tomography (CT).
MATERIALS AND METHODS: After Institutional Review Board approval, we conducted a single-group prospective pretest-posttest study. Pretest and posttest were identical and consisted of interpreting 40 contrast-enhanced abdominal CT exams containing 91 liver metastases under eye tracking. Between pretest and posttest, readers completed search training with eye-tracker feedback and coaching to increase interpretation time, use liver windows, and use coronal reformations. They also completed classification training with part-task practice, rating lesions as benign or malignant. The primary outcome was metastases missed due to search errors (<2 seconds gaze under eye tracker) and classification errors (>2 seconds). Jackknife free-response receiver operator characteristic (JAFROC) analysis was also conducted.
RESULTS: A total of 31 radiologist readers (8 abdominal subspecialists, 8 nonabdominal subspecialists, 15 senior residents/fellows) participated. Search errors were reduced (pretest 11%, posttest 8%, difference 3% [95% confidence interval, 0.3%-5.1%], P = .01), but there was no difference in classification errors (difference 0%, P = .97) or in JAFROC figure of merit (difference -0.01, P = .36). In subgroup analysis, abdominal subspecialists demonstrated no evidence of change.
CONCLUSION: Targeted training reduced search errors but not classification errors for the detection of hepatic metastases at contrast-enhanced abdominal CT. Improvements were not seen in all subgroups.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2024 |
---|---|
Erschienen: |
2024 |
Enthalten in: |
Zur Gesamtaufnahme - volume:31 |
---|---|
Enthalten in: |
Academic radiology - 31(2024), 2 vom: 01. Feb., Seite 448-456 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Hsieh, Scott S [VerfasserIn] |
---|
Links: |
---|
Themen: |
Classification errors |
---|
Anmerkungen: |
Date Completed 26.02.2024 Date Revised 16.03.2024 published: Print-Electronic Citation Status MEDLINE |
---|
doi: |
10.1016/j.acra.2023.06.017 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM360673198 |
---|
LEADER | 01000caa a22002652 4500 | ||
---|---|---|---|
001 | NLM360673198 | ||
003 | DE-627 | ||
005 | 20240316232532.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231226s2024 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1016/j.acra.2023.06.017 |2 doi | |
028 | 5 | 2 | |a pubmed24n1332.xml |
035 | |a (DE-627)NLM360673198 | ||
035 | |a (NLM)37567818 | ||
035 | |a (PII)S1076-6332(23)00313-6 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Hsieh, Scott S |e verfasserin |4 aut | |
245 | 1 | 0 | |a Targeted Training Reduces Search Errors but Not Classification Errors for Hepatic Metastasis Detection at Contrast-Enhanced CT |
264 | 1 | |c 2024 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Completed 26.02.2024 | ||
500 | |a Date Revised 16.03.2024 | ||
500 | |a published: Print-Electronic | ||
500 | |a Citation Status MEDLINE | ||
520 | |a Copyright © 2024 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved. | ||
520 | |a RATIONALE AND OBJECTIVES: Methods are needed to improve the detection of hepatic metastases. Errors occur in both lesion detection (search) and decisions of benign versus malignant (classification). Our purpose was to evaluate a training program to reduce search errors and classification errors in the detection of hepatic metastases in contrast-enhanced abdominal computed tomography (CT) | ||
520 | |a MATERIALS AND METHODS: After Institutional Review Board approval, we conducted a single-group prospective pretest-posttest study. Pretest and posttest were identical and consisted of interpreting 40 contrast-enhanced abdominal CT exams containing 91 liver metastases under eye tracking. Between pretest and posttest, readers completed search training with eye-tracker feedback and coaching to increase interpretation time, use liver windows, and use coronal reformations. They also completed classification training with part-task practice, rating lesions as benign or malignant. The primary outcome was metastases missed due to search errors (<2 seconds gaze under eye tracker) and classification errors (>2 seconds). Jackknife free-response receiver operator characteristic (JAFROC) analysis was also conducted | ||
520 | |a RESULTS: A total of 31 radiologist readers (8 abdominal subspecialists, 8 nonabdominal subspecialists, 15 senior residents/fellows) participated. Search errors were reduced (pretest 11%, posttest 8%, difference 3% [95% confidence interval, 0.3%-5.1%], P = .01), but there was no difference in classification errors (difference 0%, P = .97) or in JAFROC figure of merit (difference -0.01, P = .36). In subgroup analysis, abdominal subspecialists demonstrated no evidence of change | ||
520 | |a CONCLUSION: Targeted training reduced search errors but not classification errors for the detection of hepatic metastases at contrast-enhanced abdominal CT. Improvements were not seen in all subgroups | ||
650 | 4 | |a Journal Article | |
650 | 4 | |a Classification errors | |
650 | 4 | |a Eye tracking | |
650 | 4 | |a Radiologist training | |
650 | 4 | |a Search errors | |
650 | 7 | |a Contrast Media |2 NLM | |
700 | 1 | |a Inoue, Akitoshi |e verfasserin |4 aut | |
700 | 1 | |a Yalon, Mariana |e verfasserin |4 aut | |
700 | 1 | |a Cook, David A |e verfasserin |4 aut | |
700 | 1 | |a Gong, Hao |e verfasserin |4 aut | |
700 | 1 | |a Sudhir Pillai, Parvathy |e verfasserin |4 aut | |
700 | 1 | |a Johnson, Matthew P |e verfasserin |4 aut | |
700 | 1 | |a Fidler, Jeff L |e verfasserin |4 aut | |
700 | 1 | |a Leng, Shuai |e verfasserin |4 aut | |
700 | 1 | |a Yu, Lifeng |e verfasserin |4 aut | |
700 | 1 | |a Carter, Rickey E |e verfasserin |4 aut | |
700 | 1 | |a Holmes, David R |c 3rd |e verfasserin |4 aut | |
700 | 1 | |a McCollough, Cynthia H |e verfasserin |4 aut | |
700 | 1 | |a Fletcher, Joel G |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Academic radiology |d 1995 |g 31(2024), 2 vom: 01. Feb., Seite 448-456 |w (DE-627)NLM087676818 |x 1878-4046 |7 nnns |
773 | 1 | 8 | |g volume:31 |g year:2024 |g number:2 |g day:01 |g month:02 |g pages:448-456 |
856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.acra.2023.06.017 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 31 |j 2024 |e 2 |b 01 |c 02 |h 448-456 |