Radiologists and Clinical Trials : Part 2: Practical Statistical Methods for Understanding and Monitoring Independent Reader Performance
© 2021. The Drug Information Association, Inc..
Though many clinical trials rely on medical image evaluations for primary or key secondary endpoints, the methods to monitor reader performance are all too often mired in the legacy use of adjudication rates. If misused, this simple metric can be misleading and sometimes entirely contradictory. Furthermore, attempts to overcome the limitations of adjudication rates using de novo or ad hoc methods often ignore well-established research conducted over the last half-century and can lead to inaccurate conclusions or variable interpretations. Underperforming readers can be missed, expert readers retrained, or worse, replaced. This paper aims to standardize reader performance evaluations using proven statistical methods. Additionally, these methods will describe how to discriminate between scenarios of concern and normal medical interpretation variability. Statistical methods are provided for inter-reader and intra-reader variability and bias, including the adjudicator's bias. Finally, we have compiled guidelines for calculating correct sample sizes, considerations for intra-reader memory recall, and applying alternative designs for independent readers.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:55 |
|---|---|
| Enthalten in: |
Therapeutic innovation & regulatory science - 55(2021), 6 vom: 09. Nov., Seite 1122-1138 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Raunig, David L [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Adjudication rate |
|---|
| Anmerkungen: |
Date Completed 15.10.2021 Date Revised 15.10.2021 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1007/s43441-021-00317-5 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM32790836X |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM32790836X | ||
| 003 | DE-627 | ||
| 005 | 20231225201824.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1007/s43441-021-00317-5 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1092.xml |
| 035 | |a (DE-627)NLM32790836X | ||
| 035 | |a (NLM)34244987 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Raunig, David L |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Radiologists and Clinical Trials |b Part 2: Practical Statistical Methods for Understanding and Monitoring Independent Reader Performance |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 15.10.2021 | ||
| 500 | |a Date Revised 15.10.2021 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2021. The Drug Information Association, Inc. | ||
| 520 | |a Though many clinical trials rely on medical image evaluations for primary or key secondary endpoints, the methods to monitor reader performance are all too often mired in the legacy use of adjudication rates. If misused, this simple metric can be misleading and sometimes entirely contradictory. Furthermore, attempts to overcome the limitations of adjudication rates using de novo or ad hoc methods often ignore well-established research conducted over the last half-century and can lead to inaccurate conclusions or variable interpretations. Underperforming readers can be missed, expert readers retrained, or worse, replaced. This paper aims to standardize reader performance evaluations using proven statistical methods. Additionally, these methods will describe how to discriminate between scenarios of concern and normal medical interpretation variability. Statistical methods are provided for inter-reader and intra-reader variability and bias, including the adjudicator's bias. Finally, we have compiled guidelines for calculating correct sample sizes, considerations for intra-reader memory recall, and applying alternative designs for independent readers | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Adjudication rate | |
| 650 | 4 | |a BICR | |
| 650 | 4 | |a Bias | |
| 650 | 4 | |a Independent review | |
| 650 | 4 | |a Intra-reader variability | |
| 650 | 4 | |a Reader performance | |
| 650 | 4 | |a Training | |
| 700 | 1 | |a Schmid, Annette M |e verfasserin |4 aut | |
| 700 | 1 | |a Miller, Colin G |e verfasserin |4 aut | |
| 700 | 1 | |a Walovitch, Richard C |e verfasserin |4 aut | |
| 700 | 1 | |a O'Connor, Michael |e verfasserin |4 aut | |
| 700 | 1 | |a Noever, Klaus |e verfasserin |4 aut | |
| 700 | 1 | |a Hristova, Ivalina |e verfasserin |4 aut | |
| 700 | 1 | |a O'Neal, Michael |e verfasserin |4 aut | |
| 700 | 1 | |a Brueggenwerth, Guenther |e verfasserin |4 aut | |
| 700 | 1 | |a Ford, Robert R |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Therapeutic innovation & regulatory science |d 2013 |g 55(2021), 6 vom: 09. Nov., Seite 1122-1138 |w (DE-627)NLM243752342 |x 2168-4804 |7 nnns |
| 773 | 1 | 8 | |g volume:55 |g year:2021 |g number:6 |g day:09 |g month:11 |g pages:1122-1138 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1007/s43441-021-00317-5 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 55 |j 2021 |e 6 |b 09 |c 11 |h 1122-1138 | ||