Assessing Bias and Limitations of Clinical Validation Studies of Molecular Diagnostic Tests for Indeterminate Thyroid Nodules : Systematic Review and Meta-Analysis
Background: Molecular tests for thyroid nodules with indeterminate fine needle aspiration results are increasingly used in clinical practice; however, true diagnostic summaries of these tests are unknown. A systematic review and meta-analysis were completed to (1) evaluate the accuracy of commercially available molecular tests for malignancy in indeterminate thyroid nodules and (2) quantify biases and limitations in studies that validate those tests. Summary: PubMed, EMBASE, and Web of Science were systematically searched through July 2021. English language articles that reported original clinical validation attempts of molecular tests for indeterminate thyroid nodules were included if they reported counts of true-negative, true-positive, false-negative, and false-positive results. We performed screening and full-text review, followed by assessment of eight common biases and limitations, extraction of diagnostic and histopathological information, and meta-analysis of clinical validity using a bivariate linear mixed-effects model. Forty-nine studies were included. Meta-analysis of Afirma Gene expression classifiers (GEC; n = 38 studies) revealed a sensitivity of 0.92 (confidence interval: 0.90-0.94), specificity of 0.26 (0.20-0.32), negative likelihood ratio (LR-) of 0.32 (0.23-0.44), positive LR+ of 1.24 (1.15-1.35), and area under the curve (AUC) of 0.83 (0.74-0.89). Afirma Genomic Sequencing Classifier (GSC; n = 10) had a sensitivity of 0.94 (0.89-0.96), specificity of 0.38 (0.27-0.50), LR- of 0.18 (0.10-0.30), LR+ of 1.52 (1.28-1.87), and AUC of 0.91 (0.62-0.92). ThyroSeq v1 and v2 (n = 10) had a sensitivity of 0.86 (0.82-0.90), specificity of 0.74 (0.59-0.85), LR- of 0.19 (0.13-0.26), LR+ of 3.52 (2.08-5.92), and AUC of 0.86 (0.81-0.90). ThyroSeq v3 (n = 6) had a sensitivity of 0.92 (0.86-0.95), specificity of 0.41 (0.18-0.69), LR- of 0.24 (0.09-0.62), LR+ of 1.67 (1.09-2.98), and AUC of 0.90 (0.63-0.92). Fourteen percent of studies conducted a blinded histopathologic review of excised thyroid nodules, and 8% made the decision to go to surgery blind to molecular test results. Conclusions: Meta-analyses reveal a high diagnostic accuracy of molecular tests for thyroid nodule assessment of malignancy risk; however, these studies are subject to several limitations. Limitations and their potential clinical impacts must be addressed and, when feasible, adjusted for using valid statistical methodologies.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:32 |
|---|---|
| Enthalten in: |
Thyroid : official journal of the American Thyroid Association - 32(2022), 10 vom: 06. Okt., Seite 1144-1157 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
DiGennaro, Catherine [VerfasserIn] |
|---|
| Links: |
|---|
| Anmerkungen: |
Date Completed 28.10.2022 Date Revised 02.10.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1089/thy.2022.0269 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM345181832 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM345181832 | ||
| 003 | DE-627 | ||
| 005 | 20231226024501.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1089/thy.2022.0269 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1150.xml |
| 035 | |a (DE-627)NLM345181832 | ||
| 035 | |a (NLM)35999710 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a DiGennaro, Catherine |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Assessing Bias and Limitations of Clinical Validation Studies of Molecular Diagnostic Tests for Indeterminate Thyroid Nodules |b Systematic Review and Meta-Analysis |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 28.10.2022 | ||
| 500 | |a Date Revised 02.10.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Background: Molecular tests for thyroid nodules with indeterminate fine needle aspiration results are increasingly used in clinical practice; however, true diagnostic summaries of these tests are unknown. A systematic review and meta-analysis were completed to (1) evaluate the accuracy of commercially available molecular tests for malignancy in indeterminate thyroid nodules and (2) quantify biases and limitations in studies that validate those tests. Summary: PubMed, EMBASE, and Web of Science were systematically searched through July 2021. English language articles that reported original clinical validation attempts of molecular tests for indeterminate thyroid nodules were included if they reported counts of true-negative, true-positive, false-negative, and false-positive results. We performed screening and full-text review, followed by assessment of eight common biases and limitations, extraction of diagnostic and histopathological information, and meta-analysis of clinical validity using a bivariate linear mixed-effects model. Forty-nine studies were included. Meta-analysis of Afirma Gene expression classifiers (GEC; n = 38 studies) revealed a sensitivity of 0.92 (confidence interval: 0.90-0.94), specificity of 0.26 (0.20-0.32), negative likelihood ratio (LR-) of 0.32 (0.23-0.44), positive LR+ of 1.24 (1.15-1.35), and area under the curve (AUC) of 0.83 (0.74-0.89). Afirma Genomic Sequencing Classifier (GSC; n = 10) had a sensitivity of 0.94 (0.89-0.96), specificity of 0.38 (0.27-0.50), LR- of 0.18 (0.10-0.30), LR+ of 1.52 (1.28-1.87), and AUC of 0.91 (0.62-0.92). ThyroSeq v1 and v2 (n = 10) had a sensitivity of 0.86 (0.82-0.90), specificity of 0.74 (0.59-0.85), LR- of 0.19 (0.13-0.26), LR+ of 3.52 (2.08-5.92), and AUC of 0.86 (0.81-0.90). ThyroSeq v3 (n = 6) had a sensitivity of 0.92 (0.86-0.95), specificity of 0.41 (0.18-0.69), LR- of 0.24 (0.09-0.62), LR+ of 1.67 (1.09-2.98), and AUC of 0.90 (0.63-0.92). Fourteen percent of studies conducted a blinded histopathologic review of excised thyroid nodules, and 8% made the decision to go to surgery blind to molecular test results. Conclusions: Meta-analyses reveal a high diagnostic accuracy of molecular tests for thyroid nodule assessment of malignancy risk; however, these studies are subject to several limitations. Limitations and their potential clinical impacts must be addressed and, when feasible, adjusted for using valid statistical methodologies | ||
| 650 | 4 | |a Meta-Analysis | |
| 650 | 4 | |a Systematic Review | |
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Research Support, N.I.H., Extramural | |
| 650 | 4 | |a bias assessment | |
| 650 | 4 | |a clinical validity | |
| 650 | 4 | |a diagnostic tests | |
| 650 | 4 | |a meta-analysis | |
| 650 | 4 | |a molecular diagnostics | |
| 650 | 4 | |a oncology | |
| 650 | 4 | |a systematic review | |
| 650 | 4 | |a thyroid cancer | |
| 700 | 1 | |a Vahdatzad, Vahab |e verfasserin |4 aut | |
| 700 | 1 | |a Jalali, Mohammad S |e verfasserin |4 aut | |
| 700 | 1 | |a Toumi, Asmae |e verfasserin |4 aut | |
| 700 | 1 | |a Watson, Tina |e verfasserin |4 aut | |
| 700 | 1 | |a Gazelle, G Scott |e verfasserin |4 aut | |
| 700 | 1 | |a Mercaldo, Nathaniel |e verfasserin |4 aut | |
| 700 | 1 | |a Lubitz, Carrie Cunningham |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Thyroid : official journal of the American Thyroid Association |d 1990 |g 32(2022), 10 vom: 06. Okt., Seite 1144-1157 |w (DE-627)NLM013075799 |x 1557-9077 |7 nnns |
| 773 | 1 | 8 | |g volume:32 |g year:2022 |g number:10 |g day:06 |g month:10 |g pages:1144-1157 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1089/thy.2022.0269 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 32 |j 2022 |e 10 |b 06 |c 10 |h 1144-1157 | ||