A psychometric study found AMSTAR 2 to be a valid and moderately reliable appraisal tool
Copyright © 2019 Elsevier Inc. All rights reserved..
OBJECTIVES: The objectives of this study were to determine the interrater reliability (IRR) of assessment of multiple systematic reviews (AMSTAR) 2 for reviews of pharmacological or psychological interventions for the treatment of major depression, to compare it to that of AMSTAR and risk of bias in systematic reviews (ROBIS), and to assess the convergent validity between the appraisal tools.
STUDY DESIGN AND SETTING: Two groups of four raters were each assigned one of two samples of 30 systematic reviews. All eight raters applied AMSTAR 2 to their sample. Each group also applied either AMSTAR or ROBIS. Fleiss' kappa and Gwet's AC1 were calculated, and agreement between the tools was assessed.
RESULTS: The median kappa values as a measure of IRR indicated a moderate agreement for AMSTAR 2 (median = 0.51), a substantial agreement for AMSTAR (median = 0.62), and a fair agreement for ROBIS (median = 0.27). Validity results showed a positive association for AMSTAR and AMSTAR 2 (r = 0.91) as well as ROBIS and AMSTAR 2 (r = 0.84). For the overall rating, AMSTAR 2 showed a high concordance with ROBIS and a lower concordance with AMSTAR.
CONCLUSION: The IRR of AMSTAR 2 was found to be slightly lower than the IRR of AMSTAR and higher than the IRR of ROBIS. Validity measurements indicate that AMSTAR 2 is closely related to both ROBIS and AMSTAR.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2019 |
|---|---|
| Erschienen: |
2019 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:114 |
|---|---|
| Enthalten in: |
Journal of clinical epidemiology - 114(2019) vom: 30. Okt., Seite 133-140 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Lorenz, Robert C [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
AMSTAR |
|---|
| Anmerkungen: |
Date Completed 21.05.2020 Date Revised 21.05.2020 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.jclinepi.2019.05.028 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM297706063 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM297706063 | ||
| 003 | DE-627 | ||
| 005 | 20231225092556.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2019 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.jclinepi.2019.05.028 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n0992.xml |
| 035 | |a (DE-627)NLM297706063 | ||
| 035 | |a (NLM)31152864 | ||
| 035 | |a (PII)S0895-4356(18)31099-0 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Lorenz, Robert C |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A psychometric study found AMSTAR 2 to be a valid and moderately reliable appraisal tool |
| 264 | 1 | |c 2019 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 21.05.2020 | ||
| 500 | |a Date Revised 21.05.2020 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2019 Elsevier Inc. All rights reserved. | ||
| 520 | |a OBJECTIVES: The objectives of this study were to determine the interrater reliability (IRR) of assessment of multiple systematic reviews (AMSTAR) 2 for reviews of pharmacological or psychological interventions for the treatment of major depression, to compare it to that of AMSTAR and risk of bias in systematic reviews (ROBIS), and to assess the convergent validity between the appraisal tools | ||
| 520 | |a STUDY DESIGN AND SETTING: Two groups of four raters were each assigned one of two samples of 30 systematic reviews. All eight raters applied AMSTAR 2 to their sample. Each group also applied either AMSTAR or ROBIS. Fleiss' kappa and Gwet's AC1 were calculated, and agreement between the tools was assessed | ||
| 520 | |a RESULTS: The median kappa values as a measure of IRR indicated a moderate agreement for AMSTAR 2 (median = 0.51), a substantial agreement for AMSTAR (median = 0.62), and a fair agreement for ROBIS (median = 0.27). Validity results showed a positive association for AMSTAR and AMSTAR 2 (r = 0.91) as well as ROBIS and AMSTAR 2 (r = 0.84). For the overall rating, AMSTAR 2 showed a high concordance with ROBIS and a lower concordance with AMSTAR | ||
| 520 | |a CONCLUSION: The IRR of AMSTAR 2 was found to be slightly lower than the IRR of AMSTAR and higher than the IRR of ROBIS. Validity measurements indicate that AMSTAR 2 is closely related to both ROBIS and AMSTAR | ||
| 650 | 4 | |a Comparative Study | |
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a AMSTAR | |
| 650 | 4 | |a AMSTAR 2 | |
| 650 | 4 | |a Methodological quality | |
| 650 | 4 | |a ROBIS | |
| 650 | 4 | |a Risk of bias | |
| 650 | 4 | |a Systematic review | |
| 650 | 7 | |a Antidepressive Agents |2 NLM | |
| 700 | 1 | |a Matthias, Katja |e verfasserin |4 aut | |
| 700 | 1 | |a Pieper, Dawid |e verfasserin |4 aut | |
| 700 | 1 | |a Wegewitz, Uta |e verfasserin |4 aut | |
| 700 | 1 | |a Morche, Johannes |e verfasserin |4 aut | |
| 700 | 1 | |a Nocon, Marc |e verfasserin |4 aut | |
| 700 | 1 | |a Rissling, Olesja |e verfasserin |4 aut | |
| 700 | 1 | |a Schirm, Jacqueline |e verfasserin |4 aut | |
| 700 | 1 | |a Jacobs, Anja |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of clinical epidemiology |d 1991 |g 114(2019) vom: 30. Okt., Seite 133-140 |w (DE-627)NLM012614815 |x 1878-5921 |7 nnns |
| 773 | 1 | 8 | |g volume:114 |g year:2019 |g day:30 |g month:10 |g pages:133-140 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.jclinepi.2019.05.028 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 114 |j 2019 |b 30 |c 10 |h 133-140 | ||