Post-hoc power analysis : a conceptually valid approach for power based on observed study data
© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ..
Power analysis is a key component of planning prospective studies such as clinical trials. However, some journals in biomedical and psychosocial sciences request power analysis for data already collected and analysed before accepting manuscripts for publication. Many have raised concerns about the conceptual basis for such post-hoc power analyses. More recently, Zhang et al showed by using simulation studies that such power analyses do not indicate true power for detecting statistical significance since post-hoc power estimates vary in the range of practical interests and can be very different from the true power. On the other hand, journals' request for information about the reliability of statistical findings in a manuscript due to small sample sizes is justified since the sample size plays an important role in the reproducibility of statistical findings. The problem is the wording of the journals' request, as the current power analysis paradigm is not designed to address journals' concerns about the reliability of the statistical findings. In this paper, we propose an alternate formulation of power analysis to provide a conceptually valid approach to the journals' wrongly worded but practically significant concern.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:35 |
|---|---|
| Enthalten in: |
General psychiatry - 35(2022), 4 vom: 22., Seite e100764 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Quach, Natalie E [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Biostatistics |
|---|
| Anmerkungen: |
Date Revised 07.07.2023 published: Electronic-eCollection Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.1136/gpsych-2022-100764 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM347046711 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM347046711 | ||
| 003 | DE-627 | ||
| 005 | 20231226032908.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1136/gpsych-2022-100764 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1156.xml |
| 035 | |a (DE-627)NLM347046711 | ||
| 035 | |a (NLM)36189182 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Quach, Natalie E |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Post-hoc power analysis |b a conceptually valid approach for power based on observed study data |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 07.07.2023 | ||
| 500 | |a published: Electronic-eCollection | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a © Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. | ||
| 520 | |a Power analysis is a key component of planning prospective studies such as clinical trials. However, some journals in biomedical and psychosocial sciences request power analysis for data already collected and analysed before accepting manuscripts for publication. Many have raised concerns about the conceptual basis for such post-hoc power analyses. More recently, Zhang et al showed by using simulation studies that such power analyses do not indicate true power for detecting statistical significance since post-hoc power estimates vary in the range of practical interests and can be very different from the true power. On the other hand, journals' request for information about the reliability of statistical findings in a manuscript due to small sample sizes is justified since the sample size plays an important role in the reproducibility of statistical findings. The problem is the wording of the journals' request, as the current power analysis paradigm is not designed to address journals' concerns about the reliability of the statistical findings. In this paper, we propose an alternate formulation of power analysis to provide a conceptually valid approach to the journals' wrongly worded but practically significant concern | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Biostatistics | |
| 650 | 4 | |a Observational Studies as Topic | |
| 650 | 4 | |a Power, Psychological | |
| 650 | 4 | |a Statistics as Topic | |
| 700 | 1 | |a Yang, Kun |e verfasserin |4 aut | |
| 700 | 1 | |a Chen, Ruohui |e verfasserin |4 aut | |
| 700 | 1 | |a Tu, Justin |e verfasserin |4 aut | |
| 700 | 1 | |a Xu, Manfei |e verfasserin |4 aut | |
| 700 | 1 | |a Tu, Xin M |e verfasserin |4 aut | |
| 700 | 1 | |a Zhang, Xinlian |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t General psychiatry |d 2018 |g 35(2022), 4 vom: 22., Seite e100764 |w (DE-627)NLM292114923 |x 2517-729X |7 nnns |
| 773 | 1 | 8 | |g volume:35 |g year:2022 |g number:4 |g day:22 |g pages:e100764 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1136/gpsych-2022-100764 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 35 |j 2022 |e 4 |b 22 |h e100764 | ||