Worked-out examples of the adequacy of Bayesian optional stopping
© 2021. The Psychonomic Society, Inc..
The practice of sequentially testing a null hypothesis as data are collected until the null hypothesis is rejected is known as optional stopping. It is well known that optional stopping is problematic in the context of p value-based null hypothesis significance testing: The false-positive rates quickly overcome the single test's significance level. However, the state of affairs under null hypothesis Bayesian testing, where p values are replaced by Bayes factors, has perhaps surprisingly been much less consensual. Rouder (2014) used simulations to defend the use of optional stopping under null hypothesis Bayesian testing. The idea behind these simulations is closely related to the idea of sampling from prior predictive distributions. Deng et al. (2016) and Hendriksen et al. (2020) have provided mathematical evidence to the effect that optional stopping under null hypothesis Bayesian testing does hold under some conditions. These papers are, however, exceedingly technical for most researchers in the applied social sciences. In this paper, we provide some mathematical derivations concerning Rouder's approximate simulation results for the two Bayesian hypothesis tests that he considered. The key idea is to consider the probability distribution of the Bayes factor, which is regarded as being a random variable across repeated sampling. This paper therefore offers an intuitive perspective to the literature and we believe it is a valid contribution towards understanding the practice of optional stopping in the context of Bayesian hypothesis testing.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:29 |
|---|---|
| Enthalten in: |
Psychonomic bulletin & review - 29(2022), 1 vom: 12. Feb., Seite 70-87 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Tendeiro, Jorge N [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Bayes factor |
|---|
| Anmerkungen: |
Date Completed 22.02.2022 Date Revised 22.02.2022 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.3758/s13423-021-01962-5 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM32800006X |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM32800006X | ||
| 003 | DE-627 | ||
| 005 | 20231225202028.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.3758/s13423-021-01962-5 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1093.xml |
| 035 | |a (DE-627)NLM32800006X | ||
| 035 | |a (NLM)34254263 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Tendeiro, Jorge N |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Worked-out examples of the adequacy of Bayesian optional stopping |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 22.02.2022 | ||
| 500 | |a Date Revised 22.02.2022 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2021. The Psychonomic Society, Inc. | ||
| 520 | |a The practice of sequentially testing a null hypothesis as data are collected until the null hypothesis is rejected is known as optional stopping. It is well known that optional stopping is problematic in the context of p value-based null hypothesis significance testing: The false-positive rates quickly overcome the single test's significance level. However, the state of affairs under null hypothesis Bayesian testing, where p values are replaced by Bayes factors, has perhaps surprisingly been much less consensual. Rouder (2014) used simulations to defend the use of optional stopping under null hypothesis Bayesian testing. The idea behind these simulations is closely related to the idea of sampling from prior predictive distributions. Deng et al. (2016) and Hendriksen et al. (2020) have provided mathematical evidence to the effect that optional stopping under null hypothesis Bayesian testing does hold under some conditions. These papers are, however, exceedingly technical for most researchers in the applied social sciences. In this paper, we provide some mathematical derivations concerning Rouder's approximate simulation results for the two Bayesian hypothesis tests that he considered. The key idea is to consider the probability distribution of the Bayes factor, which is regarded as being a random variable across repeated sampling. This paper therefore offers an intuitive perspective to the literature and we believe it is a valid contribution towards understanding the practice of optional stopping in the context of Bayesian hypothesis testing | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Bayes factor | |
| 650 | 4 | |a Null hypothesis Bayesian testing | |
| 650 | 4 | |a Null hypothesis significance testing | |
| 650 | 4 | |a Sequential testing | |
| 650 | 4 | |a p value | |
| 700 | 1 | |a Kiers, Henk A L |e verfasserin |4 aut | |
| 700 | 1 | |a van Ravenzwaaij, Don |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Psychonomic bulletin & review |d 1994 |g 29(2022), 1 vom: 12. Feb., Seite 70-87 |w (DE-627)NLM106102141 |x 1531-5320 |7 nnns |
| 773 | 1 | 8 | |g volume:29 |g year:2022 |g number:1 |g day:12 |g month:02 |g pages:70-87 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.3758/s13423-021-01962-5 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 29 |j 2022 |e 1 |b 12 |c 02 |h 70-87 | ||