Statistical Decision Properties of Imprecise Trials Assessing COVID-19 Drugs
As the COVID-19 pandemic progresses, researchers are reporting findings of randomized trials comparing standard care with care augmented by experimental drugs. The trials have small sample sizes, so estimates of treatment effects are imprecise. Seeing imprecision, clinicians reading research articles may find it difficult to decide when to treat patients with experimental drugs. Whatever decision criterion one uses, there is always some probability that random variation in trial outcomes will lead to prescribing sub-optimal treatments. A conventional practice when comparing standard care and an innovation is to choose the innovation only if the estimated treatment effect is positive and statistically significant. This practice defers to standard care as the status quo. To evaluate decision criteria, we use the concept of near-optimality, which jointly considers the probability and magnitude of decision errors. An appealing decision criterion from this perspective is the empirical success rule, which chooses the treatment with the highest observed average patient outcome in the trial. Considering the design of recent and ongoing COVID-19 trials, we show that the empirical success rule yields treatment results that are much closer to optimal than those generated by prevailing decision criteria based on hypothesis tests..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2020 |
|---|---|
| Erschienen: |
2020 |
| Enthalten in: |
arXiv.org - (2020) vom: 30. Mai Zur Gesamtaufnahme - year:2020 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Manski, Charles F. [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| Förderinstitution / Projekttitel: |
|
|---|
| PPN (Katalog-ID): |
XAR018031153 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | XAR018031153 | ||
| 003 | DE-627 | ||
| 005 | 20230429070942.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 200602s2020 xx |||||o 00| ||eng c | ||
| 035 | |a (DE-627)XAR018031153 | ||
| 035 | |a (arXiv)2006.00343 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 082 | 0 | |a 330 | |
| 082 | 0 | |a 570 | |
| 082 | 0 | |a 510 | |
| 245 | 1 | 0 | |a Statistical Decision Properties of Imprecise Trials Assessing COVID-19 Drugs |
| 264 | 1 | |c 2020 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a As the COVID-19 pandemic progresses, researchers are reporting findings of randomized trials comparing standard care with care augmented by experimental drugs. The trials have small sample sizes, so estimates of treatment effects are imprecise. Seeing imprecision, clinicians reading research articles may find it difficult to decide when to treat patients with experimental drugs. Whatever decision criterion one uses, there is always some probability that random variation in trial outcomes will lead to prescribing sub-optimal treatments. A conventional practice when comparing standard care and an innovation is to choose the innovation only if the estimated treatment effect is positive and statistically significant. This practice defers to standard care as the status quo. To evaluate decision criteria, we use the concept of near-optimality, which jointly considers the probability and magnitude of decision errors. An appealing decision criterion from this perspective is the empirical success rule, which chooses the treatment with the highest observed average patient outcome in the trial. Considering the design of recent and ongoing COVID-19 trials, we show that the empirical success rule yields treatment results that are much closer to optimal than those generated by prevailing decision criteria based on hypothesis tests. | ||
| 700 | 1 | |a Manski, Charles F. |e verfasserin |4 aut | |
| 700 | 1 | |a Tetenov, Aleksey |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t arXiv.org |g (2020) vom: 30. Mai |
| 773 | 1 | 8 | |g year:2020 |g day:30 |g month:05 |
| 856 | 4 | 0 | |u https://arxiv.org/abs/2006.00343 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XAR | ||
| 912 | |a SSG-OLC-PHA | ||
| 951 | |a AR | ||
| 952 | |j 2020 |b 30 |c 05 | ||
| 953 | |2 045F |a 330 | ||
| 953 | |2 045F |a 570 | ||
| 953 | |2 045F |a 510 | ||