How hazardous are hazard ratios? An empirical investigation of individual patient data from 27 large randomized clinical trials
Abstract The use of hazard ratios as the standard treatment effect estimators for randomized trials with time-to-event outcomes has been the subject of repeated criticisms in recent years, e.g., for its non-collapsibility or with respect to (causal) interpretation. Another important issue is the built-in selection bias, which arises when the treatment is effective and when there are unobserved or not included prognostic factors that influence time-to-event. In these cases, the hazard ratio has even been termed “hazardous” because it is estimated from groups that increasingly differ in their (unobserved or omitted) baseline characteristics, yielding biased treatment estimates. We therefore adapt the Landmarking approach to assess the effect of ignoring a gradually increasing proportion of early events on the estimated hazard ratio. We propose an extension called “Dynamic Landmarking”. This approach is based on successive deletion of observations, refitting Cox models and balance checking of omitted but observed prognostic factors, to obtain a visualization that can indicate built-in selection bias. In a small proof-of-concept simulation, we show that our approach is valid under the given assumptions. We further use “Dynamic Landmarking” to assess the suspected selection bias in the individual patient data sets of 27 large randomized clinical trials (RCTs). Surprisingly, we find no empirical evidence of selection bias in these RCTs and thus conclude that the supposed bias of the hazard ratio is of little practical relevance in most cases. This is mainly due to treatment effects in RCTs being small and the patient populations being homogeneous, e.g., due to inclusion and exclusion criteria..
| Medienart: |
Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:38 |
|---|---|
| Enthalten in: |
European journal of epidemiology - 38(2023), 8 vom: 06. Juli, Seite 859-867 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Strobel, Alexandra [VerfasserIn] |
|---|
| Links: |
Volltext [lizenzpflichtig] |
|---|
| Themen: |
|---|
| Anmerkungen: |
© Springer Nature B.V. 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. |
|---|
| doi: |
10.1007/s10654-023-01026-z |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
OLC2144965749 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | OLC2144965749 | ||
| 003 | DE-627 | ||
| 005 | 20240118102016.0 | ||
| 007 | tu | ||
| 008 | 240118s2023 xx ||||| 00| ||eng c | ||
| 024 | 7 | |a 10.1007/s10654-023-01026-z |2 doi | |
| 035 | |a (DE-627)OLC2144965749 | ||
| 035 | |a (DE-He213)s10654-023-01026-z-p | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 082 | 0 | 4 | |a 610 |q VZ |
| 100 | 1 | |a Strobel, Alexandra |e verfasserin |0 (orcid)0000-0002-0018-2591 |4 aut | |
| 245 | 1 | 0 | |a How hazardous are hazard ratios? An empirical investigation of individual patient data from 27 large randomized clinical trials |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ohne Hilfsmittel zu benutzen |b n |2 rdamedia | ||
| 338 | |a Band |b nc |2 rdacarrier | ||
| 500 | |a © Springer Nature B.V. 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. | ||
| 520 | |a Abstract The use of hazard ratios as the standard treatment effect estimators for randomized trials with time-to-event outcomes has been the subject of repeated criticisms in recent years, e.g., for its non-collapsibility or with respect to (causal) interpretation. Another important issue is the built-in selection bias, which arises when the treatment is effective and when there are unobserved or not included prognostic factors that influence time-to-event. In these cases, the hazard ratio has even been termed “hazardous” because it is estimated from groups that increasingly differ in their (unobserved or omitted) baseline characteristics, yielding biased treatment estimates. We therefore adapt the Landmarking approach to assess the effect of ignoring a gradually increasing proportion of early events on the estimated hazard ratio. We propose an extension called “Dynamic Landmarking”. This approach is based on successive deletion of observations, refitting Cox models and balance checking of omitted but observed prognostic factors, to obtain a visualization that can indicate built-in selection bias. In a small proof-of-concept simulation, we show that our approach is valid under the given assumptions. We further use “Dynamic Landmarking” to assess the suspected selection bias in the individual patient data sets of 27 large randomized clinical trials (RCTs). Surprisingly, we find no empirical evidence of selection bias in these RCTs and thus conclude that the supposed bias of the hazard ratio is of little practical relevance in most cases. This is mainly due to treatment effects in RCTs being small and the patient populations being homogeneous, e.g., due to inclusion and exclusion criteria. | ||
| 650 | 4 | |a Cox model | |
| 650 | 4 | |a Survival analysis | |
| 650 | 4 | |a Hazard ratio | |
| 650 | 4 | |a Bias | |
| 650 | 4 | |a RCT | |
| 700 | 1 | |a Wienke, Andreas |4 aut | |
| 700 | 1 | |a Kuss, Oliver |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t European journal of epidemiology |d Springer Netherlands, 1985 |g 38(2023), 8 vom: 06. Juli, Seite 859-867 |w (DE-627)168085305 |w (DE-600)632614-6 |w (DE-576)018246303 |x 0393-2990 |7 nnns |
| 773 | 1 | 8 | |g volume:38 |g year:2023 |g number:8 |g day:06 |g month:07 |g pages:859-867 |
| 856 | 4 | 1 | |u https://doi.org/10.1007/s10654-023-01026-z |z lizenzpflichtig |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a SYSFLAG_A | ||
| 912 | |a GBV_OLC | ||
| 951 | |a AR | ||
| 952 | |d 38 |j 2023 |e 8 |b 06 |c 07 |h 859-867 | ||