Evidence reversals in primary care research : a study of randomized controlled trials
© The Author(s) 2021. Published by Oxford University Press. All rights reserved.For permissions, please e-mail: journals.permissionsoup.com..
BACKGROUND: Evidence-Based Medicine is built on the premise that clinicians can be more confident when their decisions are grounded in high-quality evidence. Furthermore, evidence from studies involving patient-oriented outcomes is preferred when making decisions about tests or treatments. Ideally, the findings of relevant and valid trials should be stable over time, that is, unlikely to be reversed in subsequent research.
OBJECTIVE: To evaluate the stability of evidence from trials relevant to primary healthcare and to identify study characteristics associated with their reversal.
METHODS: We studied synopses of randomized controlled trials (RCTs) published from 2002 to 2005 as "Daily POEMs" (Patient Oriented Evidence that Matters). The initial evidence (E1) from these POEMs (2002-2005) was compared with the updated evidence (E2) on that same topic in a summary resource (DynaMed 2019). Two physician-raters independently categorized each POEM-RCT as (i) reversed when E1 ≠ E2, or as (ii) not reversed, when E1 = E2. For all "Evidence Reversals" (E1 ≠ E2), we assessed the direction of change in the evidence.
RESULTS: We evaluated 408 POEMs on RCTs. Of those, 35 (9%; 95% confidence interval [6-12]) were identified as reversed, 359 (88%) were identified as not reversed, and 14 (3%) were indeterminate. On average, this represents about 2 evidence reversals per annum for POEMs about RCTs.
CONCLUSIONS: Over 12-17 years, 9% of RCTs summarized as POEMs are reversed. Information alerting services that apply strict criteria for relevance and validity of clinical information are likely to identify RCTs whose findings are stable over time.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:39 |
|---|---|
| Enthalten in: |
Family practice - 39(2022), 4 vom: 19. Juli, Seite 565-569 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Ruchon, Christian [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Contradicted findings |
|---|
| Anmerkungen: |
Date Completed 20.07.2022 Date Revised 15.10.2022 published: Print Citation Status MEDLINE |
|---|
| doi: |
10.1093/fampra/cmab104 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM330949756 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM330949756 | ||
| 003 | DE-627 | ||
| 005 | 20231225212409.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1093/fampra/cmab104 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1103.xml |
| 035 | |a (DE-627)NLM330949756 | ||
| 035 | |a (NLM)34553219 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Ruchon, Christian |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Evidence reversals in primary care research |b a study of randomized controlled trials |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 20.07.2022 | ||
| 500 | |a Date Revised 15.10.2022 | ||
| 500 | |a published: Print | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © The Author(s) 2021. Published by Oxford University Press. All rights reserved.For permissions, please e-mail: journals.permissionsoup.com. | ||
| 520 | |a BACKGROUND: Evidence-Based Medicine is built on the premise that clinicians can be more confident when their decisions are grounded in high-quality evidence. Furthermore, evidence from studies involving patient-oriented outcomes is preferred when making decisions about tests or treatments. Ideally, the findings of relevant and valid trials should be stable over time, that is, unlikely to be reversed in subsequent research | ||
| 520 | |a OBJECTIVE: To evaluate the stability of evidence from trials relevant to primary healthcare and to identify study characteristics associated with their reversal | ||
| 520 | |a METHODS: We studied synopses of randomized controlled trials (RCTs) published from 2002 to 2005 as "Daily POEMs" (Patient Oriented Evidence that Matters). The initial evidence (E1) from these POEMs (2002-2005) was compared with the updated evidence (E2) on that same topic in a summary resource (DynaMed 2019). Two physician-raters independently categorized each POEM-RCT as (i) reversed when E1 ≠ E2, or as (ii) not reversed, when E1 = E2. For all "Evidence Reversals" (E1 ≠ E2), we assessed the direction of change in the evidence | ||
| 520 | |a RESULTS: We evaluated 408 POEMs on RCTs. Of those, 35 (9%; 95% confidence interval [6-12]) were identified as reversed, 359 (88%) were identified as not reversed, and 14 (3%) were indeterminate. On average, this represents about 2 evidence reversals per annum for POEMs about RCTs | ||
| 520 | |a CONCLUSIONS: Over 12-17 years, 9% of RCTs summarized as POEMs are reversed. Information alerting services that apply strict criteria for relevance and validity of clinical information are likely to identify RCTs whose findings are stable over time | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a Evidence-Based Medicine/trends | |
| 650 | 4 | |a contradicted findings | |
| 650 | 4 | |a evidence reversal | |
| 650 | 4 | |a evidence-based practice | |
| 650 | 4 | |a primary care | |
| 650 | 4 | |a randomized controlled trials | |
| 700 | 1 | |a Grad, Roland |e verfasserin |4 aut | |
| 700 | 1 | |a Ebell, Mark H |e verfasserin |4 aut | |
| 700 | 1 | |a Slawson, David C |e verfasserin |4 aut | |
| 700 | 1 | |a Pluye, Pierre |e verfasserin |4 aut | |
| 700 | 1 | |a Filion, Kristian B |e verfasserin |4 aut | |
| 700 | 1 | |a Rousseau, Mathieu |e verfasserin |4 aut | |
| 700 | 1 | |a Braschi, Emelie |e verfasserin |4 aut | |
| 700 | 1 | |a Sridhar, Soumya |e verfasserin |4 aut | |
| 700 | 1 | |a Grover-Wenk, Anupriya |e verfasserin |4 aut | |
| 700 | 1 | |a Cheung, Jennifer Ren-Si |e verfasserin |4 aut | |
| 700 | 1 | |a Shaughnessy, Allen F |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Family practice |d 1993 |g 39(2022), 4 vom: 19. Juli, Seite 565-569 |w (DE-627)NLM013359614 |x 1460-2229 |7 nnns |
| 773 | 1 | 8 | |g volume:39 |g year:2022 |g number:4 |g day:19 |g month:07 |g pages:565-569 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1093/fampra/cmab104 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 39 |j 2022 |e 4 |b 19 |c 07 |h 565-569 | ||