Bridging language barriers in developing valid health policy research tools : insights from the translation and validation process of the SHEMESH questionnaire
© 2023. The Author(s)..
BACKGROUND: The use of research tools developed and validated in one cultural and linguistic context to another often faces challenges. One major challenge is poor performance of the tool in the new context. This potentially impact the legitimacy of health policy research conducted with informal adaptations of existing tools which have not been subjected to formal validation. Best practices exist to guide researchers in adapting and validating research tools effectively. We present here, as an extended example, our validation of the SHEMESH questionnaire ('Organizational Readiness to Change Assessment'; In Hebrew: 'SHE'elon Muchanut Ergunit le'SHinuy'), a Hebrew-language version of the Organizational Readiness to Change Assessment (ORCA). SHEMESH is tailored to support implementation science projects, whose aim is to promote a more rapid and complete adoption of evidence-based health policies and practices.
METHODS: The SHEMESH included originally eleven questions from the Evidence (item 1-4) and Context (items 5-11) domains. We validated SHEMESH through the following steps: 1. Professional translation to Hebrew and discussion of the translation by multidisciplinary committee; 2. Back-translation into English by a different translator to detect discrepancies; 3. Eleven cognitive interviews with psychiatric emergency department physicians and nurses; and 4. Pilot testing and psychometric analyses, including Cronbach's alpha for subscales and factor analyses.
RESULTS: Following translation and cognitive interviews, SHEMESH was administered to 222 psychiatrists and nurses. Pearson correlation showed significant and strong correlations of items 1-4 to the Evidence construct and items 6-11 to the Context construct. Item 5 did not correlate with the other items, and therefore was removed from the other psychometric procedures and eventually from the SHEMESH. Factor analysis with the remaining 10 items yielded two factors, which together explained a total of 69.7% of variance. Cronbach's Alpha scores for the two subscales were high (Evidence, 0.887, and Context, 0.852).
CONCLUSIONS: This multi-step validation process of the SHEMESH questionnaire may serve as a comprehensive guideline for others who are willing to adapt research tools that were developed in other languages. Practically, SHEMESH has been validated for use in implementation science research projects in Israel.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:12 |
|---|---|
| Enthalten in: |
Israel journal of health policy research - 12(2023), 1 vom: 26. Nov., Seite 36 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Shalev, Ligat [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Emergency department |
|---|
| Anmerkungen: |
Date Completed 28.11.2023 Date Revised 29.11.2023 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1186/s13584-023-00583-8 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM364999357 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM364999357 | ||
| 003 | DE-627 | ||
| 005 | 20231226100738.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1186/s13584-023-00583-8 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1216.xml |
| 035 | |a (DE-627)NLM364999357 | ||
| 035 | |a (NLM)38008722 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Shalev, Ligat |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Bridging language barriers in developing valid health policy research tools |b insights from the translation and validation process of the SHEMESH questionnaire |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 28.11.2023 | ||
| 500 | |a Date Revised 29.11.2023 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2023. The Author(s). | ||
| 520 | |a BACKGROUND: The use of research tools developed and validated in one cultural and linguistic context to another often faces challenges. One major challenge is poor performance of the tool in the new context. This potentially impact the legitimacy of health policy research conducted with informal adaptations of existing tools which have not been subjected to formal validation. Best practices exist to guide researchers in adapting and validating research tools effectively. We present here, as an extended example, our validation of the SHEMESH questionnaire ('Organizational Readiness to Change Assessment'; In Hebrew: 'SHE'elon Muchanut Ergunit le'SHinuy'), a Hebrew-language version of the Organizational Readiness to Change Assessment (ORCA). SHEMESH is tailored to support implementation science projects, whose aim is to promote a more rapid and complete adoption of evidence-based health policies and practices | ||
| 520 | |a METHODS: The SHEMESH included originally eleven questions from the Evidence (item 1-4) and Context (items 5-11) domains. We validated SHEMESH through the following steps: 1. Professional translation to Hebrew and discussion of the translation by multidisciplinary committee; 2. Back-translation into English by a different translator to detect discrepancies; 3. Eleven cognitive interviews with psychiatric emergency department physicians and nurses; and 4. Pilot testing and psychometric analyses, including Cronbach's alpha for subscales and factor analyses | ||
| 520 | |a RESULTS: Following translation and cognitive interviews, SHEMESH was administered to 222 psychiatrists and nurses. Pearson correlation showed significant and strong correlations of items 1-4 to the Evidence construct and items 6-11 to the Context construct. Item 5 did not correlate with the other items, and therefore was removed from the other psychometric procedures and eventually from the SHEMESH. Factor analysis with the remaining 10 items yielded two factors, which together explained a total of 69.7% of variance. Cronbach's Alpha scores for the two subscales were high (Evidence, 0.887, and Context, 0.852) | ||
| 520 | |a CONCLUSIONS: This multi-step validation process of the SHEMESH questionnaire may serve as a comprehensive guideline for others who are willing to adapt research tools that were developed in other languages. Practically, SHEMESH has been validated for use in implementation science research projects in Israel | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Emergency department | |
| 650 | 4 | |a Implementation science | |
| 650 | 4 | |a Organizational innovation | |
| 650 | 4 | |a Psychometrics | |
| 650 | 4 | |a Validation process | |
| 700 | 1 | |a Helfrich, Christian D |e verfasserin |4 aut | |
| 700 | 1 | |a Ellen, Moriah |e verfasserin |4 aut | |
| 700 | 1 | |a Avirame, Keren |e verfasserin |4 aut | |
| 700 | 1 | |a Eitan, Renana |e verfasserin |4 aut | |
| 700 | 1 | |a Rose, Adam J |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Israel journal of health policy research |d 2012 |g 12(2023), 1 vom: 26. Nov., Seite 36 |w (DE-627)NLM220417350 |x 2045-4015 |7 nnns |
| 773 | 1 | 8 | |g volume:12 |g year:2023 |g number:1 |g day:26 |g month:11 |g pages:36 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1186/s13584-023-00583-8 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 12 |j 2023 |e 1 |b 26 |c 11 |h 36 | ||