A behaviourally anchored rating scale for evaluating the use of the WHO surgical safety checklist : development and initial evaluation of the WHOBARS
Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.
BACKGROUND: Realising the full potential of the WHO Surgical Safety Checklist (SSC) to reduce perioperative harm requires the constructive engagement of all operating room (OR) team members during its administration. To facilitate research on SSC implementation, a valid and reliable instrument is needed for measuring OR team behaviours during its administration. We developed a behaviourally anchored rating scale (BARS) for this purpose.
METHODS: We used a modified Delphi process, involving 16 subject matter experts, to compile a BARS with behavioural domains applicable to all three phases of the SSC. We evaluated the instrument in 80 adult OR cases and 30 simulated cases using two medical student raters and seven expert raters, respectively. Intraclass correlation coefficients were calculated to assess inter-rater reliability. Internal consistency and instrument discrimination were explored. Sample size estimates for potential study designs using the instrument were calculated.
RESULTS: The Delphi process resulted in a BARS instrument (the WHOBARS) with five behavioural domains. Intraclass correlation coefficients calculated from the OR cases exceeded 0.80 for 80% of the instrument's domains across the SSC phases. The WHOBARS showed high internal consistency across the three phases of the SSC and ability to discriminate among surgical cases in both clinical and simulated settings. Fewer than 20 cases per group would be required to show a difference of 1 point between groups in studies of the SSC, where α=0.05 and β=0.8.
CONCLUSION: We have developed a generic instrument for comprehensively rating the administration of the SSC and informing initiatives to realise its full potential. We have provided data supporting its capacity for discrimination, internal consistency and inter-rater reliability. Further psychometric evaluation is warranted.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2016 |
|---|---|
| Erschienen: |
2016 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:25 |
|---|---|
| Enthalten in: |
BMJ quality & safety - 25(2016), 10 vom: 04. Okt., Seite 778-86 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Devcich, Daniel A [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Checklists |
|---|
| Anmerkungen: |
Date Completed 05.01.2018 Date Revised 31.03.2022 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1136/bmjqs-2015-004448 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM254836658 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM254836658 | ||
| 003 | DE-627 | ||
| 005 | 20231224173229.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231224s2016 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1136/bmjqs-2015-004448 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n0849.xml |
| 035 | |a (DE-627)NLM254836658 | ||
| 035 | |a (NLM)26590200 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Devcich, Daniel A |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A behaviourally anchored rating scale for evaluating the use of the WHO surgical safety checklist |b development and initial evaluation of the WHOBARS |
| 264 | 1 | |c 2016 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 05.01.2018 | ||
| 500 | |a Date Revised 31.03.2022 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/ | ||
| 520 | |a BACKGROUND: Realising the full potential of the WHO Surgical Safety Checklist (SSC) to reduce perioperative harm requires the constructive engagement of all operating room (OR) team members during its administration. To facilitate research on SSC implementation, a valid and reliable instrument is needed for measuring OR team behaviours during its administration. We developed a behaviourally anchored rating scale (BARS) for this purpose | ||
| 520 | |a METHODS: We used a modified Delphi process, involving 16 subject matter experts, to compile a BARS with behavioural domains applicable to all three phases of the SSC. We evaluated the instrument in 80 adult OR cases and 30 simulated cases using two medical student raters and seven expert raters, respectively. Intraclass correlation coefficients were calculated to assess inter-rater reliability. Internal consistency and instrument discrimination were explored. Sample size estimates for potential study designs using the instrument were calculated | ||
| 520 | |a RESULTS: The Delphi process resulted in a BARS instrument (the WHOBARS) with five behavioural domains. Intraclass correlation coefficients calculated from the OR cases exceeded 0.80 for 80% of the instrument's domains across the SSC phases. The WHOBARS showed high internal consistency across the three phases of the SSC and ability to discriminate among surgical cases in both clinical and simulated settings. Fewer than 20 cases per group would be required to show a difference of 1 point between groups in studies of the SSC, where α=0.05 and β=0.8 | ||
| 520 | |a CONCLUSION: We have developed a generic instrument for comprehensively rating the administration of the SSC and informing initiatives to realise its full potential. We have provided data supporting its capacity for discrimination, internal consistency and inter-rater reliability. Further psychometric evaluation is warranted | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a Checklists | |
| 650 | 4 | |a Communication | |
| 650 | 4 | |a Patient safety | |
| 650 | 4 | |a Surgery | |
| 650 | 4 | |a Teamwork | |
| 700 | 1 | |a Weller, Jennifer |e verfasserin |4 aut | |
| 700 | 1 | |a Mitchell, Simon J |e verfasserin |4 aut | |
| 700 | 1 | |a McLaughlin, Scott |e verfasserin |4 aut | |
| 700 | 1 | |a Barker, Lauren |e verfasserin |4 aut | |
| 700 | 1 | |a Rudolph, Jenny W |e verfasserin |4 aut | |
| 700 | 1 | |a Raemer, Daniel B |e verfasserin |4 aut | |
| 700 | 1 | |a Zammert, Martin |e verfasserin |4 aut | |
| 700 | 1 | |a Singer, Sara J |e verfasserin |4 aut | |
| 700 | 1 | |a Torrie, Jane |e verfasserin |4 aut | |
| 700 | 1 | |a Frampton, Chris Ma |e verfasserin |4 aut | |
| 700 | 1 | |a Merry, Alan F |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t BMJ quality & safety |d 2011 |g 25(2016), 10 vom: 04. Okt., Seite 778-86 |w (DE-627)NLM204824729 |x 2044-5423 |7 nnns |
| 773 | 1 | 8 | |g volume:25 |g year:2016 |g number:10 |g day:04 |g month:10 |g pages:778-86 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1136/bmjqs-2015-004448 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 25 |j 2016 |e 10 |b 04 |c 10 |h 778-86 | ||