The usefulness of work-based assessments in higher surgical training : A systematic review
Copyright © 2021 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved..
BACKGROUND: Work-based assessments including procedure based assessments, case based discussions, clinical evaluation exercises and direct observation of procedural skills are used in Higher Surgical Training Program. This systematic review aims to investigate the trainer and trainee's perception of the usefulness of workplace based assessments in Higher Surgical Training Programme.
MATERIALS AND METHODS: Embase, MEDLINE and PubMed databases were searched for relevant studies published up to Jan 15, 2021. The following search terms were used: procedure based assessments, case based discussions, clinical evaluation exercises, direct observation of procedural skills, Higher Surgical Training Program (with and without their abbreviations), surgical training, formative assessment. Usefulness was analysed according to van der Vleuten's utility formula, which is the product of educational impact, validity, reliability, acceptability, cost-effectiveness and feasibility.
RESULTS: 23 studies were included; Six on procedure based assessments, two on case based discussions, one on mini clinical evaluation exercises, three on direct observation of procedural skills and eleven on multiple methods. Overall, procedure based assessments had positive Kirkpatrick level 1 or 2 impact were valid, reliable and acceptable. Mini clinical evaluation exercises showed positive Kirkpatrick level 1 satisfaction in trainees and trainers and were feasible. Case based discussions were shown to have both positive and negative Kirkpatrick levels 1 and 2 impact and were rated valid and reliable. Direct observation of procedural skills were valid with favourable Kirkpatrick level 1 impact with more usage and modification of the forms. Multiple methods as used in the intercollegiate surgical curriculum programme portfolio was found to be less encouraging in achieving positive higher level of educational impact. The barriers included lack of time, lack of faculty development and lack of engagement.
CONCLUSION: It is important that work-based assessments are used properly, so that trainees get the maximum benefit from them. None of the studies included in our systematic review demonstrated an impact on behaviour or society (Kirkpatrick level 3 and 4), towards which future research should be directed to.
| Errataetall: | |
|---|---|
| Medienart: |
E-Artikel |
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:94 |
|---|---|
| Enthalten in: |
International journal of surgery (London, England) - 94(2021) vom: 20. Okt., Seite 106127 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Aryal, Kamal [VerfasserIn] |
|---|
| Links: |
|---|
| Anmerkungen: |
Date Completed 11.11.2021 Date Revised 02.03.2023 published: Print-Electronic CommentIn: Int J Surg. 2022 Jan;97:106199. - PMID 34973422 Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.ijsu.2021.106127 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM331392216 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM331392216 | ||
| 003 | DE-627 | ||
| 005 | 20231225213347.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.ijsu.2021.106127 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1104.xml |
| 035 | |a (DE-627)NLM331392216 | ||
| 035 | |a (NLM)34597821 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Aryal, Kamal |e verfasserin |4 aut | |
| 245 | 1 | 4 | |a The usefulness of work-based assessments in higher surgical training |b A systematic review |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 11.11.2021 | ||
| 500 | |a Date Revised 02.03.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a CommentIn: Int J Surg. 2022 Jan;97:106199. - PMID 34973422 | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2021 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved. | ||
| 520 | |a BACKGROUND: Work-based assessments including procedure based assessments, case based discussions, clinical evaluation exercises and direct observation of procedural skills are used in Higher Surgical Training Program. This systematic review aims to investigate the trainer and trainee's perception of the usefulness of workplace based assessments in Higher Surgical Training Programme | ||
| 520 | |a MATERIALS AND METHODS: Embase, MEDLINE and PubMed databases were searched for relevant studies published up to Jan 15, 2021. The following search terms were used: procedure based assessments, case based discussions, clinical evaluation exercises, direct observation of procedural skills, Higher Surgical Training Program (with and without their abbreviations), surgical training, formative assessment. Usefulness was analysed according to van der Vleuten's utility formula, which is the product of educational impact, validity, reliability, acceptability, cost-effectiveness and feasibility | ||
| 520 | |a RESULTS: 23 studies were included; Six on procedure based assessments, two on case based discussions, one on mini clinical evaluation exercises, three on direct observation of procedural skills and eleven on multiple methods. Overall, procedure based assessments had positive Kirkpatrick level 1 or 2 impact were valid, reliable and acceptable. Mini clinical evaluation exercises showed positive Kirkpatrick level 1 satisfaction in trainees and trainers and were feasible. Case based discussions were shown to have both positive and negative Kirkpatrick levels 1 and 2 impact and were rated valid and reliable. Direct observation of procedural skills were valid with favourable Kirkpatrick level 1 impact with more usage and modification of the forms. Multiple methods as used in the intercollegiate surgical curriculum programme portfolio was found to be less encouraging in achieving positive higher level of educational impact. The barriers included lack of time, lack of faculty development and lack of engagement | ||
| 520 | |a CONCLUSION: It is important that work-based assessments are used properly, so that trainees get the maximum benefit from them. None of the studies included in our systematic review demonstrated an impact on behaviour or society (Kirkpatrick level 3 and 4), towards which future research should be directed to | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Systematic Review | |
| 650 | 4 | |a Case based discussion | |
| 650 | 4 | |a Clinical evaluation exercise | |
| 650 | 4 | |a Direct observation of procedural skills | |
| 650 | 4 | |a Formative assessment | |
| 650 | 4 | |a Procedure based assessment | |
| 650 | 4 | |a Surgical training | |
| 650 | 4 | |a Work-based assessments | |
| 700 | 1 | |a Hamed, Mazin |e verfasserin |4 aut | |
| 700 | 1 | |a Currow, Chelise |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t International journal of surgery (London, England) |d 2004 |g 94(2021) vom: 20. Okt., Seite 106127 |w (DE-627)NLM169227847 |x 1743-9159 |7 nnns |
| 773 | 1 | 8 | |g volume:94 |g year:2021 |g day:20 |g month:10 |g pages:106127 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.ijsu.2021.106127 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 94 |j 2021 |b 20 |c 10 |h 106127 | ||