Cumulative Sum Chart as Complement to Objective Assessment of Graduating Surgical Resident Competency : An Exploratory Study
Copyright © 2023 by the American College of Surgeons. Published by Wolters Kluwer Health, Inc. All rights reserved..
BACKGROUND: Rater-based assessment and objective assessment play an important role in evaluating residents' clinical competencies. We hypothesize that a cumulative sum (CUSUM) chart of operative time is a complement to the assessment of chief general surgery residents' competencies with ACGME Milestones, aiding residency programs' determination of graduating residents' practice readiness.
STUDY DESIGN: We extracted ACGME Milestone evaluations of performance of operations and procedures (POP) and 3 objective metrics (operative time, case type, and case complexity) from 3 procedures (cholecystectomy, colectomy, and inguinal hernia) performed by 3 cohorts of residents (N = 15) during their PGY4-5. CUSUM charts were computed for each resident on each procedure type. A learning plateau was defined as at least 4 cases consistently locating around the centerline (target performance) at the end of a CUSUM chart with minimal deviations (range 0 to 1).
RESULTS: All residents reached the ACGME graduation targets for the overall POP by the end of chief year. A total of 2,446 cases were included (cholecystectomy N = 1234, colectomy N = 507, and inguinal hernia N = 705), and 3 CUSUM chart patterns emerged: skewed distribution, bimodal distribution, and peaks and valleys distribution. Analysis of CUSUM charts revealed surgery residents' development processes in the operating room towards a learning plateau vary, and only 46.7% residents reach a learning plateau in all 3 procedures upon graduation.
CONCLUSIONS: CUSUM charts of operative time complement the ACGME Milestones evaluations. The use of both may enable residency programs to holistically determine graduating residents' practice readiness and provide recommendations for their upcoming career/practice transition.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:237 |
|---|---|
| Enthalten in: |
Journal of the American College of Surgeons - 237(2023), 6 vom: 01. Dez., Seite 894-901 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Chen, Xiaodong Phoenix [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 14.02.2024 Date Revised 28.02.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1097/XCS.0000000000000812 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM360301746 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM360301746 | ||
| 003 | DE-627 | ||
| 005 | 20240229234240.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1097/XCS.0000000000000812 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1311.xml |
| 035 | |a (DE-627)NLM360301746 | ||
| 035 | |a (NLM)37530413 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Chen, Xiaodong Phoenix |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Cumulative Sum Chart as Complement to Objective Assessment of Graduating Surgical Resident Competency |b An Exploratory Study |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 14.02.2024 | ||
| 500 | |a Date Revised 28.02.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2023 by the American College of Surgeons. Published by Wolters Kluwer Health, Inc. All rights reserved. | ||
| 520 | |a BACKGROUND: Rater-based assessment and objective assessment play an important role in evaluating residents' clinical competencies. We hypothesize that a cumulative sum (CUSUM) chart of operative time is a complement to the assessment of chief general surgery residents' competencies with ACGME Milestones, aiding residency programs' determination of graduating residents' practice readiness | ||
| 520 | |a STUDY DESIGN: We extracted ACGME Milestone evaluations of performance of operations and procedures (POP) and 3 objective metrics (operative time, case type, and case complexity) from 3 procedures (cholecystectomy, colectomy, and inguinal hernia) performed by 3 cohorts of residents (N = 15) during their PGY4-5. CUSUM charts were computed for each resident on each procedure type. A learning plateau was defined as at least 4 cases consistently locating around the centerline (target performance) at the end of a CUSUM chart with minimal deviations (range 0 to 1) | ||
| 520 | |a RESULTS: All residents reached the ACGME graduation targets for the overall POP by the end of chief year. A total of 2,446 cases were included (cholecystectomy N = 1234, colectomy N = 507, and inguinal hernia N = 705), and 3 CUSUM chart patterns emerged: skewed distribution, bimodal distribution, and peaks and valleys distribution. Analysis of CUSUM charts revealed surgery residents' development processes in the operating room towards a learning plateau vary, and only 46.7% residents reach a learning plateau in all 3 procedures upon graduation | ||
| 520 | |a CONCLUSIONS: CUSUM charts of operative time complement the ACGME Milestones evaluations. The use of both may enable residency programs to holistically determine graduating residents' practice readiness and provide recommendations for their upcoming career/practice transition | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Harzman, Alan |e verfasserin |4 aut | |
| 700 | 1 | |a Go, Michael |e verfasserin |4 aut | |
| 700 | 1 | |a Arnold, Mark |e verfasserin |4 aut | |
| 700 | 1 | |a Ellison, E Christopher |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of the American College of Surgeons |d 1997 |g 237(2023), 6 vom: 01. Dez., Seite 894-901 |w (DE-627)NLM074881000 |x 1879-1190 |7 nnns |
| 773 | 1 | 8 | |g volume:237 |g year:2023 |g number:6 |g day:01 |g month:12 |g pages:894-901 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1097/XCS.0000000000000812 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 237 |j 2023 |e 6 |b 01 |c 12 |h 894-901 | ||