Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment
© 2023. BioMed Central Ltd., part of Springer Nature..
BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment.
OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME).
METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale.
RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05).
CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:23 |
|---|---|
| Enthalten in: |
BMC medical education - 23(2023), 1 vom: 03. Okt., Seite 720 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Mink, Richard B [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Assessment |
|---|
| Anmerkungen: |
Date Completed 05.10.2023 Date Revised 21.11.2023 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1186/s12909-023-04689-0 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM362830517 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM362830517 | ||
| 003 | DE-627 | ||
| 005 | 20231226092048.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1186/s12909-023-04689-0 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1209.xml |
| 035 | |a (DE-627)NLM362830517 | ||
| 035 | |a (NLM)37789289 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Mink, Richard B |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 05.10.2023 | ||
| 500 | |a Date Revised 21.11.2023 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2023. BioMed Central Ltd., part of Springer Nature. | ||
| 520 | |a BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment | ||
| 520 | |a OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME) | ||
| 520 | |a METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale | ||
| 520 | |a RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05) | ||
| 520 | |a CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Assessment | |
| 650 | 4 | |a Correlation | |
| 650 | 4 | |a EPAs | |
| 650 | 4 | |a Equations | |
| 650 | 4 | |a Fellow | |
| 650 | 4 | |a Milestones | |
| 700 | 1 | |a Carraccio, Carol L |e verfasserin |4 aut | |
| 700 | 1 | |a Herman, Bruce E |e verfasserin |4 aut | |
| 700 | 1 | |a Weiss, Pnina |e verfasserin |4 aut | |
| 700 | 1 | |a Turner, David A |e verfasserin |4 aut | |
| 700 | 1 | |a Stafford, Diane E J |e verfasserin |4 aut | |
| 700 | 1 | |a McGann, Kathleen A |e verfasserin |4 aut | |
| 700 | 1 | |a Kesselheim, Jennifer |e verfasserin |4 aut | |
| 700 | 1 | |a Hsu, Deborah C |e verfasserin |4 aut | |
| 700 | 1 | |a High, Pamela C |e verfasserin |4 aut | |
| 700 | 1 | |a Fussell, Jill J |e verfasserin |4 aut | |
| 700 | 1 | |a Curran, Megan L |e verfasserin |4 aut | |
| 700 | 1 | |a Chess, Patricia R |e verfasserin |4 aut | |
| 700 | 1 | |a Sauer, Cary |e verfasserin |4 aut | |
| 700 | 1 | |a Pitts, Sarah |e verfasserin |4 aut | |
| 700 | 1 | |a Myers, Angela L |e verfasserin |4 aut | |
| 700 | 1 | |a Mahan, John D |e verfasserin |4 aut | |
| 700 | 1 | |a Dammann, Christiane E L |e verfasserin |4 aut | |
| 700 | 1 | |a Aye, Tandy |e verfasserin |4 aut | |
| 700 | 1 | |a Schwartz, Alan |e verfasserin |4 aut | |
| 700 | 0 | |a Subspecialty Pediatrics Investigator Network |e verfasserin |4 aut | |
| 700 | 1 | |a Havalad, Vinod |e investigator |4 oth | |
| 700 | 1 | |a Pinheiro, Joaquim |e investigator |4 oth | |
| 700 | 1 | |a Alderman, Elizabeth |e investigator |4 oth | |
| 700 | 1 | |a Fuloria, Mamta |e investigator |4 oth | |
| 700 | 1 | |a McCabe, Megan E |e investigator |4 oth | |
| 700 | 1 | |a Mehta, Jay |e investigator |4 oth | |
| 700 | 1 | |a Rivas, Yolanda |e investigator |4 oth | |
| 700 | 1 | |a Rosenberg, Maris |e investigator |4 oth | |
| 700 | 1 | |a Doughty, Cara |e investigator |4 oth | |
| 700 | 1 | |a Hergenroeder, Albert |e investigator |4 oth | |
| 700 | 1 | |a Kale, Arundhati |e investigator |4 oth | |
| 700 | 1 | |a Lee-Kim, YoungNa |e investigator |4 oth | |
| 700 | 1 | |a Rama, Jennifer A |e investigator |4 oth | |
| 700 | 1 | |a Steuber, Phil |e investigator |4 oth | |
| 700 | 1 | |a Voigt, Bob |e investigator |4 oth | |
| 700 | 1 | |a Hardy, Karen |e investigator |4 oth | |
| 700 | 1 | |a Johnston, Samantha |e investigator |4 oth | |
| 700 | 1 | |a Boyer, Debra |e investigator |4 oth | |
| 700 | 1 | |a Mauras, Carrie |e investigator |4 oth | |
| 700 | 1 | |a Schonwald, Alison |e investigator |4 oth | |
| 700 | 1 | |a Sharma, Tanvi |e investigator |4 oth | |
| 700 | 1 | |a Barron, Christine |e investigator |4 oth | |
| 700 | 1 | |a Dennehy, Penny |e investigator |4 oth | |
| 700 | 1 | |a Jacobs, Elizabeth S |e investigator |4 oth | |
| 700 | 1 | |a Welch, Jennifer |e investigator |4 oth | |
| 700 | 1 | |a Kumar, Deepak |e investigator |4 oth | |
| 700 | 1 | |a Mason, Katherine |e investigator |4 oth | |
| 700 | 1 | |a Roizen, Nancy |e investigator |4 oth | |
| 700 | 1 | |a Rose, Jerri A |e investigator |4 oth | |
| 700 | 1 | |a Bokor, Brooke |e investigator |4 oth | |
| 700 | 1 | |a Chapman, Jennifer I |e investigator |4 oth | |
| 700 | 1 | |a Frank, Lowell |e investigator |4 oth | |
| 700 | 1 | |a Sami, Iman |e investigator |4 oth | |
| 700 | 1 | |a Schuette, Jennifer |e investigator |4 oth | |
| 700 | 1 | |a Lutes, Ramona E |e investigator |4 oth | |
| 700 | 1 | |a Savelli, Stephanie |e investigator |4 oth | |
| 700 | 1 | |a Amirnovin, Rambod |e investigator |4 oth | |
| 700 | 1 | |a Harb, Rula |e investigator |4 oth | |
| 700 | 1 | |a Kato, Roberta |e investigator |4 oth | |
| 700 | 1 | |a Marzan, Karen |e investigator |4 oth | |
| 700 | 1 | |a Monzavi, Roshanak |e investigator |4 oth | |
| 700 | 1 | |a Vanderbilt, Doug |e investigator |4 oth | |
| 700 | 1 | |a Doughty, Lesley |e investigator |4 oth | |
| 700 | 1 | |a McAneney, Constance |e investigator |4 oth | |
| 700 | 1 | |a Rice, Ward |e investigator |4 oth | |
| 700 | 1 | |a Widdice, Lea |e investigator |4 oth | |
| 700 | 1 | |a Erenberg, Fran |e investigator |4 oth | |
| 700 | 1 | |a Gonzalez, Blanca E |e investigator |4 oth | |
| 700 | 1 | |a Adkins, Deanna |e investigator |4 oth | |
| 700 | 1 | |a Green, Deanna |e investigator |4 oth | |
| 700 | 1 | |a Narayan, Aditee |e investigator |4 oth | |
| 700 | 1 | |a Rehder, Kyle |e investigator |4 oth | |
| 700 | 1 | |a Clingenpeel, Joel |e investigator |4 oth | |
| 700 | 1 | |a Starling, Suzanne |e investigator |4 oth | |
| 700 | 1 | |a Karpen, Heidi Eigenrauch |e investigator |4 oth | |
| 700 | 1 | |a Rouster-Stevens, Kelly |e investigator |4 oth | |
| 700 | 1 | |a Bhatia, Jatinder |e investigator |4 oth | |
| 700 | 1 | |a Fuqua, John |e investigator |4 oth | |
| 700 | 1 | |a Anders, Jennifer |e investigator |4 oth | |
| 700 | 1 | |a Trent, Maria |e investigator |4 oth | |
| 700 | 1 | |a Ramanathan, Rangasamy |e investigator |4 oth | |
| 700 | 1 | |a Nicolau, Yona |e investigator |4 oth | |
| 700 | 1 | |a Dozor, Allen J |e investigator |4 oth | |
| 700 | 1 | |a Kinane, Thomas Bernard |e investigator |4 oth | |
| 700 | 1 | |a Stanley, Takara |e investigator |4 oth | |
| 700 | 1 | |a Rao, Amulya Nageswara |e investigator |4 oth | |
| 700 | 1 | |a Bone, Meredith |e investigator |4 oth | |
| 700 | 1 | |a Camarda, Lauren |e investigator |4 oth | |
| 700 | 1 | |a Heffner, Viday |e investigator |4 oth | |
| 700 | 1 | |a Kim, Olivia |e investigator |4 oth | |
| 700 | 1 | |a Nocton, Jay |e investigator |4 oth | |
| 700 | 1 | |a Rabbitt, Angela L |e investigator |4 oth | |
| 700 | 1 | |a Tower, Richard |e investigator |4 oth | |
| 700 | 1 | |a Amaya, Michelle |e investigator |4 oth | |
| 700 | 1 | |a Jaroscak, Jennifer |e investigator |4 oth | |
| 700 | 1 | |a Kiger, James |e investigator |4 oth | |
| 700 | 1 | |a Macias, Michelle |e investigator |4 oth | |
| 700 | 1 | |a Titus, Olivia |e investigator |4 oth | |
| 700 | 1 | |a Awonuga, Modupe |e investigator |4 oth | |
| 700 | 1 | |a Vogt, Karen |e investigator |4 oth | |
| 700 | 1 | |a Warwick, Anne |e investigator |4 oth | |
| 700 | 1 | |a Coury, Dan |e investigator |4 oth | |
| 700 | 1 | |a Hall, Mark |e investigator |4 oth | |
| 700 | 1 | |a Letson, Megan |e investigator |4 oth | |
| 700 | 1 | |a Rose, Melissa |e investigator |4 oth | |
| 700 | 1 | |a Glickstein, Julie |e investigator |4 oth | |
| 700 | 1 | |a Lusman, Sarah |e investigator |4 oth | |
| 700 | 1 | |a Roskind, Cindy |e investigator |4 oth | |
| 700 | 1 | |a Soren, Karen |e investigator |4 oth | |
| 700 | 1 | |a Katz, Jason |e investigator |4 oth | |
| 700 | 1 | |a Siqueira, Lorena |e investigator |4 oth | |
| 700 | 1 | |a Atlas, Mark |e investigator |4 oth | |
| 700 | 1 | |a Blaufox, Andrew |e investigator |4 oth | |
| 700 | 1 | |a Gottleib, Beth |e investigator |4 oth | |
| 700 | 1 | |a Meryash, David |e investigator |4 oth | |
| 700 | 1 | |a Vuguin, Patricia |e investigator |4 oth | |
| 700 | 1 | |a Weinstein, Toba |e investigator |4 oth | |
| 700 | 1 | |a Armsby, Laurie |e investigator |4 oth | |
| 700 | 1 | |a Madison, Lisa |e investigator |4 oth | |
| 700 | 1 | |a Scottoline, Brian |e investigator |4 oth | |
| 773 | 0 | 8 | |i Enthalten in |t BMC medical education |d 2001 |g 23(2023), 1 vom: 03. Okt., Seite 720 |w (DE-627)NLM112079636 |x 1472-6920 |7 nnns |
| 773 | 1 | 8 | |g volume:23 |g year:2023 |g number:1 |g day:03 |g month:10 |g pages:720 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1186/s12909-023-04689-0 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 23 |j 2023 |e 1 |b 03 |c 10 |h 720 | ||