Exploring pooled analysis of pretested items to monitor the performance of medical students exposed to different curriculum designs
Several methods have been proposed for analyzing differences between test scores, such as using mean scores, cumulative deviation, and mixed-effect models. Here, we explore the pooled analysis of retested Progress Test items to monitor the performance of first-year medical students who were exposed to a new curriculum design. This was a cross-sectional study of students in their first year of a medical program who participated in the annual interinstitutional Progress Tests from 2013 to 2019. We analyzed the performance of first-year students in the 2019 test and compared it with that of first-year students taking the test from 2013 to 2018 and encountering the same items. For each item, we calculated odds ratios with 95% confidence intervals; we also performed meta-analyses with fixed effects for each content area in the pooled analysis and presented the odds ratio (OR) with a 95% confidence interval (CI). In all, we used 63 items, which were divided into basic sciences, internal medicine, pediatrics, surgery, obstetrics and gynecology, and public health. Significant differences were found between groups in basic sciences (OR = 1.172 [CI95% 1.005 CI 1.366], p = 0.043) and public health (OR = 1.54 [CI95% CI 1.25-1.897], p < 0.001), which may reflect the characteristics of the new curriculum. Thus, pooled analysis of pretested items may provide indicators of different performance. This method may complement analysis of score differences on benchmark assessments.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2021 |
|---|---|
| Erschienen: |
2021 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:16 |
|---|---|
| Enthalten in: |
PloS one - 16(2021), 9 vom: 28., Seite e0257293 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Hamamoto Filho, Pedro Tadao [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Journal Article |
|---|
| Anmerkungen: |
Date Completed 06.12.2021 Date Revised 14.12.2021 published: Electronic-eCollection Citation Status MEDLINE |
|---|
| doi: |
10.1371/journal.pone.0257293 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM33048818X |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM33048818X | ||
| 003 | DE-627 | ||
| 005 | 20231225211405.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2021 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1371/journal.pone.0257293 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1101.xml |
| 035 | |a (DE-627)NLM33048818X | ||
| 035 | |a (NLM)34506599 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Hamamoto Filho, Pedro Tadao |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Exploring pooled analysis of pretested items to monitor the performance of medical students exposed to different curriculum designs |
| 264 | 1 | |c 2021 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 06.12.2021 | ||
| 500 | |a Date Revised 14.12.2021 | ||
| 500 | |a published: Electronic-eCollection | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Several methods have been proposed for analyzing differences between test scores, such as using mean scores, cumulative deviation, and mixed-effect models. Here, we explore the pooled analysis of retested Progress Test items to monitor the performance of first-year medical students who were exposed to a new curriculum design. This was a cross-sectional study of students in their first year of a medical program who participated in the annual interinstitutional Progress Tests from 2013 to 2019. We analyzed the performance of first-year students in the 2019 test and compared it with that of first-year students taking the test from 2013 to 2018 and encountering the same items. For each item, we calculated odds ratios with 95% confidence intervals; we also performed meta-analyses with fixed effects for each content area in the pooled analysis and presented the odds ratio (OR) with a 95% confidence interval (CI). In all, we used 63 items, which were divided into basic sciences, internal medicine, pediatrics, surgery, obstetrics and gynecology, and public health. Significant differences were found between groups in basic sciences (OR = 1.172 [CI95% 1.005 CI 1.366], p = 0.043) and public health (OR = 1.54 [CI95% CI 1.25-1.897], p < 0.001), which may reflect the characteristics of the new curriculum. Thus, pooled analysis of pretested items may provide indicators of different performance. This method may complement analysis of score differences on benchmark assessments | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, N.I.H., Extramural | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 700 | 1 | |a Lourenção, Pedro Luiz Toledo de Arruda |e verfasserin |4 aut | |
| 700 | 1 | |a Abbade, Joélcio Francisco |e verfasserin |4 aut | |
| 700 | 1 | |a Cecílio-Fernandes, Dario |e verfasserin |4 aut | |
| 700 | 1 | |a Caramori, Jacqueline Teixeira |e verfasserin |4 aut | |
| 700 | 1 | |a Bicudo, Angélica Maria |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t PloS one |d 2006 |g 16(2021), 9 vom: 28., Seite e0257293 |w (DE-627)NLM167327399 |x 1932-6203 |7 nnns |
| 773 | 1 | 8 | |g volume:16 |g year:2021 |g number:9 |g day:28 |g pages:e0257293 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1371/journal.pone.0257293 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 16 |j 2021 |e 9 |b 28 |h e0257293 | ||