Does it make sense to use written instruments to assess communication skills? Systematic review on the concurrent and predictive value of written assessment for performance
Copyright © 2023 Elsevier B.V. All rights reserved..
OBJECTIVES: To evaluate possible associations between learners' results in written and performance-based assessments of communication skills (CS), either in concurrent or predictive study designs.
METHODS: Search included four databases for peer-reviewed studies containing both written and performance-based CS assessment. Eleven studies met the inclusion criteria.
RESULTS: Included studies predominantly assessed undergraduate medical students. Studies reported mainly low to medium correlations between written and performance-based assessment results (Objective Structured Clinical Examinations or encounters with simulated patients), and gave correlation coefficients ranging from 0.13 to 0.53 (p < 0.05). Higher correlations were reported when specific CS, like motivational interviewing were assessed. Only a few studies gave sufficient reliability indicators of both assessment formats.
CONCLUSIONS: Written assessment scores seem to predict performance-based assessments to a limited extent but cannot replace them entirely. Reporting of assessment instruments' psychometric properties is essential to improve the interpretation of future findings and could possibly affect their predictive validity for performance.
PRACTICE IMPLICATIONS: Within longitudinal CS assessment programs, triangulation of assessment including written assessment is recommended, taking into consideration possible limitations. Written assessments with feedback can help students and trainers to elaborate on procedural knowledge as a strong support for the acquisition and transfer of CS to different contexts.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:108 |
|---|---|
| Enthalten in: |
Patient education and counseling - 108(2023) vom: 15. März, Seite 107612 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Kiessling, Claudia [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Communication skills |
|---|
| Anmerkungen: |
Date Completed 30.01.2023 Date Revised 05.02.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.pec.2022.107612 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM35114627X |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM35114627X | ||
| 003 | DE-627 | ||
| 005 | 20231226050639.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.pec.2022.107612 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1170.xml |
| 035 | |a (DE-627)NLM35114627X | ||
| 035 | |a (NLM)36603470 | ||
| 035 | |a (PII)S0738-3991(22)00896-5 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Kiessling, Claudia |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Does it make sense to use written instruments to assess communication skills? Systematic review on the concurrent and predictive value of written assessment for performance |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 30.01.2023 | ||
| 500 | |a Date Revised 05.02.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2023 Elsevier B.V. All rights reserved. | ||
| 520 | |a OBJECTIVES: To evaluate possible associations between learners' results in written and performance-based assessments of communication skills (CS), either in concurrent or predictive study designs | ||
| 520 | |a METHODS: Search included four databases for peer-reviewed studies containing both written and performance-based CS assessment. Eleven studies met the inclusion criteria | ||
| 520 | |a RESULTS: Included studies predominantly assessed undergraduate medical students. Studies reported mainly low to medium correlations between written and performance-based assessment results (Objective Structured Clinical Examinations or encounters with simulated patients), and gave correlation coefficients ranging from 0.13 to 0.53 (p < 0.05). Higher correlations were reported when specific CS, like motivational interviewing were assessed. Only a few studies gave sufficient reliability indicators of both assessment formats | ||
| 520 | |a CONCLUSIONS: Written assessment scores seem to predict performance-based assessments to a limited extent but cannot replace them entirely. Reporting of assessment instruments' psychometric properties is essential to improve the interpretation of future findings and could possibly affect their predictive validity for performance | ||
| 520 | |a PRACTICE IMPLICATIONS: Within longitudinal CS assessment programs, triangulation of assessment including written assessment is recommended, taking into consideration possible limitations. Written assessments with feedback can help students and trainers to elaborate on procedural knowledge as a strong support for the acquisition and transfer of CS to different contexts | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Systematic Review | |
| 650 | 4 | |a Communication skills | |
| 650 | 4 | |a Health professionals | |
| 650 | 4 | |a Performance-based assessment | |
| 650 | 4 | |a Written assessment | |
| 700 | 1 | |a Perron, Noelle Junod |e verfasserin |4 aut | |
| 700 | 1 | |a van Nuland, Marc |e verfasserin |4 aut | |
| 700 | 1 | |a Bujnowska-Fedak, Maria Magdalena |e verfasserin |4 aut | |
| 700 | 1 | |a Essers, Geurt |e verfasserin |4 aut | |
| 700 | 1 | |a Joakimsen, Ragnar M |e verfasserin |4 aut | |
| 700 | 1 | |a Pype, Peter |e verfasserin |4 aut | |
| 700 | 1 | |a Tsimtsiou, Zoi |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Patient education and counseling |d 1983 |g 108(2023) vom: 15. März, Seite 107612 |w (DE-627)NLM012798649 |x 1873-5134 |7 nnns |
| 773 | 1 | 8 | |g volume:108 |g year:2023 |g day:15 |g month:03 |g pages:107612 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.pec.2022.107612 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 108 |j 2023 |b 15 |c 03 |h 107612 | ||