Onscreen presence of instructors in video lectures affects learners' neural synchrony and visual attention during multimedia learning
COVID-19 forced students to rely on online learning using multimedia tools, and multimedia learning continues to impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, and neuroimaging paradigms to identify multimedia learning processes and outcomes. College students viewed four video lectures including slides with either an onscreen human instructor, an animated instructor, or no onscreen instructor. Brain activity was recorded via fMRI, visual attention was recorded via eye-tracking, and learning outcome was assessed via post-tests. Onscreen presence of instructor, compared with no instructor presence, resulted in superior post-test performance, less visual attention on the slide, more synchronized eye movements during learning, and higher neural synchronization in cortical networks associated with socio-emotional processing and working memory. Individual variation in cognitive and socio-emotional abilities and intersubject neural synchronization revealed different levels of cognitive and socio-emotional processing in different learning conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra processing demands in attentional control, working memory engagement, and socio-emotional processing. Although human instructors and animated instructors led to comparable learning outcomes, the effects were due to the dynamic interplay of information processing vs. attentional distraction. These findings reflect a benefit-cost trade-off where multimedia learning outcome is enhanced only when the cognitive benefits motivated by the social presence of onscreen instructor outweigh the cognitive costs brought about by concurrent attentional distraction unrelated to learning.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2024 |
---|---|
Erschienen: |
2024 |
Enthalten in: |
Zur Gesamtaufnahme - volume:121 |
---|---|
Enthalten in: |
Proceedings of the National Academy of Sciences of the United States of America - 121(2024), 12 vom: 19. März, Seite e2309054121 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Gu, Chanyuan [VerfasserIn] |
---|
Links: |
---|
Themen: |
Individual difference |
---|
Anmerkungen: |
Date Completed 13.03.2024 Date Revised 27.03.2024 published: Print-Electronic Citation Status MEDLINE |
---|
doi: |
10.1073/pnas.2309054121 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM369565665 |
---|
LEADER | 01000caa a22002652 4500 | ||
---|---|---|---|
001 | NLM369565665 | ||
003 | DE-627 | ||
005 | 20240328000116.0 | ||
007 | cr uuu---uuuuu | ||
008 | 240312s2024 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1073/pnas.2309054121 |2 doi | |
028 | 5 | 2 | |a pubmed24n1351.xml |
035 | |a (DE-627)NLM369565665 | ||
035 | |a (NLM)38466840 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Gu, Chanyuan |e verfasserin |4 aut | |
245 | 1 | 0 | |a Onscreen presence of instructors in video lectures affects learners' neural synchrony and visual attention during multimedia learning |
264 | 1 | |c 2024 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Completed 13.03.2024 | ||
500 | |a Date Revised 27.03.2024 | ||
500 | |a published: Print-Electronic | ||
500 | |a Citation Status MEDLINE | ||
520 | |a COVID-19 forced students to rely on online learning using multimedia tools, and multimedia learning continues to impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, and neuroimaging paradigms to identify multimedia learning processes and outcomes. College students viewed four video lectures including slides with either an onscreen human instructor, an animated instructor, or no onscreen instructor. Brain activity was recorded via fMRI, visual attention was recorded via eye-tracking, and learning outcome was assessed via post-tests. Onscreen presence of instructor, compared with no instructor presence, resulted in superior post-test performance, less visual attention on the slide, more synchronized eye movements during learning, and higher neural synchronization in cortical networks associated with socio-emotional processing and working memory. Individual variation in cognitive and socio-emotional abilities and intersubject neural synchronization revealed different levels of cognitive and socio-emotional processing in different learning conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra processing demands in attentional control, working memory engagement, and socio-emotional processing. Although human instructors and animated instructors led to comparable learning outcomes, the effects were due to the dynamic interplay of information processing vs. attentional distraction. These findings reflect a benefit-cost trade-off where multimedia learning outcome is enhanced only when the cognitive benefits motivated by the social presence of onscreen instructor outweigh the cognitive costs brought about by concurrent attentional distraction unrelated to learning | ||
650 | 4 | |a Journal Article | |
650 | 4 | |a individual difference | |
650 | 4 | |a multimedia learning | |
650 | 4 | |a neural synchrony | |
650 | 4 | |a socio-emotional processing | |
650 | 4 | |a visual attention | |
700 | 1 | |a Peng, Yingying |e verfasserin |4 aut | |
700 | 1 | |a Nastase, Samuel A |e verfasserin |4 aut | |
700 | 1 | |a Mayer, Richard E |e verfasserin |4 aut | |
700 | 1 | |a Li, Ping |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Proceedings of the National Academy of Sciences of the United States of America |d 1915 |g 121(2024), 12 vom: 19. März, Seite e2309054121 |w (DE-627)NLM000008982 |x 1091-6490 |7 nnns |
773 | 1 | 8 | |g volume:121 |g year:2024 |g number:12 |g day:19 |g month:03 |g pages:e2309054121 |
856 | 4 | 0 | |u http://dx.doi.org/10.1073/pnas.2309054121 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 121 |j 2024 |e 12 |b 19 |c 03 |h e2309054121 |