Onscreen presence of instructors in video lectures affects learners' neural synchrony and visual attention during multimedia learning

COVID-19 forced students to rely on online learning using multimedia tools, and multimedia learning continues to impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, and neuroimaging paradigms to identify multimedia learning processes and outcomes. College students viewed four video lectures including slides with either an onscreen human instructor, an animated instructor, or no onscreen instructor. Brain activity was recorded via fMRI, visual attention was recorded via eye-tracking, and learning outcome was assessed via post-tests. Onscreen presence of instructor, compared with no instructor presence, resulted in superior post-test performance, less visual attention on the slide, more synchronized eye movements during learning, and higher neural synchronization in cortical networks associated with socio-emotional processing and working memory. Individual variation in cognitive and socio-emotional abilities and intersubject neural synchronization revealed different levels of cognitive and socio-emotional processing in different learning conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra processing demands in attentional control, working memory engagement, and socio-emotional processing. Although human instructors and animated instructors led to comparable learning outcomes, the effects were due to the dynamic interplay of information processing vs. attentional distraction. These findings reflect a benefit-cost trade-off where multimedia learning outcome is enhanced only when the cognitive benefits motivated by the social presence of onscreen instructor outweigh the cognitive costs brought about by concurrent attentional distraction unrelated to learning.

Medienart:

E-Artikel

Erscheinungsjahr:

2024

Erschienen:

2024

Enthalten in:

Zur Gesamtaufnahme - volume:121

Enthalten in:

Proceedings of the National Academy of Sciences of the United States of America - 121(2024), 12 vom: 19. März, Seite e2309054121

Sprache:

Englisch

Beteiligte Personen:

Gu, Chanyuan [VerfasserIn]
Peng, Yingying [VerfasserIn]
Nastase, Samuel A [VerfasserIn]
Mayer, Richard E [VerfasserIn]
Li, Ping [VerfasserIn]

Links:

Volltext

Themen:

Individual difference
Journal Article
Multimedia learning
Neural synchrony
Socio-emotional processing
Visual attention

Anmerkungen:

Date Completed 13.03.2024

Date Revised 27.03.2024

published: Print-Electronic

Citation Status MEDLINE

doi:

10.1073/pnas.2309054121

funding:

Förderinstitution / Projekttitel:

PPN (Katalog-ID):

NLM369565665