Perspective changes in human listeners are aligned with the contextual transformation of the word embedding space
© The Author(s) 2023. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissionoup.com..
Word embedding representations have been shown to be effective in predicting human neural responses to lingual stimuli. While these representations are sensitive to the textual context, they lack the extratextual sources of context such as prior knowledge, thoughts, and beliefs, all of which constitute the listener's perspective. In this study, we propose conceptualizing the listeners' perspective as a source that induces changes in the embedding space. We relied on functional magnetic resonance imaging data collected by Yeshurun Y, Swanson S, Simony E, Chen J, Lazaridi C, Honey CJ, Hasson U. Same story, different story: the neural representation of interpretive frameworks. Psychol Sci. 2017:28(3):307-319, in which two groups of human listeners (n = 40) were listening to the same story but with different perspectives. Using a dedicated fine-tuning process, we created two modified versions of a word embedding space, corresponding to the two groups of listeners. We found that each transformed space was better fitted with neural responses of the corresponding group, and that the spatial distances between these spaces reflect both interpretational differences between the perspectives and the group-level neural differences. Together, our results demonstrate how aligning a continuous embedding space to a specific context can provide a novel way of modeling listeners' intrinsic perspectives.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:33 |
|---|---|
| Enthalten in: |
Cerebral cortex (New York, N.Y. : 1991) - 33(2023), 12 vom: 08. Juni, Seite 7830-7842 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Tikochinski, Refael [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Computational modeling |
|---|
| Anmerkungen: |
Date Completed 16.06.2023 Date Revised 21.06.2023 published: Print Citation Status MEDLINE |
|---|
| doi: |
10.1093/cercor/bhad082 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM354446959 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM354446959 | ||
| 003 | DE-627 | ||
| 005 | 20231226062236.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1093/cercor/bhad082 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1181.xml |
| 035 | |a (DE-627)NLM354446959 | ||
| 035 | |a (NLM)36939309 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Tikochinski, Refael |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Perspective changes in human listeners are aligned with the contextual transformation of the word embedding space |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 16.06.2023 | ||
| 500 | |a Date Revised 21.06.2023 | ||
| 500 | |a published: Print | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © The Author(s) 2023. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissionoup.com. | ||
| 520 | |a Word embedding representations have been shown to be effective in predicting human neural responses to lingual stimuli. While these representations are sensitive to the textual context, they lack the extratextual sources of context such as prior knowledge, thoughts, and beliefs, all of which constitute the listener's perspective. In this study, we propose conceptualizing the listeners' perspective as a source that induces changes in the embedding space. We relied on functional magnetic resonance imaging data collected by Yeshurun Y, Swanson S, Simony E, Chen J, Lazaridi C, Honey CJ, Hasson U. Same story, different story: the neural representation of interpretive frameworks. Psychol Sci. 2017:28(3):307-319, in which two groups of human listeners (n = 40) were listening to the same story but with different perspectives. Using a dedicated fine-tuning process, we created two modified versions of a word embedding space, corresponding to the two groups of listeners. We found that each transformed space was better fitted with neural responses of the corresponding group, and that the spatial distances between these spaces reflect both interpretational differences between the perspectives and the group-level neural differences. Together, our results demonstrate how aligning a continuous embedding space to a specific context can provide a novel way of modeling listeners' intrinsic perspectives | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a computational modeling | |
| 650 | 4 | |a contextual transformation | |
| 650 | 4 | |a listeners’ perspective | |
| 650 | 4 | |a neural encoding | |
| 700 | 1 | |a Goldstein, Ariel |e verfasserin |4 aut | |
| 700 | 1 | |a Yeshurun, Yaara |e verfasserin |4 aut | |
| 700 | 1 | |a Hasson, Uri |e verfasserin |4 aut | |
| 700 | 1 | |a Reichart, Roi |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Cerebral cortex (New York, N.Y. : 1991) |d 1997 |g 33(2023), 12 vom: 08. Juni, Seite 7830-7842 |w (DE-627)NLM012627887 |x 1460-2199 |7 nnns |
| 773 | 1 | 8 | |g volume:33 |g year:2023 |g number:12 |g day:08 |g month:06 |g pages:7830-7842 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1093/cercor/bhad082 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 33 |j 2023 |e 12 |b 08 |c 06 |h 7830-7842 | ||