A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
Abstract Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speaker’s brain before word articulation, and the same linguistic content rapidly reemerged in the listener’s brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts..
Medienart: |
Preprint |
---|
Erscheinungsjahr: |
2023 |
---|---|
Erschienen: |
2023 |
Enthalten in: |
bioRxiv.org - (2023) vom: 03. Juli Zur Gesamtaufnahme - year:2023 |
---|
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Zada, Zaid [VerfasserIn] |
---|
Links: |
Volltext [kostenfrei] |
---|
Themen: |
---|
doi: |
10.1101/2023.06.27.546708 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
XBI040056279 |
---|
LEADER | 01000caa a22002652 4500 | ||
---|---|---|---|
001 | XBI040056279 | ||
003 | DE-627 | ||
005 | 20231205144746.0 | ||
007 | cr uuu---uuuuu | ||
008 | 230630s2023 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1101/2023.06.27.546708 |2 doi | |
035 | |a (DE-627)XBI040056279 | ||
035 | |a (biorXiv)10.1101/2023.06.27.546708 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Zada, Zaid |e verfasserin |0 (orcid)0000-0002-3096-0059 |4 aut | |
245 | 1 | 0 | |a A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations |
264 | 1 | |c 2023 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a Computermedien |b c |2 rdamedia | ||
338 | |a Online-Ressource |b cr |2 rdacarrier | ||
520 | |a Abstract Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speaker’s brain before word articulation, and the same linguistic content rapidly reemerged in the listener’s brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts. | ||
650 | 4 | |a Biology |7 (dpeaa)DE-84 | |
650 | 4 | |a 570 |7 (dpeaa)DE-84 | |
700 | 1 | |a Goldstein, Ariel |4 aut | |
700 | 1 | |a Michelmann, Sebastian |4 aut | |
700 | 1 | |a Simony, Erez |4 aut | |
700 | 1 | |a Price, Amy |4 aut | |
700 | 1 | |a Hasenfratz, Liat |4 aut | |
700 | 1 | |a Barham, Emily |4 aut | |
700 | 1 | |a Zadbood, Asieh |0 (orcid)0000-0002-9098-0510 |4 aut | |
700 | 1 | |a Doyle, Werner |4 aut | |
700 | 1 | |a Friedman, Daniel |4 aut | |
700 | 1 | |a Dugan, Patricia |4 aut | |
700 | 1 | |a Melloni, Lucia |4 aut | |
700 | 1 | |a Devore, Sasha |4 aut | |
700 | 1 | |a Flinker, Adeen |4 aut | |
700 | 1 | |a Devinsky, Orrin |4 aut | |
700 | 1 | |a Nastase, Samuel A. |0 (orcid)0000-0001-7013-5275 |4 aut | |
700 | 1 | |a Hasson, Uri |0 (orcid)0000-0002-3599-7168 |4 aut | |
773 | 0 | 8 | |i Enthalten in |t bioRxiv.org |g (2023) vom: 03. Juli |
773 | 1 | 8 | |g year:2023 |g day:03 |g month:07 |
856 | 4 | 0 | |u http://dx.doi.org/10.1101/2023.06.27.546708 |z kostenfrei |3 Volltext |
912 | |a GBV_XBI | ||
951 | |a AR | ||
952 | |j 2023 |b 03 |c 07 |