Generative models, linguistic communication and active inference
Copyright © 2020 The Author(s). Published by Elsevier Ltd.. All rights reserved..
This paper presents a biologically plausible generative model and inference scheme that is capable of simulating communication between synthetic subjects who talk to each other. Building on active inference formulations of dyadic interactions, we simulate linguistic exchange to explore generative models that support dialogues. These models employ high-order interactions among abstract (discrete) states in deep (hierarchical) models. The sequential nature of language processing mandates generative models with a particular factorial structure-necessary to accommodate the rich combinatorics of language. We illustrate linguistic communication by simulating a synthetic subject who can play the 'Twenty Questions' game. In this game, synthetic subjects take the role of the questioner or answerer, using the same generative model. This simulation setup is used to illustrate some key architectural points and demonstrate that many behavioural and neurophysiological correlates of linguistic communication emerge under variational (marginal) message passing, given the right kind of generative model. For example, we show that theta-gamma coupling is an emergent property of belief updating, when listening to another.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2020 |
|---|---|
| Erschienen: |
2020 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:118 |
|---|---|
| Enthalten in: |
Neuroscience and biobehavioral reviews - 118(2020) vom: 02. Nov., Seite 42-64 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Friston, Karl J [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Bayesian |
|---|
| Anmerkungen: |
Date Completed 21.06.2021 Date Revised 10.11.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.neubiorev.2020.07.005 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM312641974 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM312641974 | ||
| 003 | DE-627 | ||
| 005 | 20231225144844.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2020 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.neubiorev.2020.07.005 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1042.xml |
| 035 | |a (DE-627)NLM312641974 | ||
| 035 | |a (NLM)32687883 | ||
| 035 | |a (PII)S0149-7634(20)30466-8 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Friston, Karl J |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Generative models, linguistic communication and active inference |
| 264 | 1 | |c 2020 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 21.06.2021 | ||
| 500 | |a Date Revised 10.11.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2020 The Author(s). Published by Elsevier Ltd.. All rights reserved. | ||
| 520 | |a This paper presents a biologically plausible generative model and inference scheme that is capable of simulating communication between synthetic subjects who talk to each other. Building on active inference formulations of dyadic interactions, we simulate linguistic exchange to explore generative models that support dialogues. These models employ high-order interactions among abstract (discrete) states in deep (hierarchical) models. The sequential nature of language processing mandates generative models with a particular factorial structure-necessary to accommodate the rich combinatorics of language. We illustrate linguistic communication by simulating a synthetic subject who can play the 'Twenty Questions' game. In this game, synthetic subjects take the role of the questioner or answerer, using the same generative model. This simulation setup is used to illustrate some key architectural points and demonstrate that many behavioural and neurophysiological correlates of linguistic communication emerge under variational (marginal) message passing, given the right kind of generative model. For example, we show that theta-gamma coupling is an emergent property of belief updating, when listening to another | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a Review | |
| 650 | 4 | |a Bayesian | |
| 650 | 4 | |a Connectivity | |
| 650 | 4 | |a Free energy | |
| 650 | 4 | |a Hierarchical | |
| 650 | 4 | |a Inference | |
| 650 | 4 | |a Language | |
| 650 | 4 | |a Message passing | |
| 650 | 4 | |a Neuronal | |
| 700 | 1 | |a Parr, Thomas |e verfasserin |4 aut | |
| 700 | 1 | |a Yufik, Yan |e verfasserin |4 aut | |
| 700 | 1 | |a Sajid, Noor |e verfasserin |4 aut | |
| 700 | 1 | |a Price, Catherine J |e verfasserin |4 aut | |
| 700 | 1 | |a Holmes, Emma |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Neuroscience and biobehavioral reviews |d 1982 |g 118(2020) vom: 02. Nov., Seite 42-64 |w (DE-627)NLM000456977 |x 1873-7528 |7 nnns |
| 773 | 1 | 8 | |g volume:118 |g year:2020 |g day:02 |g month:11 |g pages:42-64 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.neubiorev.2020.07.005 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 118 |j 2020 |b 02 |c 11 |h 42-64 | ||