Bayesian Surprise Predicts Human Event Segmentation in Story Listening

© 2023 The Authors. Cognitive Science published by Wiley Periodicals LLC on behalf of Cognitive Science Society (CSS)..

Event segmentation theory posits that people segment continuous experience into discrete events and that event boundaries occur when there are large transient increases in prediction error. Here, we set out to test this theory in the context of story listening, by using a deep learning language model (GPT-2) to compute the predicted probability distribution of the next word, at each point in the story. For three stories, we used the probability distributions generated by GPT-2 to compute the time series of prediction error. We also asked participants to listen to these stories while marking event boundaries. We used regression models to relate the GPT-2 measures to the human segmentation data. We found that event boundaries are associated with transient increases in Bayesian surprise but not with a simpler measure of prediction error (surprisal) that tracks, for each word in the story, how strongly that word was predicted at the previous time point. These results support the hypothesis that prediction error serves as a control mechanism governing event segmentation and point to important differences between operational definitions of prediction error.

Medienart:

E-Artikel

Erscheinungsjahr:

2023

Erschienen:

2023

Enthalten in:

Zur Gesamtaufnahme - volume:47

Enthalten in:

Cognitive science - 47(2023), 10 vom: 22. Okt., Seite e13343

Sprache:

Englisch

Beteiligte Personen:

Kumar, Manoj [VerfasserIn]
Goldstein, Ariel [VerfasserIn]
Michelmann, Sebastian [VerfasserIn]
Zacks, Jeffrey M [VerfasserIn]
Hasson, Uri [VerfasserIn]
Norman, Kenneth A [VerfasserIn]

Links:

Volltext

Themen:

Bayesian surprise
Entropy
Event segmentation
GPT-2
Journal Article
Narratives
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Surprise

Anmerkungen:

Date Completed 31.10.2023

Date Revised 06.11.2023

published: Print

Citation Status MEDLINE

doi:

10.1111/cogs.13343

funding:

Förderinstitution / Projekttitel:

PPN (Katalog-ID):

NLM363596887