Adolescents flexibly adapt action selection based on controllability inferences
© 2024 Raab et al.; Published by Cold Spring Harbor Laboratory Press..
From early in life, we encounter both controllable environments, in which our actions can causally influence the reward outcomes we experience, and uncontrollable environments, in which they cannot. Environmental controllability is theoretically proposed to organize our behavior. In controllable contexts, we can learn to proactively select instrumental actions that bring about desired outcomes. In uncontrollable environments, Pavlovian learning enables hard-wired, reflexive reactions to anticipated, motivationally salient events, providing "default" behavioral responses. Previous studies characterizing the balance between Pavlovian and instrumental learning systems across development have yielded divergent findings, with some studies observing heightened expression of Pavlovian learning during adolescence and others observing a reduced influence of Pavlovian learning during this developmental stage. In this study, we aimed to investigate whether a theoretical model of controllability-dependent arbitration between learning systems might explain these seemingly divergent findings in the developmental literature, with the specific hypothesis that adolescents' action selection might be particularly sensitive to environmental controllability. To test this hypothesis, 90 participants, aged 8-27, performed a probabilistic-learning task that enables estimation of Pavlovian influence on instrumental learning, across both controllable and uncontrollable conditions. We fit participants' data with a reinforcement-learning model in which controllability inferences adaptively modulate the dominance of Pavlovian versus instrumental control. Relative to children and adults, adolescents exhibited greater flexibility in calibrating the expression of Pavlovian bias to the degree of environmental controllability. These findings suggest that sensitivity to environmental reward statistics that organize motivated behavior may be heightened during adolescence.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:31 |
|---|---|
| Enthalten in: |
Learning & memory (Cold Spring Harbor, N.Y.) - 31(2024), 3 vom: 23. März |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Raab, Hillary A [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 27.03.2024 Date Revised 10.04.2024 published: Electronic-Print Citation Status MEDLINE |
|---|
| doi: |
10.1101/lm.053901.123 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM370173066 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM370173066 | ||
| 003 | DE-627 | ||
| 005 | 20240410232756.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240327s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1101/lm.053901.123 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1371.xml |
| 035 | |a (DE-627)NLM370173066 | ||
| 035 | |a (NLM)38527752 | ||
| 035 | |a (PII)a053901 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Raab, Hillary A |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Adolescents flexibly adapt action selection based on controllability inferences |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 27.03.2024 | ||
| 500 | |a Date Revised 10.04.2024 | ||
| 500 | |a published: Electronic-Print | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2024 Raab et al.; Published by Cold Spring Harbor Laboratory Press. | ||
| 520 | |a From early in life, we encounter both controllable environments, in which our actions can causally influence the reward outcomes we experience, and uncontrollable environments, in which they cannot. Environmental controllability is theoretically proposed to organize our behavior. In controllable contexts, we can learn to proactively select instrumental actions that bring about desired outcomes. In uncontrollable environments, Pavlovian learning enables hard-wired, reflexive reactions to anticipated, motivationally salient events, providing "default" behavioral responses. Previous studies characterizing the balance between Pavlovian and instrumental learning systems across development have yielded divergent findings, with some studies observing heightened expression of Pavlovian learning during adolescence and others observing a reduced influence of Pavlovian learning during this developmental stage. In this study, we aimed to investigate whether a theoretical model of controllability-dependent arbitration between learning systems might explain these seemingly divergent findings in the developmental literature, with the specific hypothesis that adolescents' action selection might be particularly sensitive to environmental controllability. To test this hypothesis, 90 participants, aged 8-27, performed a probabilistic-learning task that enables estimation of Pavlovian influence on instrumental learning, across both controllable and uncontrollable conditions. We fit participants' data with a reinforcement-learning model in which controllability inferences adaptively modulate the dominance of Pavlovian versus instrumental control. Relative to children and adults, adolescents exhibited greater flexibility in calibrating the expression of Pavlovian bias to the degree of environmental controllability. These findings suggest that sensitivity to environmental reward statistics that organize motivated behavior may be heightened during adolescence | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Goldway, Noam |e verfasserin |4 aut | |
| 700 | 1 | |a Foord, Careen |e verfasserin |4 aut | |
| 700 | 1 | |a Hartley, Catherine A |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Learning & memory (Cold Spring Harbor, N.Y.) |d 1994 |g 31(2024), 3 vom: 23. März |w (DE-627)NLM093789912 |x 1549-5485 |7 nnns |
| 773 | 1 | 8 | |g volume:31 |g year:2024 |g number:3 |g day:23 |g month:03 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1101/lm.053901.123 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 31 |j 2024 |e 3 |b 23 |c 03 | ||