A minimal model of learning : quantifying the cost and benefit of learning in changing environments
Many organisms have the ability to learn, but the costs and benefits of learning are difficult to quantify. We construct a minimal mathematical model of learning in which a forager attempts to maximize the amount of resources (food) it collects in a changing environment. Our model has two learning parameters: α, corresponding to the duration of the forager's memory, and [Formula: see text], corresponding to how much the forager explores the environment to learn more about it. We analyse the effect of different regimes of environmental change on the optimal memory and exploration parameters [Formula: see text]. By comparing the fitness outcomes from learning foragers to the outcomes from foragers following fixed strategies, we explicitly quantify the fitness benefit (or cost) of learning as a function of environmental change. We find that in many environments, the marginal benefit of learning is surprisingly small. In every environment, it is possible to implement learning in such a way that performance is as bad or worse than following a fixed strategy. In some environments, even the best implementations of our minimal model of learning perform worse than the best fixed strategy. Finally, we find that variance in resource values negatively biases foragers' estimates for those values, potentially explaining experimental results showing that animals prefer less variable resources.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:290 |
|---|---|
| Enthalten in: |
Proceedings. Biological sciences - 290(2023), 2005 vom: 30. Aug., Seite 20231084 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Arehart, Emerson [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Changing environments |
|---|
| Anmerkungen: |
Date Completed 31.08.2023 Date Revised 14.09.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1098/rspb.2023.1084 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM361427255 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM361427255 | ||
| 003 | DE-627 | ||
| 005 | 20231226085120.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1098/rspb.2023.1084 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1204.xml |
| 035 | |a (DE-627)NLM361427255 | ||
| 035 | |a (NLM)37644832 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Arehart, Emerson |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A minimal model of learning |b quantifying the cost and benefit of learning in changing environments |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 31.08.2023 | ||
| 500 | |a Date Revised 14.09.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Many organisms have the ability to learn, but the costs and benefits of learning are difficult to quantify. We construct a minimal mathematical model of learning in which a forager attempts to maximize the amount of resources (food) it collects in a changing environment. Our model has two learning parameters: α, corresponding to the duration of the forager's memory, and [Formula: see text], corresponding to how much the forager explores the environment to learn more about it. We analyse the effect of different regimes of environmental change on the optimal memory and exploration parameters [Formula: see text]. By comparing the fitness outcomes from learning foragers to the outcomes from foragers following fixed strategies, we explicitly quantify the fitness benefit (or cost) of learning as a function of environmental change. We find that in many environments, the marginal benefit of learning is surprisingly small. In every environment, it is possible to implement learning in such a way that performance is as bad or worse than following a fixed strategy. In some environments, even the best implementations of our minimal model of learning perform worse than the best fixed strategy. Finally, we find that variance in resource values negatively biases foragers' estimates for those values, potentially explaining experimental results showing that animals prefer less variable resources | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a changing environments | |
| 650 | 4 | |a foraging strategy | |
| 650 | 4 | |a multi-armed bandit | |
| 650 | 4 | |a optimal foraging | |
| 650 | 4 | |a reinforcement learning | |
| 650 | 4 | |a restless bandit | |
| 700 | 1 | |a Adler, Frederick R |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Proceedings. Biological sciences |d 1990 |g 290(2023), 2005 vom: 30. Aug., Seite 20231084 |w (DE-627)NLM012597821 |x 1471-2954 |7 nnns |
| 773 | 1 | 8 | |g volume:290 |g year:2023 |g number:2005 |g day:30 |g month:08 |g pages:20231084 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1098/rspb.2023.1084 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 290 |j 2023 |e 2005 |b 30 |c 08 |h 20231084 | ||