Embracing curiosity eliminates the exploration-exploitation dilemma
Balancing exploration with exploitation is seen as a mathematically intractable dilemma that all animals face. In this paper, we provide an alternative view of this classic problem that does not depend on exploring to optimize for reward. We argue that the goal of exploration should be pure curiosity, or learning for learning’s sake. Through theory and simulations we prove that explore-exploit problems based on this can be solved by a simple rule that yields optimal solutions: when information is more valuable than rewards, be curious, otherwise seek rewards. We show that this rule performs well and robustly under naturalistic constraints. We suggest three criteria can be used to distinguish our approach from other theories..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
bioRxiv.org - (2022) vom: 17. Jan. Zur Gesamtaufnahme - year:2022 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Peterson, Erik J [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| doi: |
10.1101/671362 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
XBI00054471X |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | XBI00054471X | ||
| 003 | DE-627 | ||
| 005 | 20230429080118.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 200312s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1101/671362 |2 doi | |
| 035 | |a (DE-627)XBI00054471X | ||
| 035 | |a (biorXiv)10.1101/671362 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 082 | 0 | |a 570 |q DE-84 | |
| 100 | 1 | |a Peterson, Erik J |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Embracing curiosity eliminates the exploration-exploitation dilemma |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a Balancing exploration with exploitation is seen as a mathematically intractable dilemma that all animals face. In this paper, we provide an alternative view of this classic problem that does not depend on exploring to optimize for reward. We argue that the goal of exploration should be pure curiosity, or learning for learning’s sake. Through theory and simulations we prove that explore-exploit problems based on this can be solved by a simple rule that yields optimal solutions: when information is more valuable than rewards, be curious, otherwise seek rewards. We show that this rule performs well and robustly under naturalistic constraints. We suggest three criteria can be used to distinguish our approach from other theories. | ||
| 700 | 1 | |a Verstynen, Timothy D |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t bioRxiv.org |g (2022) vom: 17. Jan. |
| 773 | 1 | 8 | |g year:2022 |g day:17 |g month:01 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1101/671362 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XBI | ||
| 912 | |a SSG-OLC-PHA | ||
| 951 | |a AR | ||
| 952 | |j 2022 |b 17 |c 01 | ||
| 953 | |2 045F |a 570 | ||